Oct 25 21:10:53 user nova-compute[74189]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74189) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 25 21:10:53 user nova-compute[74189]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74189) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 25 21:10:53 user nova-compute[74189]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74189) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 25 21:10:53 user nova-compute[74189]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 25 21:10:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:10:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.023s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:10:53 user nova-compute[74189]: INFO nova.virt.driver [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 25 21:10:54 user nova-compute[74189]: INFO nova.compute.provider_config [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] Acquiring lock "singleton_lock" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] Acquired lock "singleton_lock" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] Releasing lock "singleton_lock" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] Full set of CONF: {{(pid=74189) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] ******************************************************************************** {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] Configuration options gathered from: {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] ================================================================================ {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] allow_resize_to_same_host      = True {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] arq_binding_timeout            = 300 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] backdoor_port                  = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] backdoor_socket                = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] block_device_allocate_retries  = 300 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] block_device_allocate_retries_interval = 5 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cert                           = self.pem {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] compute_monitors               = [] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] config_dir                     = [] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] config_drive_format            = iso9660 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] config_source                  = [] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] console_host                   = user {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] control_exchange               = nova {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cpu_allocation_ratio           = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] daemon                         = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] debug                          = True {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] default_access_ip_network_name = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] default_availability_zone      = nova {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] default_ephemeral_format       = ext4 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] default_green_pool_size        = 1000 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] default_schedule_zone          = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] disk_allocation_ratio          = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] enable_new_services            = True {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] enabled_ssl_apis               = [] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] flat_injected                  = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] force_config_drive             = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] force_raw_images               = True {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] graceful_shutdown_timeout      = 5 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] heal_instance_info_cache_interval = 60 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] host                           = user {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] instance_build_timeout         = 0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] instance_delete_interval       = 300 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] instance_name_template         = instance-%08x {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] instance_usage_audit           = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] instance_usage_audit_period    = month {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] internal_service_availability_zone = internal {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] key                            = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] live_migration_retry_count     = 30 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] log_config_append              = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] log_dir                        = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] log_file                       = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] log_options                    = True {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] log_rotate_interval            = 1 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] log_rotate_interval_type       = days {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] log_rotation_type              = none {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] long_rpc_timeout               = 1800 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] max_concurrent_builds          = 10 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] max_concurrent_live_migrations = 1 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] max_concurrent_snapshots       = 5 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] max_local_block_devices        = 3 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] max_logfile_count              = 30 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] max_logfile_size_mb            = 200 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] maximum_instance_delete_attempts = 5 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] metadata_listen                = 0.0.0.0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] metadata_listen_port           = 8775 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] metadata_workers               = 3 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] migrate_max_retries            = -1 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] mkisofs_cmd                    = genisoimage {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] my_ip                          = 10.0.0.210 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] network_allocate_retries       = 0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] osapi_compute_listen_port      = 8774 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] osapi_compute_unique_server_name_scope =  {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] osapi_compute_workers          = 3 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] password_length                = 12 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] periodic_enable                = True {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] periodic_fuzzy_delay           = 60 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] pointer_model                  = ps2mouse {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] preallocate_images             = none {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] publish_errors                 = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] pybasedir                      = /opt/stack/nova {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] ram_allocation_ratio           = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] rate_limit_burst               = 0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] rate_limit_except_level        = CRITICAL {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] rate_limit_interval            = 0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] reboot_timeout                 = 0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] reclaim_instance_interval      = 0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] record                         = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] reimage_timeout_per_gb         = 60 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] report_interval                = 120 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] rescue_timeout                 = 0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] reserved_host_cpus             = 0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] reserved_host_disk_mb          = 0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] reserved_host_memory_mb        = 512 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] reserved_huge_pages            = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] resize_confirm_window          = 0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] resize_fs_using_block_device   = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] resume_guests_state_on_host_boot = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] rpc_response_timeout           = 60 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] run_external_periodic_tasks    = True {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] running_deleted_instance_action = reap {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] running_deleted_instance_timeout = 0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] scheduler_instance_sync_interval = 120 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] service_down_time              = 720 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] servicegroup_driver            = db {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] shelved_offload_time           = 0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] shelved_poll_interval          = 3600 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] shutdown_timeout               = 0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] source_is_ipv6                 = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] ssl_only                       = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] state_path                     = /opt/stack/data/nova {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] sync_power_state_interval      = 600 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] sync_power_state_pool_size     = 1000 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] syslog_log_facility            = LOG_USER {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] tempdir                        = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] timeout_nbd                    = 10 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] transport_url                  = **** {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] update_resources_interval      = 0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] use_cow_images                 = True {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] use_eventlog                   = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] use_journal                    = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] use_json                       = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] use_rootwrap_daemon            = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] use_stderr                     = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] use_syslog                     = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vcpu_pin_set                   = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vif_plugging_is_fatal          = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vif_plugging_timeout           = 0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] virt_mkfs                      = [] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] volume_usage_poll_interval     = 0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] watch_log_file                 = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] web                            = /usr/share/spice-html5 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_concurrency.disable_process_locking = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api.auth_strategy              = keystone {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api.compute_link_prefix        = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api.dhcp_domain                = novalocal {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api.enable_instance_password   = True {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api.glance_link_prefix         = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api.instance_list_per_project_cells = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api.list_records_by_skipping_down_cells = True {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api.local_metadata_per_cell    = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api.max_limit                  = 1000 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api.metadata_cache_expiration  = 15 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api.neutron_default_tenant_id  = default {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api.use_forwarded_for          = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api.use_neutron_default_nets   = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api.vendordata_dynamic_targets = [] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api.vendordata_jsonfile_path   = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cache.backend_argument         = **** {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cache.config_prefix            = cache.oslo {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cache.dead_timeout             = 60.0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cache.debug_cache_backend      = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cache.enable_retry_client      = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cache.enable_socket_keepalive  = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cache.enabled                  = True {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cache.expiration_time          = 600 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cache.hashclient_retry_attempts = 2 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cache.memcache_dead_retry      = 300 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cache.memcache_password        =  {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cache.memcache_sasl_enabled    = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cache.memcache_username        =  {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cache.proxies                  = [] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cache.retry_attempts           = 2 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cache.retry_delay              = 0.0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cache.socket_keepalive_count   = 1 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cache.socket_keepalive_idle    = 1 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cache.socket_keepalive_interval = 1 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cache.tls_allowed_ciphers      = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cache.tls_cafile               = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cache.tls_certfile             = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cache.tls_enabled              = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cache.tls_keyfile              = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cinder.auth_section            = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cinder.auth_type               = password {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cinder.cafile                  = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cinder.certfile                = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cinder.collect_timing          = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cinder.cross_az_attach         = True {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cinder.debug                   = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cinder.endpoint_template       = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cinder.http_retries            = 3 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cinder.insecure                = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cinder.keyfile                 = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cinder.os_region_name          = RegionOne {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cinder.split_loggers           = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cinder.timeout                 = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] compute.cpu_dedicated_set      = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] compute.cpu_shared_set         = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] compute.image_type_exclude_list = [] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] compute.resource_provider_association_refresh = 300 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] compute.shutdown_retry_interval = 10 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] conductor.workers              = 3 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] console.allowed_origins        = [] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] console.ssl_ciphers            = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] console.ssl_minimum_version    = default {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] consoleauth.token_ttl          = 600 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cyborg.cafile                  = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cyborg.certfile                = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cyborg.collect_timing          = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cyborg.connect_retries         = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cyborg.connect_retry_delay     = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cyborg.endpoint_override       = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cyborg.insecure                = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cyborg.keyfile                 = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cyborg.max_version             = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cyborg.min_version             = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cyborg.region_name             = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cyborg.service_name            = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cyborg.service_type            = accelerator {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cyborg.split_loggers           = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cyborg.status_code_retries     = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cyborg.status_code_retry_delay = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cyborg.timeout                 = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] cyborg.version                 = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] database.backend               = sqlalchemy {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] database.connection            = **** {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] database.connection_debug      = 0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] database.connection_parameters =  {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] database.connection_recycle_time = 3600 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] database.connection_trace      = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] database.db_inc_retry_interval = True {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] database.db_max_retries        = 20 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] database.db_max_retry_interval = 10 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] database.db_retry_interval     = 1 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] database.max_overflow          = 50 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] database.max_pool_size         = 5 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] database.max_retries           = 10 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] database.mysql_wsrep_sync_wait = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] database.pool_timeout          = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] database.retry_interval        = 10 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] database.slave_connection      = **** {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] database.sqlite_synchronous    = True {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api_database.backend           = sqlalchemy {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api_database.connection        = **** {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api_database.connection_debug  = 0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api_database.connection_parameters =  {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api_database.connection_recycle_time = 3600 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api_database.connection_trace  = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api_database.db_inc_retry_interval = True {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api_database.db_max_retries    = 20 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api_database.db_max_retry_interval = 10 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api_database.db_retry_interval = 1 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api_database.max_overflow      = 50 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api_database.max_pool_size     = 5 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api_database.max_retries       = 10 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api_database.pool_timeout      = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api_database.retry_interval    = 10 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api_database.slave_connection  = **** {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] api_database.sqlite_synchronous = True {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] devices.enabled_mdev_types     = [] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] ephemeral_storage_encryption.enabled = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] glance.api_servers             = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] glance.cafile                  = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] glance.certfile                = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] glance.collect_timing          = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] glance.connect_retries         = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] glance.connect_retry_delay     = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] glance.debug                   = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] glance.default_trusted_certificate_ids = [] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] glance.enable_certificate_validation = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] glance.enable_rbd_download     = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] glance.endpoint_override       = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] glance.insecure                = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] glance.keyfile                 = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] glance.max_version             = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] glance.min_version             = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] glance.num_retries             = 3 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] glance.rbd_ceph_conf           =  {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] glance.rbd_connect_timeout     = 5 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] glance.rbd_pool                =  {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] glance.rbd_user                =  {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] glance.region_name             = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] glance.service_name            = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] glance.service_type            = image {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] glance.split_loggers           = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] glance.status_code_retries     = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] glance.status_code_retry_delay = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] glance.timeout                 = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] glance.verify_glance_signatures = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] glance.version                 = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] guestfs.debug                  = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] hyperv.config_drive_cdrom      = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] hyperv.config_drive_inject_password = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] hyperv.enable_remotefx         = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] hyperv.instances_path_share    =  {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] hyperv.limit_cpu_features      = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] hyperv.use_multipath_io        = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] hyperv.vswitch_name            = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] mks.enabled                    = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] image_cache.manager_interval   = 2400 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] image_cache.precache_concurrency = 1 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] image_cache.remove_unused_base_images = True {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] image_cache.subdirectory_name  = _base {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] ironic.api_max_retries         = 60 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] ironic.api_retry_interval      = 2 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] ironic.auth_section            = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] ironic.auth_type               = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] ironic.cafile                  = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] ironic.certfile                = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] ironic.collect_timing          = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] ironic.conductor_group         = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] ironic.connect_retries         = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] ironic.connect_retry_delay     = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] ironic.endpoint_override       = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] ironic.insecure                = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] ironic.keyfile                 = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] ironic.max_version             = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] ironic.min_version             = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] ironic.peer_list               = [] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] ironic.region_name             = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] ironic.serial_console_state_timeout = 10 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] ironic.service_name            = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] ironic.service_type            = baremetal {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] ironic.split_loggers           = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] ironic.status_code_retries     = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] ironic.status_code_retry_delay = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] ironic.timeout                 = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] ironic.version                 = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] key_manager.fixed_key          = **** {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] barbican.barbican_api_version  = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] barbican.barbican_endpoint     = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] barbican.barbican_endpoint_type = public {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] barbican.barbican_region_name  = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] barbican.cafile                = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] barbican.certfile              = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] barbican.collect_timing        = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] barbican.insecure              = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] barbican.keyfile               = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] barbican.number_of_retries     = 60 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] barbican.retry_delay           = 1 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] barbican.send_service_user_token = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] barbican.split_loggers         = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] barbican.timeout               = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] barbican.verify_ssl            = True {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] barbican.verify_ssl_path       = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] barbican_service_user.auth_section = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] barbican_service_user.auth_type = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] barbican_service_user.cafile   = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] barbican_service_user.certfile = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] barbican_service_user.collect_timing = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] barbican_service_user.insecure = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] barbican_service_user.keyfile  = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] barbican_service_user.split_loggers = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] barbican_service_user.timeout  = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vault.approle_role_id          = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vault.approle_secret_id        = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vault.cafile                   = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vault.certfile                 = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vault.collect_timing           = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vault.insecure                 = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vault.keyfile                  = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vault.kv_mountpoint            = secret {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vault.kv_path                  = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vault.kv_version               = 2 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vault.namespace                = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vault.root_token_id            = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vault.split_loggers            = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vault.ssl_ca_crt_file          = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vault.timeout                  = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vault.use_ssl                  = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] keystone.auth_section          = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] keystone.auth_type             = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] keystone.cafile                = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] keystone.certfile              = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] keystone.collect_timing        = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] keystone.connect_retries       = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] keystone.connect_retry_delay   = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] keystone.endpoint_override     = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] keystone.insecure              = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] keystone.keyfile               = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] keystone.max_version           = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] keystone.min_version           = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] keystone.region_name           = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] keystone.service_name          = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] keystone.service_type          = identity {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] keystone.split_loggers         = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] keystone.status_code_retries   = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] keystone.status_code_retry_delay = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] keystone.timeout               = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] keystone.version               = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.connection_uri         =  {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.cpu_mode               = custom {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: WARNING oslo_config.cfg [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.cpu_power_governor_high = performance {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.cpu_power_management   = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.device_detach_attempts = 8 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.device_detach_timeout  = 20 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.disk_cachemodes        = [] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.disk_prefix            = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.enabled_perf_events    = [] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.file_backed_memory     = 0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.gid_maps               = [] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.hw_disk_discard        = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.hw_machine_type        = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.images_rbd_pool        = rbd {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.images_type            = default {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.images_volume_group    = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.inject_key             = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.inject_partition       = -2 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.inject_password        = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.iscsi_iface            = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.iser_use_multipath     = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.live_migration_downtime = 500 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.live_migration_inbound_addr = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.live_migration_scheme  = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.live_migration_timeout_action = abort {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.live_migration_tunnelled = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: WARNING oslo_config.cfg [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 25 21:10:54 user nova-compute[74189]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 25 21:10:54 user nova-compute[74189]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 25 21:10:54 user nova-compute[74189]: and ``live_migration_inbound_addr`` respectively.
Oct 25 21:10:54 user nova-compute[74189]: ).  Its value may be silently ignored in the future.
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.live_migration_with_native_tls = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.max_queues             = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.nfs_mount_options      = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.num_pcie_ports         = 0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.pmem_namespaces        = [] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.quobyte_client_cfg     = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.rbd_secret_uuid        = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.rbd_user               = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.rescue_image_id        = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.rescue_kernel_id       = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.rx_queue_size          = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.smbfs_mount_options    =  {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.snapshot_compression   = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.snapshot_image_format  = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.sparse_logical_volumes = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.swtpm_enabled          = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.swtpm_group            = tss {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.swtpm_user             = tss {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.sysinfo_serial         = unique {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.tb_cache_size          = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.tx_queue_size          = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.uid_maps               = [] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.use_virtio_for_bridges = True {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.virt_type              = kvm {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.volume_clear           = zero {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.volume_clear_size      = 0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.volume_use_multipath   = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.vzstorage_cache_path   = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] neutron.auth_section           = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] neutron.auth_type              = password {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] neutron.cafile                 = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] neutron.certfile               = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] neutron.collect_timing         = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] neutron.connect_retries        = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] neutron.connect_retry_delay    = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] neutron.default_floating_pool  = public {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] neutron.endpoint_override      = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] neutron.extension_sync_interval = 600 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] neutron.http_retries           = 3 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] neutron.insecure               = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] neutron.keyfile                = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] neutron.max_version            = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] neutron.min_version            = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] neutron.ovs_bridge             = br-int {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] neutron.physnets               = [] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] neutron.region_name            = RegionOne {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] neutron.service_metadata_proxy = True {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] neutron.service_name           = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] neutron.service_type           = network {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] neutron.split_loggers          = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] neutron.status_code_retries    = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] neutron.status_code_retry_delay = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] neutron.timeout                = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] neutron.version                = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] notifications.bdms_in_notifications = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] notifications.default_level    = INFO {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] notifications.notification_format = unversioned {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] notifications.notify_on_state_change = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] pci.alias                      = [] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] pci.device_spec                = [] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] pci.report_in_placement        = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.auth_section         = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.auth_type            = password {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.cafile               = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.certfile             = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.collect_timing       = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.connect_retries      = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.connect_retry_delay  = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.default_domain_id    = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.default_domain_name  = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.domain_id            = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.domain_name          = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.endpoint_override    = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.insecure             = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.keyfile              = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.max_version          = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.min_version          = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.password             = **** {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.project_domain_id    = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.project_domain_name  = Default {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.project_id           = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.project_name         = service {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.region_name          = RegionOne {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.service_name         = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.service_type         = placement {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.split_loggers        = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.status_code_retries  = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.status_code_retry_delay = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.system_scope         = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.timeout              = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.trust_id             = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.user_domain_id       = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.user_domain_name     = Default {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.user_id              = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.username             = placement {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] placement.version              = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] quota.cores                    = 20 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] quota.count_usage_from_placement = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] quota.injected_file_content_bytes = 10240 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] quota.injected_file_path_length = 255 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] quota.injected_files           = 5 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] quota.instances                = 10 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] quota.key_pairs                = 100 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] quota.metadata_items           = 128 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] quota.ram                      = 51200 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] quota.recheck_quota            = True {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] quota.server_group_members     = 10 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] quota.server_groups            = 10 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] rdp.enabled                    = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] scheduler.image_metadata_prefilter = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] scheduler.max_attempts         = 3 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] scheduler.max_placement_results = 1000 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] scheduler.workers              = 3 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] filter_scheduler.host_subset_size = 1 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] filter_scheduler.isolated_hosts = [] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] filter_scheduler.isolated_images = [] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] filter_scheduler.pci_in_placement = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] filter_scheduler.track_instance_changes = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] metrics.required               = True {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] metrics.weight_multiplier      = 1.0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] metrics.weight_setting         = [] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] serial_console.enabled         = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] serial_console.port_range      = 10000:20000 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] serial_console.serialproxy_port = 6083 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] service_user.auth_section      = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] service_user.auth_type         = password {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] service_user.cafile            = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] service_user.certfile          = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] service_user.collect_timing    = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] service_user.insecure          = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] service_user.keyfile           = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] service_user.send_service_user_token = True {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] service_user.split_loggers     = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] service_user.timeout           = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] spice.agent_enabled            = True {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] spice.enabled                  = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] spice.html5proxy_port          = 6082 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] spice.image_compression        = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] spice.jpeg_compression         = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] spice.playback_compression     = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] spice.server_listen            = 127.0.0.1 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] spice.streaming_mode           = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] spice.zlib_compression         = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] upgrade_levels.baseapi         = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] upgrade_levels.cert            = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] upgrade_levels.compute         = auto {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] upgrade_levels.conductor       = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] upgrade_levels.scheduler       = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vendordata_dynamic_auth.cafile = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vendordata_dynamic_auth.certfile = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vendordata_dynamic_auth.insecure = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vendordata_dynamic_auth.timeout = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vmware.api_retry_count         = 10 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vmware.ca_file                 = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vmware.cache_prefix            = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vmware.cluster_name            = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vmware.connection_pool_size    = 10 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vmware.console_delay_seconds   = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vmware.datastore_regex         = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vmware.host_ip                 = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vmware.host_password           = **** {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vmware.host_port               = 443 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vmware.host_username           = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vmware.insecure                = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vmware.integration_bridge      = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vmware.maximum_objects         = 100 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vmware.pbm_default_policy      = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vmware.pbm_enabled             = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vmware.pbm_wsdl_location       = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vmware.serial_port_proxy_uri   = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vmware.serial_port_service_uri = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vmware.task_poll_interval      = 0.5 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vmware.use_linked_clone        = True {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vmware.vnc_keymap              = en-us {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vmware.vnc_port                = 5900 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vmware.vnc_port_total          = 10000 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vnc.auth_schemes               = ['none'] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vnc.enabled                    = True {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vnc.novncproxy_port            = 6080 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vnc.vencrypt_ca_certs          = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vnc.vencrypt_client_cert       = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vnc.vencrypt_client_key        = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] workarounds.disable_rootwrap   = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] workarounds.enable_numa_live_migration = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] workarounds.libvirt_disable_apic = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] wsgi.client_socket_timeout     = 900 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] wsgi.default_pool_size         = 1000 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] wsgi.keep_alive                = True {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] wsgi.max_header_line           = 16384 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] wsgi.ssl_ca_file               = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] wsgi.ssl_cert_file             = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] wsgi.ssl_key_file              = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] wsgi.tcp_keepidle              = 600 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] zvm.ca_file                    = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] zvm.cloud_connector_url        = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] zvm.reachable_timeout          = 300 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_policy.enforce_new_defaults = True {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_policy.enforce_scope      = True {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_policy.policy_default_rule = default {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] profiler.connection_string     = messaging:// {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] profiler.enabled               = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] profiler.es_doc_type           = notification {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] profiler.es_scroll_size        = 10000 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] profiler.es_scroll_time        = 2m {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] profiler.filter_error_trace    = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] profiler.hmac_keys             = **** {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] profiler.sentinel_service_name = mymaster {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] profiler.socket_timeout        = 0.1 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] profiler.trace_requests        = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] profiler.trace_sqlalchemy      = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] profiler_jaeger.process_tags   = {} {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] profiler_jaeger.service_name_prefix = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] profiler_otlp.service_name_prefix = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] remote_debug.host              = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] remote_debug.port              = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_notifications.retry = -1 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_limit.auth_section        = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_limit.auth_type           = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_limit.cafile              = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_limit.certfile            = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_limit.collect_timing      = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_limit.connect_retries     = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_limit.connect_retry_delay = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_limit.endpoint_id         = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_limit.endpoint_override   = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_limit.insecure            = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_limit.keyfile             = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_limit.max_version         = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_limit.min_version         = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_limit.region_name         = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_limit.service_name        = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_limit.service_type        = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_limit.split_loggers       = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_limit.status_code_retries = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_limit.status_code_retry_delay = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_limit.timeout             = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_limit.valid_interfaces    = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_limit.version             = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_reports.file_event_handler = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] oslo_reports.log_dir           = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vif_plug_ovs_privileged.group  = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] vif_plug_ovs_privileged.user   = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] os_vif_ovs.isolate_vif         = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] os_brick.lock_path             = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] privsep_osbrick.capabilities   = [21] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] privsep_osbrick.group          = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] privsep_osbrick.helper_command = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] privsep_osbrick.user           = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] nova_sys_admin.group           = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] nova_sys_admin.helper_command  = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] nova_sys_admin.user            = None {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG oslo_service.service [None req-ef882ab6-3b26-4c0b-850a-46ff551b3ea4 None None] ******************************************************************************** {{(pid=74189) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 25 21:10:54 user nova-compute[74189]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 25 21:10:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Connecting to libvirt: qemu:///system {{(pid=74189) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fe30c1465c0> {{(pid=74189) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 25 21:10:54 user nova-compute[74189]: libvirt:  error : internal error: could not initialize domain event timer
Oct 25 21:10:54 user nova-compute[74189]: WARNING nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 25 21:10:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fe30c1465c0> {{(pid=74189) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Starting native event thread {{(pid=74189) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Starting green dispatch thread {{(pid=74189) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 25 21:10:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Starting connection event dispatch thread {{(pid=74189) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 25 21:10:54 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Connection event '1' reason 'None'
Oct 25 21:10:54 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 25 21:10:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.mount [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Initialising _HostMountState generation 0 {{(pid=74189) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 25 21:11:01 user nova-compute[74189]: INFO nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Libvirt host capabilities <capabilities>
Oct 25 21:11:01 user nova-compute[74189]:   <host>
Oct 25 21:11:01 user nova-compute[74189]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 25 21:11:01 user nova-compute[74189]:     <cpu>
Oct 25 21:11:01 user nova-compute[74189]:       <arch>x86_64</arch>
Oct 25 21:11:01 user nova-compute[74189]:       <model>IvyBridge-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <vendor>Intel</vendor>
Oct 25 21:11:01 user nova-compute[74189]:       <microcode version='1070'/>
Oct 25 21:11:01 user nova-compute[74189]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 25 21:11:01 user nova-compute[74189]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature name='ss'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature name='vmx'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature name='pcid'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature name='osxsave'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature name='hypervisor'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature name='arat'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature name='tsc_adjust'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature name='md-clear'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature name='stibp'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature name='arch-capabilities'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature name='ssbd'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature name='invtsc'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature name='rsba'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature name='skip-l1dfl-vmentry'/>
Oct 25 21:11:01 user nova-compute[74189]:       <pages unit='KiB' size='4'/>
Oct 25 21:11:01 user nova-compute[74189]:       <pages unit='KiB' size='2048'/>
Oct 25 21:11:01 user nova-compute[74189]:     </cpu>
Oct 25 21:11:01 user nova-compute[74189]:     <power_management>
Oct 25 21:11:01 user nova-compute[74189]:       <suspend_mem/>
Oct 25 21:11:01 user nova-compute[74189]:       <suspend_disk/>
Oct 25 21:11:01 user nova-compute[74189]:       <suspend_hybrid/>
Oct 25 21:11:01 user nova-compute[74189]:     </power_management>
Oct 25 21:11:01 user nova-compute[74189]:     <iommu support='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     <migration_features>
Oct 25 21:11:01 user nova-compute[74189]:       <live/>
Oct 25 21:11:01 user nova-compute[74189]:       <uri_transports>
Oct 25 21:11:01 user nova-compute[74189]:         <uri_transport>tcp</uri_transport>
Oct 25 21:11:01 user nova-compute[74189]:         <uri_transport>rdma</uri_transport>
Oct 25 21:11:01 user nova-compute[74189]:       </uri_transports>
Oct 25 21:11:01 user nova-compute[74189]:     </migration_features>
Oct 25 21:11:01 user nova-compute[74189]:     <topology>
Oct 25 21:11:01 user nova-compute[74189]:       <cells num='2'>
Oct 25 21:11:01 user nova-compute[74189]:         <cell id='0'>
Oct 25 21:11:01 user nova-compute[74189]:           <memory unit='KiB'>8189224</memory>
Oct 25 21:11:01 user nova-compute[74189]:           <pages unit='KiB' size='4'>2047306</pages>
Oct 25 21:11:01 user nova-compute[74189]:           <pages unit='KiB' size='2048'>0</pages>
Oct 25 21:11:01 user nova-compute[74189]:           <distances>
Oct 25 21:11:01 user nova-compute[74189]:             <sibling id='0' value='10'/>
Oct 25 21:11:01 user nova-compute[74189]:             <sibling id='1' value='20'/>
Oct 25 21:11:01 user nova-compute[74189]:           </distances>
Oct 25 21:11:01 user nova-compute[74189]:           <cpus num='6'>
Oct 25 21:11:01 user nova-compute[74189]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 25 21:11:01 user nova-compute[74189]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 25 21:11:01 user nova-compute[74189]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 25 21:11:01 user nova-compute[74189]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 25 21:11:01 user nova-compute[74189]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 25 21:11:01 user nova-compute[74189]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 25 21:11:01 user nova-compute[74189]:           </cpus>
Oct 25 21:11:01 user nova-compute[74189]:         </cell>
Oct 25 21:11:01 user nova-compute[74189]:         <cell id='1'>
Oct 25 21:11:01 user nova-compute[74189]:           <memory unit='KiB'>8206492</memory>
Oct 25 21:11:01 user nova-compute[74189]:           <pages unit='KiB' size='4'>2051623</pages>
Oct 25 21:11:01 user nova-compute[74189]:           <pages unit='KiB' size='2048'>0</pages>
Oct 25 21:11:01 user nova-compute[74189]:           <distances>
Oct 25 21:11:01 user nova-compute[74189]:             <sibling id='0' value='20'/>
Oct 25 21:11:01 user nova-compute[74189]:             <sibling id='1' value='10'/>
Oct 25 21:11:01 user nova-compute[74189]:           </distances>
Oct 25 21:11:01 user nova-compute[74189]:           <cpus num='6'>
Oct 25 21:11:01 user nova-compute[74189]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 25 21:11:01 user nova-compute[74189]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 25 21:11:01 user nova-compute[74189]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 25 21:11:01 user nova-compute[74189]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 25 21:11:01 user nova-compute[74189]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 25 21:11:01 user nova-compute[74189]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 25 21:11:01 user nova-compute[74189]:           </cpus>
Oct 25 21:11:01 user nova-compute[74189]:         </cell>
Oct 25 21:11:01 user nova-compute[74189]:       </cells>
Oct 25 21:11:01 user nova-compute[74189]:     </topology>
Oct 25 21:11:01 user nova-compute[74189]:     <cache>
Oct 25 21:11:01 user nova-compute[74189]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 25 21:11:01 user nova-compute[74189]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 25 21:11:01 user nova-compute[74189]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 25 21:11:01 user nova-compute[74189]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 25 21:11:01 user nova-compute[74189]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 25 21:11:01 user nova-compute[74189]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 25 21:11:01 user nova-compute[74189]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 25 21:11:01 user nova-compute[74189]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 25 21:11:01 user nova-compute[74189]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 25 21:11:01 user nova-compute[74189]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 25 21:11:01 user nova-compute[74189]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 25 21:11:01 user nova-compute[74189]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 25 21:11:01 user nova-compute[74189]:     </cache>
Oct 25 21:11:01 user nova-compute[74189]:     <secmodel>
Oct 25 21:11:01 user nova-compute[74189]:       <model>apparmor</model>
Oct 25 21:11:01 user nova-compute[74189]:       <doi>0</doi>
Oct 25 21:11:01 user nova-compute[74189]:     </secmodel>
Oct 25 21:11:01 user nova-compute[74189]:     <secmodel>
Oct 25 21:11:01 user nova-compute[74189]:       <model>dac</model>
Oct 25 21:11:01 user nova-compute[74189]:       <doi>0</doi>
Oct 25 21:11:01 user nova-compute[74189]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 25 21:11:01 user nova-compute[74189]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 25 21:11:01 user nova-compute[74189]:     </secmodel>
Oct 25 21:11:01 user nova-compute[74189]:   </host>
Oct 25 21:11:01 user nova-compute[74189]:   <guest>
Oct 25 21:11:01 user nova-compute[74189]:     <os_type>hvm</os_type>
Oct 25 21:11:01 user nova-compute[74189]:     <arch name='alpha'>
Oct 25 21:11:01 user nova-compute[74189]:       <wordsize>64</wordsize>
Oct 25 21:11:01 user nova-compute[74189]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>clipper</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <domain type='qemu'/>
Oct 25 21:11:01 user nova-compute[74189]:     </arch>
Oct 25 21:11:01 user nova-compute[74189]:     <features>
Oct 25 21:11:01 user nova-compute[74189]:       <cpuselection/>
Oct 25 21:11:01 user nova-compute[74189]:       <deviceboot/>
Oct 25 21:11:01 user nova-compute[74189]:       <disksnapshot default='on' toggle='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     </features>
Oct 25 21:11:01 user nova-compute[74189]:   </guest>
Oct 25 21:11:01 user nova-compute[74189]:   <guest>
Oct 25 21:11:01 user nova-compute[74189]:     <os_type>hvm</os_type>
Oct 25 21:11:01 user nova-compute[74189]:     <arch name='armv6l'>
Oct 25 21:11:01 user nova-compute[74189]:       <wordsize>32</wordsize>
Oct 25 21:11:01 user nova-compute[74189]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>integratorcp</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>borzoi</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>spitz</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>nuri</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>musca-b1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>versatileab</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>kzm</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>musca-a</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>smdkc210</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>sx1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>z2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>tosa</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>sabrelite</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>realview-eb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>n810</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>n800</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>versatilepb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>terrier</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>mainstone</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>midway</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>musicpal</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>microbit</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>cubieboard</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>verdex</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>netduino2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>raspi2b</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>cheetah</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>highbank</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>akita</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>connex</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>collie</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>raspi0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <domain type='qemu'/>
Oct 25 21:11:01 user nova-compute[74189]:     </arch>
Oct 25 21:11:01 user nova-compute[74189]:     <features>
Oct 25 21:11:01 user nova-compute[74189]:       <cpuselection/>
Oct 25 21:11:01 user nova-compute[74189]:       <deviceboot/>
Oct 25 21:11:01 user nova-compute[74189]:       <disksnapshot default='on' toggle='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     </features>
Oct 25 21:11:01 user nova-compute[74189]:   </guest>
Oct 25 21:11:01 user nova-compute[74189]:   <guest>
Oct 25 21:11:01 user nova-compute[74189]:     <os_type>hvm</os_type>
Oct 25 21:11:01 user nova-compute[74189]:     <arch name='armv7l'>
Oct 25 21:11:01 user nova-compute[74189]:       <wordsize>32</wordsize>
Oct 25 21:11:01 user nova-compute[74189]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>integratorcp</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>borzoi</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>spitz</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>nuri</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>musca-b1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>versatileab</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>kzm</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>musca-a</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>smdkc210</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>sx1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>z2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>tosa</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>sabrelite</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>realview-eb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>n810</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>n800</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>versatilepb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>terrier</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>mainstone</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>midway</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>musicpal</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>microbit</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>cubieboard</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>verdex</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>netduino2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>raspi2b</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>cheetah</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>highbank</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>akita</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>connex</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>collie</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>raspi0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <domain type='qemu'/>
Oct 25 21:11:01 user nova-compute[74189]:     </arch>
Oct 25 21:11:01 user nova-compute[74189]:     <features>
Oct 25 21:11:01 user nova-compute[74189]:       <cpuselection/>
Oct 25 21:11:01 user nova-compute[74189]:       <deviceboot/>
Oct 25 21:11:01 user nova-compute[74189]:       <disksnapshot default='on' toggle='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     </features>
Oct 25 21:11:01 user nova-compute[74189]:   </guest>
Oct 25 21:11:01 user nova-compute[74189]:   <guest>
Oct 25 21:11:01 user nova-compute[74189]:     <os_type>hvm</os_type>
Oct 25 21:11:01 user nova-compute[74189]:     <arch name='aarch64'>
Oct 25 21:11:01 user nova-compute[74189]:       <wordsize>64</wordsize>
Oct 25 21:11:01 user nova-compute[74189]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>integratorcp</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>borzoi</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>spitz</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>nuri</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>musca-b1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>versatileab</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>kzm</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>musca-a</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>smdkc210</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>sx1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>z2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>tosa</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>sabrelite</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>realview-eb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>n810</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>n800</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>versatilepb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>terrier</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>mainstone</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>midway</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>musicpal</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>microbit</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>cubieboard</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>verdex</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>netduino2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>raspi3b</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>raspi2b</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>cheetah</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>highbank</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>akita</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>connex</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>collie</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>raspi0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <domain type='qemu'/>
Oct 25 21:11:01 user nova-compute[74189]:     </arch>
Oct 25 21:11:01 user nova-compute[74189]:     <features>
Oct 25 21:11:01 user nova-compute[74189]:       <acpi default='on' toggle='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:       <cpuselection/>
Oct 25 21:11:01 user nova-compute[74189]:       <deviceboot/>
Oct 25 21:11:01 user nova-compute[74189]:       <disksnapshot default='on' toggle='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     </features>
Oct 25 21:11:01 user nova-compute[74189]:   </guest>
Oct 25 21:11:01 user nova-compute[74189]:   <guest>
Oct 25 21:11:01 user nova-compute[74189]:     <os_type>hvm</os_type>
Oct 25 21:11:01 user nova-compute[74189]:     <arch name='cris'>
Oct 25 21:11:01 user nova-compute[74189]:       <wordsize>32</wordsize>
Oct 25 21:11:01 user nova-compute[74189]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <domain type='qemu'/>
Oct 25 21:11:01 user nova-compute[74189]:     </arch>
Oct 25 21:11:01 user nova-compute[74189]:     <features>
Oct 25 21:11:01 user nova-compute[74189]:       <cpuselection/>
Oct 25 21:11:01 user nova-compute[74189]:       <deviceboot/>
Oct 25 21:11:01 user nova-compute[74189]:       <disksnapshot default='on' toggle='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     </features>
Oct 25 21:11:01 user nova-compute[74189]:   </guest>
Oct 25 21:11:01 user nova-compute[74189]:   <guest>
Oct 25 21:11:01 user nova-compute[74189]:     <os_type>hvm</os_type>
Oct 25 21:11:01 user nova-compute[74189]:     <arch name='i686'>
Oct 25 21:11:01 user nova-compute[74189]:       <wordsize>32</wordsize>
Oct 25 21:11:01 user nova-compute[74189]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>x-remote</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>isapc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>microvm</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <domain type='qemu'/>
Oct 25 21:11:01 user nova-compute[74189]:       <domain type='kvm'/>
Oct 25 21:11:01 user nova-compute[74189]:     </arch>
Oct 25 21:11:01 user nova-compute[74189]:     <features>
Oct 25 21:11:01 user nova-compute[74189]:       <pae/>
Oct 25 21:11:01 user nova-compute[74189]:       <nonpae/>
Oct 25 21:11:01 user nova-compute[74189]:       <acpi default='on' toggle='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:       <apic default='on' toggle='no'/>
Oct 25 21:11:01 user nova-compute[74189]:       <cpuselection/>
Oct 25 21:11:01 user nova-compute[74189]:       <deviceboot/>
Oct 25 21:11:01 user nova-compute[74189]:       <disksnapshot default='on' toggle='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     </features>
Oct 25 21:11:01 user nova-compute[74189]:   </guest>
Oct 25 21:11:01 user nova-compute[74189]:   <guest>
Oct 25 21:11:01 user nova-compute[74189]:     <os_type>hvm</os_type>
Oct 25 21:11:01 user nova-compute[74189]:     <arch name='m68k'>
Oct 25 21:11:01 user nova-compute[74189]:       <wordsize>32</wordsize>
Oct 25 21:11:01 user nova-compute[74189]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>an5206</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>q800</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>next-cube</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <domain type='qemu'/>
Oct 25 21:11:01 user nova-compute[74189]:     </arch>
Oct 25 21:11:01 user nova-compute[74189]:     <features>
Oct 25 21:11:01 user nova-compute[74189]:       <cpuselection/>
Oct 25 21:11:01 user nova-compute[74189]:       <deviceboot/>
Oct 25 21:11:01 user nova-compute[74189]:       <disksnapshot default='on' toggle='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     </features>
Oct 25 21:11:01 user nova-compute[74189]:   </guest>
Oct 25 21:11:01 user nova-compute[74189]:   <guest>
Oct 25 21:11:01 user nova-compute[74189]:     <os_type>hvm</os_type>
Oct 25 21:11:01 user nova-compute[74189]:     <arch name='microblaze'>
Oct 25 21:11:01 user nova-compute[74189]:       <wordsize>32</wordsize>
Oct 25 21:11:01 user nova-compute[74189]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <domain type='qemu'/>
Oct 25 21:11:01 user nova-compute[74189]:     </arch>
Oct 25 21:11:01 user nova-compute[74189]:     <features>
Oct 25 21:11:01 user nova-compute[74189]:       <cpuselection/>
Oct 25 21:11:01 user nova-compute[74189]:       <deviceboot/>
Oct 25 21:11:01 user nova-compute[74189]:       <disksnapshot default='on' toggle='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     </features>
Oct 25 21:11:01 user nova-compute[74189]:   </guest>
Oct 25 21:11:01 user nova-compute[74189]:   <guest>
Oct 25 21:11:01 user nova-compute[74189]:     <os_type>hvm</os_type>
Oct 25 21:11:01 user nova-compute[74189]:     <arch name='microblazeel'>
Oct 25 21:11:01 user nova-compute[74189]:       <wordsize>32</wordsize>
Oct 25 21:11:01 user nova-compute[74189]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <domain type='qemu'/>
Oct 25 21:11:01 user nova-compute[74189]:     </arch>
Oct 25 21:11:01 user nova-compute[74189]:     <features>
Oct 25 21:11:01 user nova-compute[74189]:       <cpuselection/>
Oct 25 21:11:01 user nova-compute[74189]:       <deviceboot/>
Oct 25 21:11:01 user nova-compute[74189]:       <disksnapshot default='on' toggle='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     </features>
Oct 25 21:11:01 user nova-compute[74189]:   </guest>
Oct 25 21:11:01 user nova-compute[74189]:   <guest>
Oct 25 21:11:01 user nova-compute[74189]:     <os_type>hvm</os_type>
Oct 25 21:11:01 user nova-compute[74189]:     <arch name='mips'>
Oct 25 21:11:01 user nova-compute[74189]:       <wordsize>32</wordsize>
Oct 25 21:11:01 user nova-compute[74189]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='16'>malta</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>mipssim</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <domain type='qemu'/>
Oct 25 21:11:01 user nova-compute[74189]:     </arch>
Oct 25 21:11:01 user nova-compute[74189]:     <features>
Oct 25 21:11:01 user nova-compute[74189]:       <cpuselection/>
Oct 25 21:11:01 user nova-compute[74189]:       <deviceboot/>
Oct 25 21:11:01 user nova-compute[74189]:       <disksnapshot default='on' toggle='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     </features>
Oct 25 21:11:01 user nova-compute[74189]:   </guest>
Oct 25 21:11:01 user nova-compute[74189]:   <guest>
Oct 25 21:11:01 user nova-compute[74189]:     <os_type>hvm</os_type>
Oct 25 21:11:01 user nova-compute[74189]:     <arch name='mipsel'>
Oct 25 21:11:01 user nova-compute[74189]:       <wordsize>32</wordsize>
Oct 25 21:11:01 user nova-compute[74189]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='16'>malta</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>mipssim</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <domain type='qemu'/>
Oct 25 21:11:01 user nova-compute[74189]:     </arch>
Oct 25 21:11:01 user nova-compute[74189]:     <features>
Oct 25 21:11:01 user nova-compute[74189]:       <cpuselection/>
Oct 25 21:11:01 user nova-compute[74189]:       <deviceboot/>
Oct 25 21:11:01 user nova-compute[74189]:       <disksnapshot default='on' toggle='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     </features>
Oct 25 21:11:01 user nova-compute[74189]:   </guest>
Oct 25 21:11:01 user nova-compute[74189]:   <guest>
Oct 25 21:11:01 user nova-compute[74189]:     <os_type>hvm</os_type>
Oct 25 21:11:01 user nova-compute[74189]:     <arch name='mips64'>
Oct 25 21:11:01 user nova-compute[74189]:       <wordsize>64</wordsize>
Oct 25 21:11:01 user nova-compute[74189]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='16'>malta</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>mipssim</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>pica61</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>magnum</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <domain type='qemu'/>
Oct 25 21:11:01 user nova-compute[74189]:     </arch>
Oct 25 21:11:01 user nova-compute[74189]:     <features>
Oct 25 21:11:01 user nova-compute[74189]:       <cpuselection/>
Oct 25 21:11:01 user nova-compute[74189]:       <deviceboot/>
Oct 25 21:11:01 user nova-compute[74189]:       <disksnapshot default='on' toggle='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     </features>
Oct 25 21:11:01 user nova-compute[74189]:   </guest>
Oct 25 21:11:01 user nova-compute[74189]:   <guest>
Oct 25 21:11:01 user nova-compute[74189]:     <os_type>hvm</os_type>
Oct 25 21:11:01 user nova-compute[74189]:     <arch name='mips64el'>
Oct 25 21:11:01 user nova-compute[74189]:       <wordsize>64</wordsize>
Oct 25 21:11:01 user nova-compute[74189]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='16'>malta</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>mipssim</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>pica61</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>magnum</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='16'>boston</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <domain type='qemu'/>
Oct 25 21:11:01 user nova-compute[74189]:     </arch>
Oct 25 21:11:01 user nova-compute[74189]:     <features>
Oct 25 21:11:01 user nova-compute[74189]:       <cpuselection/>
Oct 25 21:11:01 user nova-compute[74189]:       <deviceboot/>
Oct 25 21:11:01 user nova-compute[74189]:       <disksnapshot default='on' toggle='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     </features>
Oct 25 21:11:01 user nova-compute[74189]:   </guest>
Oct 25 21:11:01 user nova-compute[74189]:   <guest>
Oct 25 21:11:01 user nova-compute[74189]:     <os_type>hvm</os_type>
Oct 25 21:11:01 user nova-compute[74189]:     <arch name='ppc'>
Oct 25 21:11:01 user nova-compute[74189]:       <wordsize>32</wordsize>
Oct 25 21:11:01 user nova-compute[74189]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>g3beige</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>mac99</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='32'>ppce500</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>pegasos2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>sam460ex</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>bamboo</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>40p</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>ref405ep</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>taihu</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <domain type='qemu'/>
Oct 25 21:11:01 user nova-compute[74189]:     </arch>
Oct 25 21:11:01 user nova-compute[74189]:     <features>
Oct 25 21:11:01 user nova-compute[74189]:       <cpuselection/>
Oct 25 21:11:01 user nova-compute[74189]:       <deviceboot/>
Oct 25 21:11:01 user nova-compute[74189]:       <disksnapshot default='on' toggle='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     </features>
Oct 25 21:11:01 user nova-compute[74189]:   </guest>
Oct 25 21:11:01 user nova-compute[74189]:   <guest>
Oct 25 21:11:01 user nova-compute[74189]:     <os_type>hvm</os_type>
Oct 25 21:11:01 user nova-compute[74189]:     <arch name='ppc64'>
Oct 25 21:11:01 user nova-compute[74189]:       <wordsize>64</wordsize>
Oct 25 21:11:01 user nova-compute[74189]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2048'>powernv9</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>taihu</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2048'>powernv10</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='32'>ppce500</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>40p</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>pegasos2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>bamboo</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>g3beige</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>mac99</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>sam460ex</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>ref405ep</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2048'>powernv8</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <domain type='qemu'/>
Oct 25 21:11:01 user nova-compute[74189]:     </arch>
Oct 25 21:11:01 user nova-compute[74189]:     <features>
Oct 25 21:11:01 user nova-compute[74189]:       <cpuselection/>
Oct 25 21:11:01 user nova-compute[74189]:       <deviceboot/>
Oct 25 21:11:01 user nova-compute[74189]:       <disksnapshot default='on' toggle='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     </features>
Oct 25 21:11:01 user nova-compute[74189]:   </guest>
Oct 25 21:11:01 user nova-compute[74189]:   <guest>
Oct 25 21:11:01 user nova-compute[74189]:     <os_type>hvm</os_type>
Oct 25 21:11:01 user nova-compute[74189]:     <arch name='ppc64le'>
Oct 25 21:11:01 user nova-compute[74189]:       <wordsize>64</wordsize>
Oct 25 21:11:01 user nova-compute[74189]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2048'>powernv9</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>taihu</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2048'>powernv10</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='32'>ppce500</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>40p</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>pegasos2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>bamboo</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>g3beige</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>mac99</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>sam460ex</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>ref405ep</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2048'>powernv8</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <domain type='qemu'/>
Oct 25 21:11:01 user nova-compute[74189]:     </arch>
Oct 25 21:11:01 user nova-compute[74189]:     <features>
Oct 25 21:11:01 user nova-compute[74189]:       <cpuselection/>
Oct 25 21:11:01 user nova-compute[74189]:       <deviceboot/>
Oct 25 21:11:01 user nova-compute[74189]:       <disksnapshot default='on' toggle='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     </features>
Oct 25 21:11:01 user nova-compute[74189]:   </guest>
Oct 25 21:11:01 user nova-compute[74189]:   <guest>
Oct 25 21:11:01 user nova-compute[74189]:     <os_type>hvm</os_type>
Oct 25 21:11:01 user nova-compute[74189]:     <arch name='riscv32'>
Oct 25 21:11:01 user nova-compute[74189]:       <wordsize>32</wordsize>
Oct 25 21:11:01 user nova-compute[74189]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='8'>spike</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>opentitan</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='5'>sifive_u</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>sifive_e</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='8'>virt</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <domain type='qemu'/>
Oct 25 21:11:01 user nova-compute[74189]:     </arch>
Oct 25 21:11:01 user nova-compute[74189]:     <features>
Oct 25 21:11:01 user nova-compute[74189]:       <cpuselection/>
Oct 25 21:11:01 user nova-compute[74189]:       <deviceboot/>
Oct 25 21:11:01 user nova-compute[74189]:       <disksnapshot default='on' toggle='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     </features>
Oct 25 21:11:01 user nova-compute[74189]:   </guest>
Oct 25 21:11:01 user nova-compute[74189]:   <guest>
Oct 25 21:11:01 user nova-compute[74189]:     <os_type>hvm</os_type>
Oct 25 21:11:01 user nova-compute[74189]:     <arch name='riscv64'>
Oct 25 21:11:01 user nova-compute[74189]:       <wordsize>64</wordsize>
Oct 25 21:11:01 user nova-compute[74189]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='8'>spike</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='5'>sifive_u</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>shakti_c</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>sifive_e</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='8'>virt</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <domain type='qemu'/>
Oct 25 21:11:01 user nova-compute[74189]:     </arch>
Oct 25 21:11:01 user nova-compute[74189]:     <features>
Oct 25 21:11:01 user nova-compute[74189]:       <cpuselection/>
Oct 25 21:11:01 user nova-compute[74189]:       <deviceboot/>
Oct 25 21:11:01 user nova-compute[74189]:       <disksnapshot default='on' toggle='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     </features>
Oct 25 21:11:01 user nova-compute[74189]:   </guest>
Oct 25 21:11:01 user nova-compute[74189]:   <guest>
Oct 25 21:11:01 user nova-compute[74189]:     <os_type>hvm</os_type>
Oct 25 21:11:01 user nova-compute[74189]:     <arch name='s390x'>
Oct 25 21:11:01 user nova-compute[74189]:       <wordsize>64</wordsize>
Oct 25 21:11:01 user nova-compute[74189]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <domain type='qemu'/>
Oct 25 21:11:01 user nova-compute[74189]:     </arch>
Oct 25 21:11:01 user nova-compute[74189]:     <features>
Oct 25 21:11:01 user nova-compute[74189]:       <cpuselection/>
Oct 25 21:11:01 user nova-compute[74189]:       <deviceboot/>
Oct 25 21:11:01 user nova-compute[74189]:       <disksnapshot default='on' toggle='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     </features>
Oct 25 21:11:01 user nova-compute[74189]:   </guest>
Oct 25 21:11:01 user nova-compute[74189]:   <guest>
Oct 25 21:11:01 user nova-compute[74189]:     <os_type>hvm</os_type>
Oct 25 21:11:01 user nova-compute[74189]:     <arch name='sh4'>
Oct 25 21:11:01 user nova-compute[74189]:       <wordsize>32</wordsize>
Oct 25 21:11:01 user nova-compute[74189]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>shix</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>r2d</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <domain type='qemu'/>
Oct 25 21:11:01 user nova-compute[74189]:     </arch>
Oct 25 21:11:01 user nova-compute[74189]:     <features>
Oct 25 21:11:01 user nova-compute[74189]:       <cpuselection/>
Oct 25 21:11:01 user nova-compute[74189]:       <deviceboot/>
Oct 25 21:11:01 user nova-compute[74189]:       <disksnapshot default='on' toggle='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     </features>
Oct 25 21:11:01 user nova-compute[74189]:   </guest>
Oct 25 21:11:01 user nova-compute[74189]:   <guest>
Oct 25 21:11:01 user nova-compute[74189]:     <os_type>hvm</os_type>
Oct 25 21:11:01 user nova-compute[74189]:     <arch name='sh4eb'>
Oct 25 21:11:01 user nova-compute[74189]:       <wordsize>64</wordsize>
Oct 25 21:11:01 user nova-compute[74189]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>shix</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>r2d</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <domain type='qemu'/>
Oct 25 21:11:01 user nova-compute[74189]:     </arch>
Oct 25 21:11:01 user nova-compute[74189]:     <features>
Oct 25 21:11:01 user nova-compute[74189]:       <cpuselection/>
Oct 25 21:11:01 user nova-compute[74189]:       <deviceboot/>
Oct 25 21:11:01 user nova-compute[74189]:       <disksnapshot default='on' toggle='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     </features>
Oct 25 21:11:01 user nova-compute[74189]:   </guest>
Oct 25 21:11:01 user nova-compute[74189]:   <guest>
Oct 25 21:11:01 user nova-compute[74189]:     <os_type>hvm</os_type>
Oct 25 21:11:01 user nova-compute[74189]:     <arch name='sparc'>
Oct 25 21:11:01 user nova-compute[74189]:       <wordsize>32</wordsize>
Oct 25 21:11:01 user nova-compute[74189]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>SS-5</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>SS-20</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>LX</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>SS-4</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>SS-10</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>Voyager</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <domain type='qemu'/>
Oct 25 21:11:01 user nova-compute[74189]:     </arch>
Oct 25 21:11:01 user nova-compute[74189]:     <features>
Oct 25 21:11:01 user nova-compute[74189]:       <cpuselection/>
Oct 25 21:11:01 user nova-compute[74189]:       <deviceboot/>
Oct 25 21:11:01 user nova-compute[74189]:       <disksnapshot default='on' toggle='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     </features>
Oct 25 21:11:01 user nova-compute[74189]:   </guest>
Oct 25 21:11:01 user nova-compute[74189]:   <guest>
Oct 25 21:11:01 user nova-compute[74189]:     <os_type>hvm</os_type>
Oct 25 21:11:01 user nova-compute[74189]:     <arch name='sparc64'>
Oct 25 21:11:01 user nova-compute[74189]:       <wordsize>64</wordsize>
Oct 25 21:11:01 user nova-compute[74189]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>sun4u</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>niagara</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>sun4v</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <domain type='qemu'/>
Oct 25 21:11:01 user nova-compute[74189]:     </arch>
Oct 25 21:11:01 user nova-compute[74189]:     <features>
Oct 25 21:11:01 user nova-compute[74189]:       <cpuselection/>
Oct 25 21:11:01 user nova-compute[74189]:       <deviceboot/>
Oct 25 21:11:01 user nova-compute[74189]:       <disksnapshot default='on' toggle='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     </features>
Oct 25 21:11:01 user nova-compute[74189]:   </guest>
Oct 25 21:11:01 user nova-compute[74189]:   <guest>
Oct 25 21:11:01 user nova-compute[74189]:     <os_type>hvm</os_type>
Oct 25 21:11:01 user nova-compute[74189]:     <arch name='x86_64'>
Oct 25 21:11:01 user nova-compute[74189]:       <wordsize>64</wordsize>
Oct 25 21:11:01 user nova-compute[74189]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>x-remote</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='1'>isapc</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>microvm</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <domain type='qemu'/>
Oct 25 21:11:01 user nova-compute[74189]:       <domain type='kvm'/>
Oct 25 21:11:01 user nova-compute[74189]:     </arch>
Oct 25 21:11:01 user nova-compute[74189]:     <features>
Oct 25 21:11:01 user nova-compute[74189]:       <acpi default='on' toggle='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:       <apic default='on' toggle='no'/>
Oct 25 21:11:01 user nova-compute[74189]:       <cpuselection/>
Oct 25 21:11:01 user nova-compute[74189]:       <deviceboot/>
Oct 25 21:11:01 user nova-compute[74189]:       <disksnapshot default='on' toggle='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     </features>
Oct 25 21:11:01 user nova-compute[74189]:   </guest>
Oct 25 21:11:01 user nova-compute[74189]:   <guest>
Oct 25 21:11:01 user nova-compute[74189]:     <os_type>hvm</os_type>
Oct 25 21:11:01 user nova-compute[74189]:     <arch name='xtensa'>
Oct 25 21:11:01 user nova-compute[74189]:       <wordsize>32</wordsize>
Oct 25 21:11:01 user nova-compute[74189]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>sim</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='32'>kc705</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='32'>ml605</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='32'>virt</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='32'>lx200</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='32'>lx60</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <domain type='qemu'/>
Oct 25 21:11:01 user nova-compute[74189]:     </arch>
Oct 25 21:11:01 user nova-compute[74189]:     <features>
Oct 25 21:11:01 user nova-compute[74189]:       <cpuselection/>
Oct 25 21:11:01 user nova-compute[74189]:       <deviceboot/>
Oct 25 21:11:01 user nova-compute[74189]:       <disksnapshot default='on' toggle='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     </features>
Oct 25 21:11:01 user nova-compute[74189]:   </guest>
Oct 25 21:11:01 user nova-compute[74189]:   <guest>
Oct 25 21:11:01 user nova-compute[74189]:     <os_type>hvm</os_type>
Oct 25 21:11:01 user nova-compute[74189]:     <arch name='xtensaeb'>
Oct 25 21:11:01 user nova-compute[74189]:       <wordsize>32</wordsize>
Oct 25 21:11:01 user nova-compute[74189]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='4'>sim</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='32'>kc705</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='32'>ml605</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='32'>virt</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='32'>lx200</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='32'>lx60</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 25 21:11:01 user nova-compute[74189]:       <domain type='qemu'/>
Oct 25 21:11:01 user nova-compute[74189]:     </arch>
Oct 25 21:11:01 user nova-compute[74189]:     <features>
Oct 25 21:11:01 user nova-compute[74189]:       <cpuselection/>
Oct 25 21:11:01 user nova-compute[74189]:       <deviceboot/>
Oct 25 21:11:01 user nova-compute[74189]:       <disksnapshot default='on' toggle='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     </features>
Oct 25 21:11:01 user nova-compute[74189]:   </guest>
Oct 25 21:11:01 user nova-compute[74189]: </capabilities>
Oct 25 21:11:01 user nova-compute[74189]: 
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74189) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74189) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74189) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74189) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74189) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74189) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74189) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74189) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74189) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74189) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74189) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'pc', 'ubuntu-q35', 'q35'} {{(pid=74189) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 25 21:11:01 user nova-compute[74189]: <domainCapabilities>
Oct 25 21:11:01 user nova-compute[74189]:   <path>/usr/bin/qemu-system-i386</path>
Oct 25 21:11:01 user nova-compute[74189]:   <domain>kvm</domain>
Oct 25 21:11:01 user nova-compute[74189]:   <machine>pc-i440fx-jammy</machine>
Oct 25 21:11:01 user nova-compute[74189]:   <arch>i686</arch>
Oct 25 21:11:01 user nova-compute[74189]:   <vcpu max='255'/>
Oct 25 21:11:01 user nova-compute[74189]:   <iothreads supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:   <os supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:     <enum name='firmware'/>
Oct 25 21:11:01 user nova-compute[74189]:     <loader supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='type'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>rom</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>pflash</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='readonly'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>yes</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>no</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='secure'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>no</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </loader>
Oct 25 21:11:01 user nova-compute[74189]:   </os>
Oct 25 21:11:01 user nova-compute[74189]:   <cpu>
Oct 25 21:11:01 user nova-compute[74189]:     <mode name='host-passthrough' supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='hostPassthroughMigratable'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>off</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </mode>
Oct 25 21:11:01 user nova-compute[74189]:     <mode name='maximum' supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='maximumMigratable'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>on</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>off</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </mode>
Oct 25 21:11:01 user nova-compute[74189]:     <mode name='host-model' supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <vendor>Intel</vendor>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='ss'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='vmx'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='pcid'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='hypervisor'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='arat'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='umip'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='md-clear'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='stibp'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='ssbd'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='ibpb'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='ibrs'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='amd-stibp'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='disable' name='erms'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='disable' name='lm'/>
Oct 25 21:11:01 user nova-compute[74189]:     </mode>
Oct 25 21:11:01 user nova-compute[74189]:     <mode name='custom' supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>qemu64</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>qemu32</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>phenom</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>pentium3</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>pentium2</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>pentium</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>n270</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>kvm64</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>kvm32</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>coreduo</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>core2duo</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>athlon</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Westmere-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Westmere</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Snowridge</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Server</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Client</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>SandyBridge</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Penryn</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G5</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G4</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G3</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G2</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G1</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Nehalem-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Nehalem</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>IvyBridge</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Icelake-Server</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Haswell</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>EPYC-Rome</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>EPYC-Milan</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>EPYC</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Dhyana</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Cooperlake</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Conroe</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Broadwell</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>486</model>
Oct 25 21:11:01 user nova-compute[74189]:     </mode>
Oct 25 21:11:01 user nova-compute[74189]:   </cpu>
Oct 25 21:11:01 user nova-compute[74189]:   <memoryBacking supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:     <enum name='sourceType'>
Oct 25 21:11:01 user nova-compute[74189]:       <value>file</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>anonymous</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>memfd</value>
Oct 25 21:11:01 user nova-compute[74189]:     </enum>
Oct 25 21:11:01 user nova-compute[74189]:   </memoryBacking>
Oct 25 21:11:01 user nova-compute[74189]:   <devices>
Oct 25 21:11:01 user nova-compute[74189]:     <disk supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='diskDevice'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>disk</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>cdrom</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>floppy</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>lun</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='bus'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>ide</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>fdc</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>scsi</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>usb</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>sata</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='model'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio-transitional</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio-non-transitional</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </disk>
Oct 25 21:11:01 user nova-compute[74189]:     <graphics supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='type'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>sdl</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>vnc</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>spice</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>egl-headless</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </graphics>
Oct 25 21:11:01 user nova-compute[74189]:     <video supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='modelType'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>vga</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>cirrus</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>vmvga</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>qxl</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>none</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>bochs</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>ramfb</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </video>
Oct 25 21:11:01 user nova-compute[74189]:     <hostdev supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='mode'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>subsystem</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='startupPolicy'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>default</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>mandatory</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>requisite</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>optional</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='subsysType'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>usb</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>pci</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>scsi</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='capsType'/>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='pciBackend'/>
Oct 25 21:11:01 user nova-compute[74189]:     </hostdev>
Oct 25 21:11:01 user nova-compute[74189]:     <rng supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='model'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio-transitional</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio-non-transitional</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='backendModel'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>random</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>egd</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>builtin</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </rng>
Oct 25 21:11:01 user nova-compute[74189]:     <filesystem supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='driverType'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>path</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>handle</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtiofs</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </filesystem>
Oct 25 21:11:01 user nova-compute[74189]:     <tpm supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='model'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>tpm-tis</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>tpm-crb</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='backendModel'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>passthrough</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>emulator</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </tpm>
Oct 25 21:11:01 user nova-compute[74189]:   </devices>
Oct 25 21:11:01 user nova-compute[74189]:   <features>
Oct 25 21:11:01 user nova-compute[74189]:     <gic supported='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     <vmcoreinfo supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:     <genid supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:     <backingStoreInput supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:     <backup supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:     <sev supported='no'/>
Oct 25 21:11:01 user nova-compute[74189]:   </features>
Oct 25 21:11:01 user nova-compute[74189]: </domainCapabilities>
Oct 25 21:11:01 user nova-compute[74189]:  {{(pid=74189) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 25 21:11:01 user nova-compute[74189]: <domainCapabilities>
Oct 25 21:11:01 user nova-compute[74189]:   <path>/usr/bin/qemu-system-i386</path>
Oct 25 21:11:01 user nova-compute[74189]:   <domain>kvm</domain>
Oct 25 21:11:01 user nova-compute[74189]:   <machine>pc-i440fx-6.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:   <arch>i686</arch>
Oct 25 21:11:01 user nova-compute[74189]:   <vcpu max='255'/>
Oct 25 21:11:01 user nova-compute[74189]:   <iothreads supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:   <os supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:     <enum name='firmware'/>
Oct 25 21:11:01 user nova-compute[74189]:     <loader supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='type'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>rom</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>pflash</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='readonly'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>yes</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>no</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='secure'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>no</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </loader>
Oct 25 21:11:01 user nova-compute[74189]:   </os>
Oct 25 21:11:01 user nova-compute[74189]:   <cpu>
Oct 25 21:11:01 user nova-compute[74189]:     <mode name='host-passthrough' supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='hostPassthroughMigratable'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>off</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </mode>
Oct 25 21:11:01 user nova-compute[74189]:     <mode name='maximum' supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='maximumMigratable'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>on</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>off</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </mode>
Oct 25 21:11:01 user nova-compute[74189]:     <mode name='host-model' supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <vendor>Intel</vendor>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='ss'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='vmx'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='pcid'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='hypervisor'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='arat'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='umip'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='md-clear'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='stibp'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='ssbd'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='ibpb'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='ibrs'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='amd-stibp'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='disable' name='erms'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='disable' name='lm'/>
Oct 25 21:11:01 user nova-compute[74189]:     </mode>
Oct 25 21:11:01 user nova-compute[74189]:     <mode name='custom' supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>qemu64</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>qemu32</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>phenom</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>pentium3</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>pentium2</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>pentium</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>n270</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>kvm64</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>kvm32</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>coreduo</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>core2duo</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>athlon</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Westmere-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Westmere</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Snowridge</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Server</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Client</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>SandyBridge</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Penryn</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G5</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G4</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G3</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G2</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G1</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Nehalem-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Nehalem</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>IvyBridge</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Icelake-Server</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Haswell</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>EPYC-Rome</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>EPYC-Milan</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>EPYC</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Dhyana</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Cooperlake</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Conroe</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Broadwell</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>486</model>
Oct 25 21:11:01 user nova-compute[74189]:     </mode>
Oct 25 21:11:01 user nova-compute[74189]:   </cpu>
Oct 25 21:11:01 user nova-compute[74189]:   <memoryBacking supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:     <enum name='sourceType'>
Oct 25 21:11:01 user nova-compute[74189]:       <value>file</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>anonymous</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>memfd</value>
Oct 25 21:11:01 user nova-compute[74189]:     </enum>
Oct 25 21:11:01 user nova-compute[74189]:   </memoryBacking>
Oct 25 21:11:01 user nova-compute[74189]:   <devices>
Oct 25 21:11:01 user nova-compute[74189]:     <disk supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='diskDevice'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>disk</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>cdrom</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>floppy</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>lun</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='bus'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>ide</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>fdc</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>scsi</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>usb</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>sata</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='model'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio-transitional</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio-non-transitional</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </disk>
Oct 25 21:11:01 user nova-compute[74189]:     <graphics supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='type'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>sdl</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>vnc</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>spice</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>egl-headless</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </graphics>
Oct 25 21:11:01 user nova-compute[74189]:     <video supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='modelType'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>vga</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>cirrus</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>vmvga</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>qxl</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>none</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>bochs</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>ramfb</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </video>
Oct 25 21:11:01 user nova-compute[74189]:     <hostdev supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='mode'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>subsystem</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='startupPolicy'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>default</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>mandatory</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>requisite</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>optional</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='subsysType'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>usb</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>pci</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>scsi</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='capsType'/>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='pciBackend'/>
Oct 25 21:11:01 user nova-compute[74189]:     </hostdev>
Oct 25 21:11:01 user nova-compute[74189]:     <rng supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='model'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio-transitional</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio-non-transitional</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='backendModel'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>random</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>egd</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>builtin</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </rng>
Oct 25 21:11:01 user nova-compute[74189]:     <filesystem supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='driverType'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>path</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>handle</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtiofs</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </filesystem>
Oct 25 21:11:01 user nova-compute[74189]:     <tpm supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='model'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>tpm-tis</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>tpm-crb</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='backendModel'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>passthrough</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>emulator</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </tpm>
Oct 25 21:11:01 user nova-compute[74189]:   </devices>
Oct 25 21:11:01 user nova-compute[74189]:   <features>
Oct 25 21:11:01 user nova-compute[74189]:     <gic supported='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     <vmcoreinfo supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:     <genid supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:     <backingStoreInput supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:     <backup supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:     <sev supported='no'/>
Oct 25 21:11:01 user nova-compute[74189]:   </features>
Oct 25 21:11:01 user nova-compute[74189]: </domainCapabilities>
Oct 25 21:11:01 user nova-compute[74189]:  {{(pid=74189) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 25 21:11:01 user nova-compute[74189]: <domainCapabilities>
Oct 25 21:11:01 user nova-compute[74189]:   <path>/usr/bin/qemu-system-i386</path>
Oct 25 21:11:01 user nova-compute[74189]:   <domain>kvm</domain>
Oct 25 21:11:01 user nova-compute[74189]:   <machine>pc-q35-jammy</machine>
Oct 25 21:11:01 user nova-compute[74189]:   <arch>i686</arch>
Oct 25 21:11:01 user nova-compute[74189]:   <vcpu max='288'/>
Oct 25 21:11:01 user nova-compute[74189]:   <iothreads supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:   <os supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:     <enum name='firmware'/>
Oct 25 21:11:01 user nova-compute[74189]:     <loader supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='type'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>rom</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>pflash</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='readonly'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>yes</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>no</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='secure'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>no</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </loader>
Oct 25 21:11:01 user nova-compute[74189]:   </os>
Oct 25 21:11:01 user nova-compute[74189]:   <cpu>
Oct 25 21:11:01 user nova-compute[74189]:     <mode name='host-passthrough' supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='hostPassthroughMigratable'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>off</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </mode>
Oct 25 21:11:01 user nova-compute[74189]:     <mode name='maximum' supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='maximumMigratable'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>on</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>off</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </mode>
Oct 25 21:11:01 user nova-compute[74189]:     <mode name='host-model' supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <vendor>Intel</vendor>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='ss'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='vmx'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='pcid'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='hypervisor'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='arat'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='umip'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='md-clear'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='stibp'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='ssbd'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='ibpb'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='ibrs'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='amd-stibp'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='disable' name='erms'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='disable' name='lm'/>
Oct 25 21:11:01 user nova-compute[74189]:     </mode>
Oct 25 21:11:01 user nova-compute[74189]:     <mode name='custom' supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>qemu64</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>qemu32</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>phenom</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>pentium3</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>pentium2</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>pentium</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>n270</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>kvm64</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>kvm32</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>coreduo</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>core2duo</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>athlon</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Westmere-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Westmere</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Snowridge</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Server</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Client</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>SandyBridge</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Penryn</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G5</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G4</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G3</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G2</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G1</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Nehalem-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Nehalem</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>IvyBridge</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Icelake-Server</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Haswell</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>EPYC-Rome</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>EPYC-Milan</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>EPYC</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Dhyana</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Cooperlake</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Conroe</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Broadwell</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>486</model>
Oct 25 21:11:01 user nova-compute[74189]:     </mode>
Oct 25 21:11:01 user nova-compute[74189]:   </cpu>
Oct 25 21:11:01 user nova-compute[74189]:   <memoryBacking supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:     <enum name='sourceType'>
Oct 25 21:11:01 user nova-compute[74189]:       <value>file</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>anonymous</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>memfd</value>
Oct 25 21:11:01 user nova-compute[74189]:     </enum>
Oct 25 21:11:01 user nova-compute[74189]:   </memoryBacking>
Oct 25 21:11:01 user nova-compute[74189]:   <devices>
Oct 25 21:11:01 user nova-compute[74189]:     <disk supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='diskDevice'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>disk</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>cdrom</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>floppy</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>lun</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='bus'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>fdc</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>scsi</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>usb</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>sata</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='model'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio-transitional</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio-non-transitional</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </disk>
Oct 25 21:11:01 user nova-compute[74189]:     <graphics supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='type'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>sdl</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>vnc</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>spice</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>egl-headless</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </graphics>
Oct 25 21:11:01 user nova-compute[74189]:     <video supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='modelType'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>vga</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>cirrus</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>vmvga</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>qxl</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>none</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>bochs</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>ramfb</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </video>
Oct 25 21:11:01 user nova-compute[74189]:     <hostdev supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='mode'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>subsystem</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='startupPolicy'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>default</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>mandatory</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>requisite</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>optional</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='subsysType'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>usb</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>pci</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>scsi</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='capsType'/>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='pciBackend'/>
Oct 25 21:11:01 user nova-compute[74189]:     </hostdev>
Oct 25 21:11:01 user nova-compute[74189]:     <rng supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='model'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio-transitional</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio-non-transitional</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='backendModel'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>random</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>egd</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>builtin</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </rng>
Oct 25 21:11:01 user nova-compute[74189]:     <filesystem supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='driverType'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>path</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>handle</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtiofs</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </filesystem>
Oct 25 21:11:01 user nova-compute[74189]:     <tpm supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='model'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>tpm-tis</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>tpm-crb</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='backendModel'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>passthrough</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>emulator</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </tpm>
Oct 25 21:11:01 user nova-compute[74189]:   </devices>
Oct 25 21:11:01 user nova-compute[74189]:   <features>
Oct 25 21:11:01 user nova-compute[74189]:     <gic supported='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     <vmcoreinfo supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:     <genid supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:     <backingStoreInput supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:     <backup supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:     <sev supported='no'/>
Oct 25 21:11:01 user nova-compute[74189]:   </features>
Oct 25 21:11:01 user nova-compute[74189]: </domainCapabilities>
Oct 25 21:11:01 user nova-compute[74189]:  {{(pid=74189) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 25 21:11:01 user nova-compute[74189]: <domainCapabilities>
Oct 25 21:11:01 user nova-compute[74189]:   <path>/usr/bin/qemu-system-i386</path>
Oct 25 21:11:01 user nova-compute[74189]:   <domain>kvm</domain>
Oct 25 21:11:01 user nova-compute[74189]:   <machine>pc-q35-6.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:   <arch>i686</arch>
Oct 25 21:11:01 user nova-compute[74189]:   <vcpu max='288'/>
Oct 25 21:11:01 user nova-compute[74189]:   <iothreads supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:   <os supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:     <enum name='firmware'/>
Oct 25 21:11:01 user nova-compute[74189]:     <loader supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='type'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>rom</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>pflash</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='readonly'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>yes</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>no</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='secure'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>no</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </loader>
Oct 25 21:11:01 user nova-compute[74189]:   </os>
Oct 25 21:11:01 user nova-compute[74189]:   <cpu>
Oct 25 21:11:01 user nova-compute[74189]:     <mode name='host-passthrough' supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='hostPassthroughMigratable'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>off</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </mode>
Oct 25 21:11:01 user nova-compute[74189]:     <mode name='maximum' supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='maximumMigratable'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>on</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>off</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </mode>
Oct 25 21:11:01 user nova-compute[74189]:     <mode name='host-model' supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <vendor>Intel</vendor>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='ss'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='vmx'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='pcid'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='hypervisor'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='arat'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='umip'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='md-clear'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='stibp'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='ssbd'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='ibpb'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='ibrs'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='amd-stibp'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='disable' name='erms'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='disable' name='lm'/>
Oct 25 21:11:01 user nova-compute[74189]:     </mode>
Oct 25 21:11:01 user nova-compute[74189]:     <mode name='custom' supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>qemu64</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>qemu32</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>phenom</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>pentium3</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>pentium2</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>pentium</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>n270</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>kvm64</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>kvm32</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>coreduo</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>core2duo</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>athlon</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Westmere-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Westmere</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Snowridge</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Server</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Client</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>SandyBridge</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Penryn</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G5</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G4</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G3</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G2</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G1</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Nehalem-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Nehalem</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>IvyBridge</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Icelake-Server</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Haswell</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>EPYC-Rome</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>EPYC-Milan</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>EPYC</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Dhyana</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Cooperlake</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Conroe</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Broadwell</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>486</model>
Oct 25 21:11:01 user nova-compute[74189]:     </mode>
Oct 25 21:11:01 user nova-compute[74189]:   </cpu>
Oct 25 21:11:01 user nova-compute[74189]:   <memoryBacking supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:     <enum name='sourceType'>
Oct 25 21:11:01 user nova-compute[74189]:       <value>file</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>anonymous</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>memfd</value>
Oct 25 21:11:01 user nova-compute[74189]:     </enum>
Oct 25 21:11:01 user nova-compute[74189]:   </memoryBacking>
Oct 25 21:11:01 user nova-compute[74189]:   <devices>
Oct 25 21:11:01 user nova-compute[74189]:     <disk supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='diskDevice'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>disk</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>cdrom</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>floppy</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>lun</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='bus'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>fdc</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>scsi</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>usb</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>sata</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='model'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio-transitional</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio-non-transitional</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </disk>
Oct 25 21:11:01 user nova-compute[74189]:     <graphics supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='type'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>sdl</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>vnc</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>spice</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>egl-headless</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </graphics>
Oct 25 21:11:01 user nova-compute[74189]:     <video supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='modelType'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>vga</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>cirrus</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>vmvga</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>qxl</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>none</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>bochs</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>ramfb</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </video>
Oct 25 21:11:01 user nova-compute[74189]:     <hostdev supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='mode'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>subsystem</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='startupPolicy'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>default</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>mandatory</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>requisite</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>optional</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='subsysType'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>usb</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>pci</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>scsi</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='capsType'/>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='pciBackend'/>
Oct 25 21:11:01 user nova-compute[74189]:     </hostdev>
Oct 25 21:11:01 user nova-compute[74189]:     <rng supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='model'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio-transitional</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio-non-transitional</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='backendModel'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>random</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>egd</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>builtin</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </rng>
Oct 25 21:11:01 user nova-compute[74189]:     <filesystem supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='driverType'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>path</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>handle</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtiofs</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </filesystem>
Oct 25 21:11:01 user nova-compute[74189]:     <tpm supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='model'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>tpm-tis</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>tpm-crb</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='backendModel'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>passthrough</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>emulator</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </tpm>
Oct 25 21:11:01 user nova-compute[74189]:   </devices>
Oct 25 21:11:01 user nova-compute[74189]:   <features>
Oct 25 21:11:01 user nova-compute[74189]:     <gic supported='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     <vmcoreinfo supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:     <genid supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:     <backingStoreInput supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:     <backup supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:     <sev supported='no'/>
Oct 25 21:11:01 user nova-compute[74189]:   </features>
Oct 25 21:11:01 user nova-compute[74189]: </domainCapabilities>
Oct 25 21:11:01 user nova-compute[74189]:  {{(pid=74189) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74189) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74189) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74189) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74189) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74189) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74189) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74189) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74189) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74189) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74189) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74189) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74189) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74189) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74189) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74189) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74189) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74189) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=74189) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74189) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74189) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74189) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74189) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74189) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74189) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74189) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74189) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74189) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74189) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74189) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74189) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74189) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74189) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74189) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74189) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74189) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74189) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74189) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74189) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'pc', 'ubuntu-q35', 'q35'} {{(pid=74189) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 25 21:11:01 user nova-compute[74189]: <domainCapabilities>
Oct 25 21:11:01 user nova-compute[74189]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 25 21:11:01 user nova-compute[74189]:   <domain>kvm</domain>
Oct 25 21:11:01 user nova-compute[74189]:   <machine>pc-i440fx-jammy</machine>
Oct 25 21:11:01 user nova-compute[74189]:   <arch>x86_64</arch>
Oct 25 21:11:01 user nova-compute[74189]:   <vcpu max='255'/>
Oct 25 21:11:01 user nova-compute[74189]:   <iothreads supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:   <os supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:     <enum name='firmware'>
Oct 25 21:11:01 user nova-compute[74189]:       <value>efi</value>
Oct 25 21:11:01 user nova-compute[74189]:     </enum>
Oct 25 21:11:01 user nova-compute[74189]:     <loader supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='type'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>rom</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>pflash</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='readonly'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>yes</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>no</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='secure'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>no</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </loader>
Oct 25 21:11:01 user nova-compute[74189]:   </os>
Oct 25 21:11:01 user nova-compute[74189]:   <cpu>
Oct 25 21:11:01 user nova-compute[74189]:     <mode name='host-passthrough' supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='hostPassthroughMigratable'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>on</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>off</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </mode>
Oct 25 21:11:01 user nova-compute[74189]:     <mode name='maximum' supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='maximumMigratable'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>on</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>off</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </mode>
Oct 25 21:11:01 user nova-compute[74189]:     <mode name='host-model' supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <vendor>Intel</vendor>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='ss'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='vmx'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='pcid'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='hypervisor'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='arat'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='umip'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='md-clear'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='stibp'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='ssbd'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='invtsc'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='ibpb'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='ibrs'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='amd-stibp'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='rsba'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='pschange-mc-no'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='disable' name='erms'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 21:11:01 user nova-compute[74189]:     </mode>
Oct 25 21:11:01 user nova-compute[74189]:     <mode name='custom' supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>qemu64</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>qemu32</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>phenom</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>pentium3</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>pentium2</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>pentium</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>n270</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>kvm64</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>kvm32</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>coreduo</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>core2duo</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>athlon</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>Westmere-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>Westmere</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Snowridge</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Server</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Client</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>SandyBridge</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>Penryn</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G5</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G4</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G3</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G2</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>Opteron_G1</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>Nehalem</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>IvyBridge</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Icelake-Server</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Haswell</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>EPYC-Rome</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>EPYC-Milan</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>EPYC</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Dhyana</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Cooperlake</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>Conroe</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Broadwell</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>486</model>
Oct 25 21:11:01 user nova-compute[74189]:     </mode>
Oct 25 21:11:01 user nova-compute[74189]:   </cpu>
Oct 25 21:11:01 user nova-compute[74189]:   <memoryBacking supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:     <enum name='sourceType'>
Oct 25 21:11:01 user nova-compute[74189]:       <value>file</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>anonymous</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>memfd</value>
Oct 25 21:11:01 user nova-compute[74189]:     </enum>
Oct 25 21:11:01 user nova-compute[74189]:   </memoryBacking>
Oct 25 21:11:01 user nova-compute[74189]:   <devices>
Oct 25 21:11:01 user nova-compute[74189]:     <disk supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='diskDevice'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>disk</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>cdrom</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>floppy</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>lun</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='bus'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>ide</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>fdc</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>scsi</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>usb</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>sata</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='model'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio-transitional</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio-non-transitional</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </disk>
Oct 25 21:11:01 user nova-compute[74189]:     <graphics supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='type'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>sdl</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>vnc</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>spice</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>egl-headless</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </graphics>
Oct 25 21:11:01 user nova-compute[74189]:     <video supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='modelType'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>vga</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>cirrus</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>vmvga</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>qxl</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>none</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>bochs</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>ramfb</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </video>
Oct 25 21:11:01 user nova-compute[74189]:     <hostdev supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='mode'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>subsystem</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='startupPolicy'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>default</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>mandatory</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>requisite</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>optional</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='subsysType'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>usb</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>pci</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>scsi</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='capsType'/>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='pciBackend'/>
Oct 25 21:11:01 user nova-compute[74189]:     </hostdev>
Oct 25 21:11:01 user nova-compute[74189]:     <rng supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='model'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio-transitional</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio-non-transitional</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='backendModel'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>random</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>egd</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>builtin</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </rng>
Oct 25 21:11:01 user nova-compute[74189]:     <filesystem supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='driverType'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>path</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>handle</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtiofs</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </filesystem>
Oct 25 21:11:01 user nova-compute[74189]:     <tpm supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='model'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>tpm-tis</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>tpm-crb</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='backendModel'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>passthrough</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>emulator</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </tpm>
Oct 25 21:11:01 user nova-compute[74189]:   </devices>
Oct 25 21:11:01 user nova-compute[74189]:   <features>
Oct 25 21:11:01 user nova-compute[74189]:     <gic supported='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     <vmcoreinfo supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:     <genid supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:     <backingStoreInput supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:     <backup supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:     <sev supported='no'/>
Oct 25 21:11:01 user nova-compute[74189]:   </features>
Oct 25 21:11:01 user nova-compute[74189]: </domainCapabilities>
Oct 25 21:11:01 user nova-compute[74189]:  {{(pid=74189) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 25 21:11:01 user nova-compute[74189]: <domainCapabilities>
Oct 25 21:11:01 user nova-compute[74189]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 25 21:11:01 user nova-compute[74189]:   <domain>kvm</domain>
Oct 25 21:11:01 user nova-compute[74189]:   <machine>pc-i440fx-6.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:   <arch>x86_64</arch>
Oct 25 21:11:01 user nova-compute[74189]:   <vcpu max='255'/>
Oct 25 21:11:01 user nova-compute[74189]:   <iothreads supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:   <os supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:     <enum name='firmware'>
Oct 25 21:11:01 user nova-compute[74189]:       <value>efi</value>
Oct 25 21:11:01 user nova-compute[74189]:     </enum>
Oct 25 21:11:01 user nova-compute[74189]:     <loader supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='type'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>rom</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>pflash</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='readonly'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>yes</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>no</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='secure'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>no</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </loader>
Oct 25 21:11:01 user nova-compute[74189]:   </os>
Oct 25 21:11:01 user nova-compute[74189]:   <cpu>
Oct 25 21:11:01 user nova-compute[74189]:     <mode name='host-passthrough' supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='hostPassthroughMigratable'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>on</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>off</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </mode>
Oct 25 21:11:01 user nova-compute[74189]:     <mode name='maximum' supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='maximumMigratable'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>on</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>off</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </mode>
Oct 25 21:11:01 user nova-compute[74189]:     <mode name='host-model' supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <vendor>Intel</vendor>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='ss'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='vmx'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='pcid'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='hypervisor'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='arat'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='umip'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='md-clear'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='stibp'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='ssbd'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='invtsc'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='ibpb'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='ibrs'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='amd-stibp'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='rsba'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='pschange-mc-no'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='disable' name='erms'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 21:11:01 user nova-compute[74189]:     </mode>
Oct 25 21:11:01 user nova-compute[74189]:     <mode name='custom' supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>qemu64</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>qemu32</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>phenom</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>pentium3</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>pentium2</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>pentium</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>n270</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>kvm64</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>kvm32</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>coreduo</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>core2duo</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>athlon</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>Westmere-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>Westmere</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Snowridge</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Server</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Client</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>SandyBridge</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>Penryn</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G5</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G4</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G3</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G2</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>Opteron_G1</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>Nehalem</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>IvyBridge</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Icelake-Server</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Haswell</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>EPYC-Rome</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>EPYC-Milan</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>EPYC</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Dhyana</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Cooperlake</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>Conroe</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Broadwell</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>486</model>
Oct 25 21:11:01 user nova-compute[74189]:     </mode>
Oct 25 21:11:01 user nova-compute[74189]:   </cpu>
Oct 25 21:11:01 user nova-compute[74189]:   <memoryBacking supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:     <enum name='sourceType'>
Oct 25 21:11:01 user nova-compute[74189]:       <value>file</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>anonymous</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>memfd</value>
Oct 25 21:11:01 user nova-compute[74189]:     </enum>
Oct 25 21:11:01 user nova-compute[74189]:   </memoryBacking>
Oct 25 21:11:01 user nova-compute[74189]:   <devices>
Oct 25 21:11:01 user nova-compute[74189]:     <disk supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='diskDevice'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>disk</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>cdrom</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>floppy</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>lun</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='bus'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>ide</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>fdc</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>scsi</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>usb</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>sata</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='model'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio-transitional</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio-non-transitional</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </disk>
Oct 25 21:11:01 user nova-compute[74189]:     <graphics supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='type'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>sdl</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>vnc</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>spice</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>egl-headless</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </graphics>
Oct 25 21:11:01 user nova-compute[74189]:     <video supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='modelType'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>vga</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>cirrus</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>vmvga</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>qxl</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>none</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>bochs</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>ramfb</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </video>
Oct 25 21:11:01 user nova-compute[74189]:     <hostdev supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='mode'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>subsystem</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='startupPolicy'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>default</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>mandatory</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>requisite</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>optional</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='subsysType'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>usb</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>pci</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>scsi</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='capsType'/>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='pciBackend'/>
Oct 25 21:11:01 user nova-compute[74189]:     </hostdev>
Oct 25 21:11:01 user nova-compute[74189]:     <rng supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='model'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio-transitional</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio-non-transitional</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='backendModel'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>random</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>egd</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>builtin</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </rng>
Oct 25 21:11:01 user nova-compute[74189]:     <filesystem supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='driverType'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>path</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>handle</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtiofs</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </filesystem>
Oct 25 21:11:01 user nova-compute[74189]:     <tpm supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='model'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>tpm-tis</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>tpm-crb</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='backendModel'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>passthrough</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>emulator</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </tpm>
Oct 25 21:11:01 user nova-compute[74189]:   </devices>
Oct 25 21:11:01 user nova-compute[74189]:   <features>
Oct 25 21:11:01 user nova-compute[74189]:     <gic supported='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     <vmcoreinfo supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:     <genid supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:     <backingStoreInput supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:     <backup supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:     <sev supported='no'/>
Oct 25 21:11:01 user nova-compute[74189]:   </features>
Oct 25 21:11:01 user nova-compute[74189]: </domainCapabilities>
Oct 25 21:11:01 user nova-compute[74189]:  {{(pid=74189) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 25 21:11:01 user nova-compute[74189]: <domainCapabilities>
Oct 25 21:11:01 user nova-compute[74189]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 25 21:11:01 user nova-compute[74189]:   <domain>kvm</domain>
Oct 25 21:11:01 user nova-compute[74189]:   <machine>pc-q35-jammy</machine>
Oct 25 21:11:01 user nova-compute[74189]:   <arch>x86_64</arch>
Oct 25 21:11:01 user nova-compute[74189]:   <vcpu max='288'/>
Oct 25 21:11:01 user nova-compute[74189]:   <iothreads supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:   <os supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:     <enum name='firmware'>
Oct 25 21:11:01 user nova-compute[74189]:       <value>efi</value>
Oct 25 21:11:01 user nova-compute[74189]:     </enum>
Oct 25 21:11:01 user nova-compute[74189]:     <loader supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='type'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>rom</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>pflash</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='readonly'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>yes</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>no</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='secure'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>yes</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>no</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </loader>
Oct 25 21:11:01 user nova-compute[74189]:   </os>
Oct 25 21:11:01 user nova-compute[74189]:   <cpu>
Oct 25 21:11:01 user nova-compute[74189]:     <mode name='host-passthrough' supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='hostPassthroughMigratable'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>on</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>off</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </mode>
Oct 25 21:11:01 user nova-compute[74189]:     <mode name='maximum' supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='maximumMigratable'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>on</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>off</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </mode>
Oct 25 21:11:01 user nova-compute[74189]:     <mode name='host-model' supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <vendor>Intel</vendor>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='ss'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='vmx'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='pcid'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='hypervisor'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='arat'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='umip'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='md-clear'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='stibp'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='ssbd'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='invtsc'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='ibpb'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='ibrs'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='amd-stibp'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='rsba'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='pschange-mc-no'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='disable' name='erms'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 21:11:01 user nova-compute[74189]:     </mode>
Oct 25 21:11:01 user nova-compute[74189]:     <mode name='custom' supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>qemu64</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>qemu32</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>phenom</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>pentium3</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>pentium2</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>pentium</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>n270</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>kvm64</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>kvm32</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>coreduo</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>core2duo</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>athlon</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>Westmere-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>Westmere</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Snowridge</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Server</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Client</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>SandyBridge</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>Penryn</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G5</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G4</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G3</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G2</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>Opteron_G1</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>Nehalem</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>IvyBridge</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Icelake-Server</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Haswell</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>EPYC-Rome</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>EPYC-Milan</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>EPYC</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Dhyana</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Cooperlake</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>Conroe</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Broadwell</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>486</model>
Oct 25 21:11:01 user nova-compute[74189]:     </mode>
Oct 25 21:11:01 user nova-compute[74189]:   </cpu>
Oct 25 21:11:01 user nova-compute[74189]:   <memoryBacking supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:     <enum name='sourceType'>
Oct 25 21:11:01 user nova-compute[74189]:       <value>file</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>anonymous</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>memfd</value>
Oct 25 21:11:01 user nova-compute[74189]:     </enum>
Oct 25 21:11:01 user nova-compute[74189]:   </memoryBacking>
Oct 25 21:11:01 user nova-compute[74189]:   <devices>
Oct 25 21:11:01 user nova-compute[74189]:     <disk supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='diskDevice'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>disk</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>cdrom</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>floppy</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>lun</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='bus'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>fdc</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>scsi</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>usb</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>sata</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='model'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio-transitional</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio-non-transitional</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </disk>
Oct 25 21:11:01 user nova-compute[74189]:     <graphics supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='type'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>sdl</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>vnc</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>spice</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>egl-headless</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </graphics>
Oct 25 21:11:01 user nova-compute[74189]:     <video supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='modelType'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>vga</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>cirrus</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>vmvga</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>qxl</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>none</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>bochs</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>ramfb</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </video>
Oct 25 21:11:01 user nova-compute[74189]:     <hostdev supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='mode'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>subsystem</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='startupPolicy'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>default</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>mandatory</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>requisite</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>optional</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='subsysType'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>usb</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>pci</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>scsi</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='capsType'/>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='pciBackend'/>
Oct 25 21:11:01 user nova-compute[74189]:     </hostdev>
Oct 25 21:11:01 user nova-compute[74189]:     <rng supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='model'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio-transitional</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio-non-transitional</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='backendModel'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>random</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>egd</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>builtin</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </rng>
Oct 25 21:11:01 user nova-compute[74189]:     <filesystem supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='driverType'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>path</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>handle</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtiofs</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </filesystem>
Oct 25 21:11:01 user nova-compute[74189]:     <tpm supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='model'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>tpm-tis</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>tpm-crb</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='backendModel'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>passthrough</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>emulator</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </tpm>
Oct 25 21:11:01 user nova-compute[74189]:   </devices>
Oct 25 21:11:01 user nova-compute[74189]:   <features>
Oct 25 21:11:01 user nova-compute[74189]:     <gic supported='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     <vmcoreinfo supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:     <genid supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:     <backingStoreInput supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:     <backup supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:     <sev supported='no'/>
Oct 25 21:11:01 user nova-compute[74189]:   </features>
Oct 25 21:11:01 user nova-compute[74189]: </domainCapabilities>
Oct 25 21:11:01 user nova-compute[74189]:  {{(pid=74189) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 25 21:11:01 user nova-compute[74189]: <domainCapabilities>
Oct 25 21:11:01 user nova-compute[74189]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 25 21:11:01 user nova-compute[74189]:   <domain>kvm</domain>
Oct 25 21:11:01 user nova-compute[74189]:   <machine>pc-q35-6.2</machine>
Oct 25 21:11:01 user nova-compute[74189]:   <arch>x86_64</arch>
Oct 25 21:11:01 user nova-compute[74189]:   <vcpu max='288'/>
Oct 25 21:11:01 user nova-compute[74189]:   <iothreads supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:   <os supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:     <enum name='firmware'>
Oct 25 21:11:01 user nova-compute[74189]:       <value>efi</value>
Oct 25 21:11:01 user nova-compute[74189]:     </enum>
Oct 25 21:11:01 user nova-compute[74189]:     <loader supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='type'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>rom</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>pflash</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='readonly'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>yes</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>no</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='secure'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>yes</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>no</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </loader>
Oct 25 21:11:01 user nova-compute[74189]:   </os>
Oct 25 21:11:01 user nova-compute[74189]:   <cpu>
Oct 25 21:11:01 user nova-compute[74189]:     <mode name='host-passthrough' supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='hostPassthroughMigratable'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>on</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>off</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </mode>
Oct 25 21:11:01 user nova-compute[74189]:     <mode name='maximum' supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='maximumMigratable'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>on</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>off</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </mode>
Oct 25 21:11:01 user nova-compute[74189]:     <mode name='host-model' supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <vendor>Intel</vendor>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='ss'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='vmx'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='pcid'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='hypervisor'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='arat'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='umip'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='md-clear'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='stibp'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='ssbd'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='invtsc'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='ibpb'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='ibrs'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='amd-stibp'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='rsba'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='require' name='pschange-mc-no'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='disable' name='erms'/>
Oct 25 21:11:01 user nova-compute[74189]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 21:11:01 user nova-compute[74189]:     </mode>
Oct 25 21:11:01 user nova-compute[74189]:     <mode name='custom' supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>qemu64</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>qemu32</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>phenom</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>pentium3</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>pentium2</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>pentium</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>n270</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>kvm64</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>kvm32</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>coreduo</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>core2duo</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>athlon</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>Westmere-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>Westmere</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Snowridge</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Server</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Skylake-Client</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>SandyBridge</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>Penryn</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G5</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G4</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G3</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Opteron_G2</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>Opteron_G1</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>Nehalem</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>IvyBridge</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Icelake-Server</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Haswell</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>EPYC-Rome</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>EPYC-Milan</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>EPYC</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Dhyana</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Cooperlake</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>Conroe</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='no'>Broadwell</model>
Oct 25 21:11:01 user nova-compute[74189]:       <model usable='yes'>486</model>
Oct 25 21:11:01 user nova-compute[74189]:     </mode>
Oct 25 21:11:01 user nova-compute[74189]:   </cpu>
Oct 25 21:11:01 user nova-compute[74189]:   <memoryBacking supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:     <enum name='sourceType'>
Oct 25 21:11:01 user nova-compute[74189]:       <value>file</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>anonymous</value>
Oct 25 21:11:01 user nova-compute[74189]:       <value>memfd</value>
Oct 25 21:11:01 user nova-compute[74189]:     </enum>
Oct 25 21:11:01 user nova-compute[74189]:   </memoryBacking>
Oct 25 21:11:01 user nova-compute[74189]:   <devices>
Oct 25 21:11:01 user nova-compute[74189]:     <disk supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='diskDevice'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>disk</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>cdrom</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>floppy</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>lun</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='bus'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>fdc</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>scsi</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>usb</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>sata</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='model'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio-transitional</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio-non-transitional</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </disk>
Oct 25 21:11:01 user nova-compute[74189]:     <graphics supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='type'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>sdl</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>vnc</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>spice</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>egl-headless</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </graphics>
Oct 25 21:11:01 user nova-compute[74189]:     <video supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='modelType'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>vga</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>cirrus</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>vmvga</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>qxl</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>none</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>bochs</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>ramfb</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </video>
Oct 25 21:11:01 user nova-compute[74189]:     <hostdev supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='mode'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>subsystem</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='startupPolicy'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>default</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>mandatory</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>requisite</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>optional</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='subsysType'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>usb</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>pci</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>scsi</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='capsType'/>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='pciBackend'/>
Oct 25 21:11:01 user nova-compute[74189]:     </hostdev>
Oct 25 21:11:01 user nova-compute[74189]:     <rng supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='model'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio-transitional</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtio-non-transitional</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='backendModel'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>random</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>egd</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>builtin</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </rng>
Oct 25 21:11:01 user nova-compute[74189]:     <filesystem supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='driverType'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>path</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>handle</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>virtiofs</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </filesystem>
Oct 25 21:11:01 user nova-compute[74189]:     <tpm supported='yes'>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='model'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>tpm-tis</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>tpm-crb</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:       <enum name='backendModel'>
Oct 25 21:11:01 user nova-compute[74189]:         <value>passthrough</value>
Oct 25 21:11:01 user nova-compute[74189]:         <value>emulator</value>
Oct 25 21:11:01 user nova-compute[74189]:       </enum>
Oct 25 21:11:01 user nova-compute[74189]:     </tpm>
Oct 25 21:11:01 user nova-compute[74189]:   </devices>
Oct 25 21:11:01 user nova-compute[74189]:   <features>
Oct 25 21:11:01 user nova-compute[74189]:     <gic supported='no'/>
Oct 25 21:11:01 user nova-compute[74189]:     <vmcoreinfo supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:     <genid supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:     <backingStoreInput supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:     <backup supported='yes'/>
Oct 25 21:11:01 user nova-compute[74189]:     <sev supported='no'/>
Oct 25 21:11:01 user nova-compute[74189]:   </features>
Oct 25 21:11:01 user nova-compute[74189]: </domainCapabilities>
Oct 25 21:11:01 user nova-compute[74189]:  {{(pid=74189) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74189) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74189) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74189) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74189) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Checking secure boot support for host arch (x86_64) {{(pid=74189) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Checking secure boot support for host arch (x86_64) {{(pid=74189) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Checking secure boot support for host arch (x86_64) {{(pid=74189) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Checking secure boot support for host arch (x86_64) {{(pid=74189) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Checking secure boot support for host arch (x86_64) {{(pid=74189) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 25 21:11:01 user nova-compute[74189]: INFO nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Secure Boot support detected
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] cpu compare xml: <cpu match="exact">
Oct 25 21:11:01 user nova-compute[74189]:   <model>Nehalem</model>
Oct 25 21:11:01 user nova-compute[74189]: </cpu>
Oct 25 21:11:01 user nova-compute[74189]:  {{(pid=74189) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 25 21:11:01 user nova-compute[74189]: INFO nova.virt.node [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Generated node identity 4eea19d7-3bab-440b-873e-a6e9c99ba7fc
Oct 25 21:11:01 user nova-compute[74189]: INFO nova.virt.node [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Wrote node identity 4eea19d7-3bab-440b-873e-a6e9c99ba7fc to /opt/stack/data/nova/compute_id
Oct 25 21:11:01 user nova-compute[74189]: WARNING nova.compute.manager [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Compute nodes ['4eea19d7-3bab-440b-873e-a6e9c99ba7fc'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 25 21:11:01 user nova-compute[74189]: INFO nova.compute.manager [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 25 21:11:01 user nova-compute[74189]: WARNING nova.compute.manager [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 25 21:11:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:11:01 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:11:02 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:11:02 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:11:02 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Hypervisor/Node resource view: name=user free_ram=10948MB free_disk=26.133468627929688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:11:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:11:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:11:02 user nova-compute[74189]: WARNING nova.compute.resource_tracker [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] No compute node record for user:4eea19d7-3bab-440b-873e-a6e9c99ba7fc: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 4eea19d7-3bab-440b-873e-a6e9c99ba7fc could not be found.
Oct 25 21:11:02 user nova-compute[74189]: INFO nova.compute.resource_tracker [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Compute node record created for user:user with uuid: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc
Oct 25 21:11:02 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:11:02 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:11:02 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] [req-06b6f44c-658f-4c71-abed-03cea18daac5] Created resource provider record via placement API for resource provider with UUID 4eea19d7-3bab-440b-873e-a6e9c99ba7fc and name user.
Oct 25 21:11:02 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74189) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 25 21:11:02 user nova-compute[74189]: INFO nova.virt.libvirt.host [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] kernel doesn't support AMD SEV
Oct 25 21:11:02 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Updating inventory in ProviderTree for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 21:11:02 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:11:02 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Libvirt baseline CPU <cpu>
Oct 25 21:11:02 user nova-compute[74189]:   <arch>x86_64</arch>
Oct 25 21:11:02 user nova-compute[74189]:   <model>Nehalem</model>
Oct 25 21:11:02 user nova-compute[74189]:   <vendor>Intel</vendor>
Oct 25 21:11:02 user nova-compute[74189]:   <topology sockets="6" cores="1" threads="1"/>
Oct 25 21:11:02 user nova-compute[74189]: </cpu>
Oct 25 21:11:02 user nova-compute[74189]:  {{(pid=74189) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 25 21:11:02 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Updated inventory for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 25 21:11:02 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Updating resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc generation from 0 to 1 during operation: update_inventory {{(pid=74189) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 25 21:11:02 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Updating inventory in ProviderTree for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 21:11:02 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Updating resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc generation from 1 to 2 during operation: update_traits {{(pid=74189) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 25 21:11:02 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:11:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.631s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:11:02 user nova-compute[74189]: DEBUG nova.service [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Creating RPC server for service compute {{(pid=74189) start /opt/stack/nova/nova/service.py:182}}
Oct 25 21:11:02 user nova-compute[74189]: DEBUG nova.service [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] Join ServiceGroup membership for this service compute {{(pid=74189) start /opt/stack/nova/nova/service.py:199}}
Oct 25 21:11:02 user nova-compute[74189]: DEBUG nova.servicegroup.drivers.db [None req-c6d16d00-2197-4d16-89b0-8dcb543ae3b6 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74189) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 25 21:11:51 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:11:51 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:11:53 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:11:53 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:11:53 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:11:53 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Rebuilding the list of instances to heal {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 21:11:53 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Didn't find any instances for network info cache update. {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 21:11:53 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:11:53 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:11:53 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:11:53 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:11:53 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:11:53 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:11:53 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:11:53 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:11:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:11:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:11:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:11:53 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:11:54 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:11:54 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:11:54 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=10375MB free_disk=26.037212371826172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:11:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:11:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:11:54 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:11:54 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:11:54 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:11:54 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:11:54 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:11:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.313s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:12:54 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:12:54 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:12:54 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:12:54 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Rebuilding the list of instances to heal {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 21:12:54 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Didn't find any instances for network info cache update. {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 21:12:54 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:12:54 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:12:54 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:12:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:12:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:12:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:12:54 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:12:54 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:12:54 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:12:54 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=10325MB free_disk=26.101425170898438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:12:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:12:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:12:54 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:12:54 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:12:54 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:12:54 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:12:54 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:12:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:12:55 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:12:55 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:12:55 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:12:55 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:12:55 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:12:55 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:13:54 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:13:55 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:13:55 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:13:55 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:13:55 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Rebuilding the list of instances to heal {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 21:13:55 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Didn't find any instances for network info cache update. {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 21:13:55 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:13:55 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:13:55 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:13:55 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:13:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:13:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:13:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:13:56 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:13:56 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:13:56 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:13:56 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=10300MB free_disk=25.854942321777344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:13:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:13:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:13:56 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:13:56 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:13:56 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:13:56 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:13:56 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:13:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:13:58 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:13:58 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:13:58 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:14:54 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:14:54 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:14:55 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:14:55 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:14:55 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:14:55 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Rebuilding the list of instances to heal {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 21:14:55 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Didn't find any instances for network info cache update. {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 21:14:55 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:14:55 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:14:55 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:14:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:14:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:14:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:14:55 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:14:56 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:14:56 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:14:56 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=9581MB free_disk=25.875091552734375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:14:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:14:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:14:56 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:14:56 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:14:56 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:14:56 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:14:56 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:14:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:14:57 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:14:57 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:14:57 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:14:59 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:15:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Acquiring lock "59ab3484-9785-48b4-96fb-1563a6fb8434" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Lock "59ab3484-9785-48b4-96fb-1563a6fb8434" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "d7c3a99a-ab38-4e88-896d-94ae51a09a48" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "d7c3a99a-ab38-4e88-896d-94ae51a09a48" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:01 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:15:01 user nova-compute[74189]: DEBUG nova.compute.manager [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:15:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:02 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:15:02 user nova-compute[74189]: INFO nova.compute.claims [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Claim successful on node user
Oct 25 21:15:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:02 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:15:02 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:15:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.292s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:02 user nova-compute[74189]: DEBUG nova.compute.manager [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:15:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.284s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:02 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:15:02 user nova-compute[74189]: INFO nova.compute.claims [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Claim successful on node user
Oct 25 21:15:02 user nova-compute[74189]: DEBUG nova.compute.manager [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:15:02 user nova-compute[74189]: DEBUG nova.network.neutron [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:15:02 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:15:02 user nova-compute[74189]: DEBUG nova.compute.manager [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:15:02 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:15:02 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:15:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.246s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:02 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:15:02 user nova-compute[74189]: DEBUG nova.compute.manager [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:15:02 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:15:02 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Creating image(s)
Oct 25 21:15:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "/opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "/opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:02 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:15:02 user nova-compute[74189]: DEBUG nova.network.neutron [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:15:02 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:15:03 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:15:03 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:15:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:15:03 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Creating image(s)
Oct 25 21:15:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Acquiring lock "/opt/stack/data/nova/instances/59ab3484-9785-48b4-96fb-1563a6fb8434/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Lock "/opt/stack/data/nova/instances/59ab3484-9785-48b4-96fb-1563a6fb8434/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Lock "/opt/stack/data/nova/instances/59ab3484-9785-48b4-96fb-1563a6fb8434/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:03 user nova-compute[74189]: DEBUG nova.policy [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc377c1beaab443683a6d776f2f734ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acbb4f93936848a8949477ad124bf98e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:15:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8.part --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:03 user nova-compute[74189]: DEBUG nova.policy [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1a8198d38ce4478a8fa932223d9b0dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2aaccb94133476fbded17c902219c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:15:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8.part --force-share --output=json" returned: 0 in 0.163s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:03 user nova-compute[74189]: DEBUG nova.virt.images [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] 30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd was qcow2, converting to raw {{(pid=74189) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 21:15:03 user nova-compute[74189]: DEBUG nova.privsep.utils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74189) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 21:15:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8.part /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8.converted {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8.part /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8.converted" returned: 0 in 0.271s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8.converted --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8.converted --force-share --output=json" returned: 0 in 0.212s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.390s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:04 user nova-compute[74189]: INFO oslo.privsep.daemon [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmphmlxrm03/privsep.sock']
Oct 25 21:15:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 1.231s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:04 user sudo[83440]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmphmlxrm03/privsep.sock
Oct 25 21:15:04 user sudo[83440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 25 21:15:05 user nova-compute[74189]: DEBUG nova.network.neutron [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Successfully created port: 9c2c5804-3d81-4e3a-9c17-073b1dc171e3 {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:15:05 user nova-compute[74189]: DEBUG nova.network.neutron [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Successfully created port: 44169902-69da-4fe1-8292-a23e0ff15fc7 {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:15:05 user sudo[83440]: pam_unix(sudo:session): session closed for user root
Oct 25 21:15:05 user nova-compute[74189]: INFO oslo.privsep.daemon [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Spawned new privsep daemon via rootwrap
Oct 25 21:15:06 user nova-compute[74189]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 25 21:15:06 user nova-compute[74189]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 25 21:15:06 user nova-compute[74189]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 25 21:15:06 user nova-compute[74189]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83444
Oct 25 21:15:06 user nova-compute[74189]: WARNING oslo_privsep.priv_context [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] privsep daemon already running
Oct 25 21:15:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.183s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.187s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.160s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk 1073741824" returned: 0 in 0.054s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.215s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.164s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:06 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:15:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.191s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/59ab3484-9785-48b4-96fb-1563a6fb8434/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/59ab3484-9785-48b4-96fb-1563a6fb8434/disk 1073741824" returned: 0 in 0.060s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:06 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Cannot resize image /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:15:06 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:15:06 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Ensure instance console log exists: /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:15:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.187s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:07 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Checking if we can resize image /opt/stack/data/nova/instances/59ab3484-9785-48b4-96fb-1563a6fb8434/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:15:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ab3484-9785-48b4-96fb-1563a6fb8434/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:07 user nova-compute[74189]: DEBUG nova.network.neutron [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Successfully updated port: 44169902-69da-4fe1-8292-a23e0ff15fc7 {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:15:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "refresh_cache-d7c3a99a-ab38-4e88-896d-94ae51a09a48" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:15:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquired lock "refresh_cache-d7c3a99a-ab38-4e88-896d-94ae51a09a48" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:15:07 user nova-compute[74189]: DEBUG nova.network.neutron [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:15:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ab3484-9785-48b4-96fb-1563a6fb8434/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:07 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Cannot resize image /opt/stack/data/nova/instances/59ab3484-9785-48b4-96fb-1563a6fb8434/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:15:07 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:15:07 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Ensure instance console log exists: /opt/stack/data/nova/instances/59ab3484-9785-48b4-96fb-1563a6fb8434/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:15:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquiring lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:07 user nova-compute[74189]: DEBUG nova.compute.manager [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:15:07 user nova-compute[74189]: DEBUG nova.network.neutron [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:15:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:07 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:15:07 user nova-compute[74189]: INFO nova.compute.claims [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Claim successful on node user
Oct 25 21:15:07 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:15:07 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:15:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.331s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:07 user nova-compute[74189]: DEBUG nova.compute.manager [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:15:07 user nova-compute[74189]: DEBUG nova.compute.manager [req-765c8d51-1043-4bd8-aab1-66fae975b97e req-4b2e5820-bc41-4eb5-981f-c3b0d706dc58 service nova] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Received event network-changed-44169902-69da-4fe1-8292-a23e0ff15fc7 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:15:07 user nova-compute[74189]: DEBUG nova.compute.manager [req-765c8d51-1043-4bd8-aab1-66fae975b97e req-4b2e5820-bc41-4eb5-981f-c3b0d706dc58 service nova] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Refreshing instance network info cache due to event network-changed-44169902-69da-4fe1-8292-a23e0ff15fc7. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:15:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-765c8d51-1043-4bd8-aab1-66fae975b97e req-4b2e5820-bc41-4eb5-981f-c3b0d706dc58 service nova] Acquiring lock "refresh_cache-d7c3a99a-ab38-4e88-896d-94ae51a09a48" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:15:07 user nova-compute[74189]: DEBUG nova.compute.manager [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:15:07 user nova-compute[74189]: DEBUG nova.network.neutron [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:15:07 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:15:07 user nova-compute[74189]: DEBUG nova.compute.manager [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:15:07 user nova-compute[74189]: DEBUG nova.network.neutron [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Updating instance_info_cache with network_info: [{"id": "44169902-69da-4fe1-8292-a23e0ff15fc7", "address": "fa:16:3e:b9:37:c6", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44169902-69", "ovs_interfaceid": "44169902-69da-4fe1-8292-a23e0ff15fc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:15:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Releasing lock "refresh_cache-d7c3a99a-ab38-4e88-896d-94ae51a09a48" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:15:07 user nova-compute[74189]: DEBUG nova.compute.manager [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Instance network_info: |[{"id": "44169902-69da-4fe1-8292-a23e0ff15fc7", "address": "fa:16:3e:b9:37:c6", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44169902-69", "ovs_interfaceid": "44169902-69da-4fe1-8292-a23e0ff15fc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:15:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-765c8d51-1043-4bd8-aab1-66fae975b97e req-4b2e5820-bc41-4eb5-981f-c3b0d706dc58 service nova] Acquired lock "refresh_cache-d7c3a99a-ab38-4e88-896d-94ae51a09a48" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:15:07 user nova-compute[74189]: DEBUG nova.network.neutron [req-765c8d51-1043-4bd8-aab1-66fae975b97e req-4b2e5820-bc41-4eb5-981f-c3b0d706dc58 service nova] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Refreshing network info cache for port 44169902-69da-4fe1-8292-a23e0ff15fc7 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Start _get_guest_xml network_info=[{"id": "44169902-69da-4fe1-8292-a23e0ff15fc7", "address": "fa:16:3e:b9:37:c6", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44169902-69", "ovs_interfaceid": "44169902-69da-4fe1-8292-a23e0ff15fc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:15:08 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:15:08 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.privsep.utils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74189) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:15:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1400291475',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1400291475',id=2,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='acbb4f93936848a8949477ad124bf98e',ramdisk_id='',reservation_id='r-lh66jkbe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-571481303',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:15:03Z,user_data=None,user_id='fc377c1beaab443683a6d776f2f734ff',uuid=d7c3a99a-ab38-4e88-896d-94ae51a09a48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44169902-69da-4fe1-8292-a23e0ff15fc7", "address": "fa:16:3e:b9:37:c6", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44169902-69", "ovs_interfaceid": "44169902-69da-4fe1-8292-a23e0ff15fc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Converting VIF {"id": "44169902-69da-4fe1-8292-a23e0ff15fc7", "address": "fa:16:3e:b9:37:c6", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44169902-69", "ovs_interfaceid": "44169902-69da-4fe1-8292-a23e0ff15fc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:37:c6,bridge_name='br-int',has_traffic_filtering=True,id=44169902-69da-4fe1-8292-a23e0ff15fc7,network=Network(f202171f-dfd8-4a19-9321-788318413ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44169902-69') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.objects.instance [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lazy-loading 'pci_devices' on Instance uuid d7c3a99a-ab38-4e88-896d-94ae51a09a48 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:15:08 user nova-compute[74189]:   <uuid>d7c3a99a-ab38-4e88-896d-94ae51a09a48</uuid>
Oct 25 21:15:08 user nova-compute[74189]:   <name>instance-00000002</name>
Oct 25 21:15:08 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:15:08 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:15:08 user nova-compute[74189]:   <metadata>
Oct 25 21:15:08 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:15:08 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:15:08 user nova-compute[74189]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1400291475</nova:name>
Oct 25 21:15:08 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:15:08</nova:creationTime>
Oct 25 21:15:08 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:15:08 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:15:08 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:15:08 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:15:08 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:15:08 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:15:08 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:15:08 user nova-compute[74189]:       <nova:owner>
Oct 25 21:15:08 user nova-compute[74189]:         <nova:user uuid="fc377c1beaab443683a6d776f2f734ff">tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member</nova:user>
Oct 25 21:15:08 user nova-compute[74189]:         <nova:project uuid="acbb4f93936848a8949477ad124bf98e">tempest-ServerBootFromVolumeStableRescueTest-571481303</nova:project>
Oct 25 21:15:08 user nova-compute[74189]:       </nova:owner>
Oct 25 21:15:08 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:15:08 user nova-compute[74189]:       <nova:ports>
Oct 25 21:15:08 user nova-compute[74189]:         <nova:port uuid="44169902-69da-4fe1-8292-a23e0ff15fc7">
Oct 25 21:15:08 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 25 21:15:08 user nova-compute[74189]:         </nova:port>
Oct 25 21:15:08 user nova-compute[74189]:       </nova:ports>
Oct 25 21:15:08 user nova-compute[74189]:     </nova:instance>
Oct 25 21:15:08 user nova-compute[74189]:   </metadata>
Oct 25 21:15:08 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:15:08 user nova-compute[74189]:     <system>
Oct 25 21:15:08 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:15:08 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:15:08 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:15:08 user nova-compute[74189]:       <entry name="serial">d7c3a99a-ab38-4e88-896d-94ae51a09a48</entry>
Oct 25 21:15:08 user nova-compute[74189]:       <entry name="uuid">d7c3a99a-ab38-4e88-896d-94ae51a09a48</entry>
Oct 25 21:15:08 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:15:08 user nova-compute[74189]:     </system>
Oct 25 21:15:08 user nova-compute[74189]:   </sysinfo>
Oct 25 21:15:08 user nova-compute[74189]:   <os>
Oct 25 21:15:08 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:15:08 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:15:08 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:15:08 user nova-compute[74189]:   </os>
Oct 25 21:15:08 user nova-compute[74189]:   <features>
Oct 25 21:15:08 user nova-compute[74189]:     <acpi/>
Oct 25 21:15:08 user nova-compute[74189]:     <apic/>
Oct 25 21:15:08 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:15:08 user nova-compute[74189]:   </features>
Oct 25 21:15:08 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:15:08 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:15:08 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:15:08 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:15:08 user nova-compute[74189]:   </clock>
Oct 25 21:15:08 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:15:08 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:15:08 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:15:08 user nova-compute[74189]:   </cpu>
Oct 25 21:15:08 user nova-compute[74189]:   <devices>
Oct 25 21:15:08 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:15:08 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:15:08 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk"/>
Oct 25 21:15:08 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:15:08 user nova-compute[74189]:     </disk>
Oct 25 21:15:08 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:15:08 user nova-compute[74189]:       <mac address="fa:16:3e:b9:37:c6"/>
Oct 25 21:15:08 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:15:08 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:15:08 user nova-compute[74189]:       <target dev="tap44169902-69"/>
Oct 25 21:15:08 user nova-compute[74189]:     </interface>
Oct 25 21:15:08 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:15:08 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/console.log" append="off"/>
Oct 25 21:15:08 user nova-compute[74189]:     </serial>
Oct 25 21:15:08 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:15:08 user nova-compute[74189]:     <video>
Oct 25 21:15:08 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:15:08 user nova-compute[74189]:     </video>
Oct 25 21:15:08 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:15:08 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:15:08 user nova-compute[74189]:     </rng>
Oct 25 21:15:08 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:15:08 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:15:08 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:15:08 user nova-compute[74189]:     </memballoon>
Oct 25 21:15:08 user nova-compute[74189]:   </devices>
Oct 25 21:15:08 user nova-compute[74189]: </domain>
Oct 25 21:15:08 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:15:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1400291475',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1400291475',id=2,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='acbb4f93936848a8949477ad124bf98e',ramdisk_id='',reservation_id='r-lh66jkbe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-571481303',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:15:03Z,user_data=None,user_id='fc377c1beaab443683a6d776f2f734ff',uuid=d7c3a99a-ab38-4e88-896d-94ae51a09a48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44169902-69da-4fe1-8292-a23e0ff15fc7", "address": "fa:16:3e:b9:37:c6", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44169902-69", "ovs_interfaceid": "44169902-69da-4fe1-8292-a23e0ff15fc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Converting VIF {"id": "44169902-69da-4fe1-8292-a23e0ff15fc7", "address": "fa:16:3e:b9:37:c6", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44169902-69", "ovs_interfaceid": "44169902-69da-4fe1-8292-a23e0ff15fc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:37:c6,bridge_name='br-int',has_traffic_filtering=True,id=44169902-69da-4fe1-8292-a23e0ff15fc7,network=Network(f202171f-dfd8-4a19-9321-788318413ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44169902-69') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG os_vif [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:37:c6,bridge_name='br-int',has_traffic_filtering=True,id=44169902-69da-4fe1-8292-a23e0ff15fc7,network=Network(f202171f-dfd8-4a19-9321-788318413ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44169902-69') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Created schema index Interface.name {{(pid=74189) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Created schema index Port.name {{(pid=74189) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Created schema index Bridge.name {{(pid=74189) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [POLLOUT] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.policy [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e81aaad00624abdafe04f6c8de4c5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e426fbc4bb374115a46d927092d62423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.compute.manager [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:15:08 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Creating image(s)
Oct 25 21:15:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquiring lock "/opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "/opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "/opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.network.neutron [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Successfully updated port: 9c2c5804-3d81-4e3a-9c17-073b1dc171e3 {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Acquiring lock "refresh_cache-59ab3484-9785-48b4-96fb-1563a6fb8434" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Acquired lock "refresh_cache-59ab3484-9785-48b4-96fb-1563a6fb8434" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.network.neutron [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28cef282-f463-5358-afd4-88eb0550aa9f', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:15:08 user nova-compute[74189]: INFO oslo.privsep.daemon [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp2e9kpjxw/privsep.sock']
Oct 25 21:15:08 user sudo[83483]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp2e9kpjxw/privsep.sock
Oct 25 21:15:08 user sudo[83483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 25 21:15:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.207s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.network.neutron [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.compute.manager [req-698ebc5c-ba53-4a27-b06a-3f71ef2422ad req-49c576d1-e7be-466d-945f-002be527037c service nova] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Received event network-changed-9c2c5804-3d81-4e3a-9c17-073b1dc171e3 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.compute.manager [req-698ebc5c-ba53-4a27-b06a-3f71ef2422ad req-49c576d1-e7be-466d-945f-002be527037c service nova] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Refreshing instance network info cache due to event network-changed-9c2c5804-3d81-4e3a-9c17-073b1dc171e3. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-698ebc5c-ba53-4a27-b06a-3f71ef2422ad req-49c576d1-e7be-466d-945f-002be527037c service nova] Acquiring lock "refresh_cache-59ab3484-9785-48b4-96fb-1563a6fb8434" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.200s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk 1073741824" returned: 0 in 0.041s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.185s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:15:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Cannot resize image /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Ensure instance console log exists: /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG nova.network.neutron [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Updating instance_info_cache with network_info: [{"id": "9c2c5804-3d81-4e3a-9c17-073b1dc171e3", "address": "fa:16:3e:0c:3e:53", "network": {"id": "606f4918-8904-4548-9cfd-b1e0c1eed7ee", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1638907501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2aaccb94133476fbded17c902219c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c2c5804-3d", "ovs_interfaceid": "9c2c5804-3d81-4e3a-9c17-073b1dc171e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Releasing lock "refresh_cache-59ab3484-9785-48b4-96fb-1563a6fb8434" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Instance network_info: |[{"id": "9c2c5804-3d81-4e3a-9c17-073b1dc171e3", "address": "fa:16:3e:0c:3e:53", "network": {"id": "606f4918-8904-4548-9cfd-b1e0c1eed7ee", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1638907501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2aaccb94133476fbded17c902219c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c2c5804-3d", "ovs_interfaceid": "9c2c5804-3d81-4e3a-9c17-073b1dc171e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-698ebc5c-ba53-4a27-b06a-3f71ef2422ad req-49c576d1-e7be-466d-945f-002be527037c service nova] Acquired lock "refresh_cache-59ab3484-9785-48b4-96fb-1563a6fb8434" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG nova.network.neutron [req-698ebc5c-ba53-4a27-b06a-3f71ef2422ad req-49c576d1-e7be-466d-945f-002be527037c service nova] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Refreshing network info cache for port 9c2c5804-3d81-4e3a-9c17-073b1dc171e3 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Start _get_guest_xml network_info=[{"id": "9c2c5804-3d81-4e3a-9c17-073b1dc171e3", "address": "fa:16:3e:0c:3e:53", "network": {"id": "606f4918-8904-4548-9cfd-b1e0c1eed7ee", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1638907501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2aaccb94133476fbded17c902219c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c2c5804-3d", "ovs_interfaceid": "9c2c5804-3d81-4e3a-9c17-073b1dc171e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:15:09 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:15:09 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:15:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:15:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1093579140',display_name='tempest-DeleteServersTestJSON-server-1093579140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1093579140',id=1,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2aaccb94133476fbded17c902219c2a',ramdisk_id='',reservation_id='r-o2zgbk44',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-500805402',owner_user_name='tempest-DeleteServersTestJSON-500805402-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:15:03Z,user_data=None,user_id='1a8198d38ce4478a8fa932223d9b0dcb',uuid=59ab3484-9785-48b4-96fb-1563a6fb8434,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c2c5804-3d81-4e3a-9c17-073b1dc171e3", "address": "fa:16:3e:0c:3e:53", "network": {"id": "606f4918-8904-4548-9cfd-b1e0c1eed7ee", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1638907501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2aaccb94133476fbded17c902219c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c2c5804-3d", "ovs_interfaceid": "9c2c5804-3d81-4e3a-9c17-073b1dc171e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Converting VIF {"id": "9c2c5804-3d81-4e3a-9c17-073b1dc171e3", "address": "fa:16:3e:0c:3e:53", "network": {"id": "606f4918-8904-4548-9cfd-b1e0c1eed7ee", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1638907501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2aaccb94133476fbded17c902219c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c2c5804-3d", "ovs_interfaceid": "9c2c5804-3d81-4e3a-9c17-073b1dc171e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:3e:53,bridge_name='br-int',has_traffic_filtering=True,id=9c2c5804-3d81-4e3a-9c17-073b1dc171e3,network=Network(606f4918-8904-4548-9cfd-b1e0c1eed7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c2c5804-3d') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG nova.objects.instance [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Lazy-loading 'pci_devices' on Instance uuid 59ab3484-9785-48b4-96fb-1563a6fb8434 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG nova.network.neutron [req-765c8d51-1043-4bd8-aab1-66fae975b97e req-4b2e5820-bc41-4eb5-981f-c3b0d706dc58 service nova] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Updated VIF entry in instance network info cache for port 44169902-69da-4fe1-8292-a23e0ff15fc7. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG nova.network.neutron [req-765c8d51-1043-4bd8-aab1-66fae975b97e req-4b2e5820-bc41-4eb5-981f-c3b0d706dc58 service nova] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Updating instance_info_cache with network_info: [{"id": "44169902-69da-4fe1-8292-a23e0ff15fc7", "address": "fa:16:3e:b9:37:c6", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44169902-69", "ovs_interfaceid": "44169902-69da-4fe1-8292-a23e0ff15fc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:15:09 user nova-compute[74189]:   <uuid>59ab3484-9785-48b4-96fb-1563a6fb8434</uuid>
Oct 25 21:15:09 user nova-compute[74189]:   <name>instance-00000001</name>
Oct 25 21:15:09 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:15:09 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:15:09 user nova-compute[74189]:   <metadata>
Oct 25 21:15:09 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:15:09 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:15:09 user nova-compute[74189]:       <nova:name>tempest-DeleteServersTestJSON-server-1093579140</nova:name>
Oct 25 21:15:09 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:15:09</nova:creationTime>
Oct 25 21:15:09 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:15:09 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:15:09 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:15:09 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:15:09 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:15:09 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:15:09 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:15:09 user nova-compute[74189]:       <nova:owner>
Oct 25 21:15:09 user nova-compute[74189]:         <nova:user uuid="1a8198d38ce4478a8fa932223d9b0dcb">tempest-DeleteServersTestJSON-500805402-project-member</nova:user>
Oct 25 21:15:09 user nova-compute[74189]:         <nova:project uuid="d2aaccb94133476fbded17c902219c2a">tempest-DeleteServersTestJSON-500805402</nova:project>
Oct 25 21:15:09 user nova-compute[74189]:       </nova:owner>
Oct 25 21:15:09 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:15:09 user nova-compute[74189]:       <nova:ports>
Oct 25 21:15:09 user nova-compute[74189]:         <nova:port uuid="9c2c5804-3d81-4e3a-9c17-073b1dc171e3">
Oct 25 21:15:09 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 25 21:15:09 user nova-compute[74189]:         </nova:port>
Oct 25 21:15:09 user nova-compute[74189]:       </nova:ports>
Oct 25 21:15:09 user nova-compute[74189]:     </nova:instance>
Oct 25 21:15:09 user nova-compute[74189]:   </metadata>
Oct 25 21:15:09 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:15:09 user nova-compute[74189]:     <system>
Oct 25 21:15:09 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:15:09 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:15:09 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:15:09 user nova-compute[74189]:       <entry name="serial">59ab3484-9785-48b4-96fb-1563a6fb8434</entry>
Oct 25 21:15:09 user nova-compute[74189]:       <entry name="uuid">59ab3484-9785-48b4-96fb-1563a6fb8434</entry>
Oct 25 21:15:09 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:15:09 user nova-compute[74189]:     </system>
Oct 25 21:15:09 user nova-compute[74189]:   </sysinfo>
Oct 25 21:15:09 user nova-compute[74189]:   <os>
Oct 25 21:15:09 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:15:09 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:15:09 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:15:09 user nova-compute[74189]:   </os>
Oct 25 21:15:09 user nova-compute[74189]:   <features>
Oct 25 21:15:09 user nova-compute[74189]:     <acpi/>
Oct 25 21:15:09 user nova-compute[74189]:     <apic/>
Oct 25 21:15:09 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:15:09 user nova-compute[74189]:   </features>
Oct 25 21:15:09 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:15:09 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:15:09 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:15:09 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:15:09 user nova-compute[74189]:   </clock>
Oct 25 21:15:09 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:15:09 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:15:09 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:15:09 user nova-compute[74189]:   </cpu>
Oct 25 21:15:09 user nova-compute[74189]:   <devices>
Oct 25 21:15:09 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:15:09 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:15:09 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/59ab3484-9785-48b4-96fb-1563a6fb8434/disk"/>
Oct 25 21:15:09 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:15:09 user nova-compute[74189]:     </disk>
Oct 25 21:15:09 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:15:09 user nova-compute[74189]:       <mac address="fa:16:3e:0c:3e:53"/>
Oct 25 21:15:09 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:15:09 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:15:09 user nova-compute[74189]:       <target dev="tap9c2c5804-3d"/>
Oct 25 21:15:09 user nova-compute[74189]:     </interface>
Oct 25 21:15:09 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:15:09 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/59ab3484-9785-48b4-96fb-1563a6fb8434/console.log" append="off"/>
Oct 25 21:15:09 user nova-compute[74189]:     </serial>
Oct 25 21:15:09 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:15:09 user nova-compute[74189]:     <video>
Oct 25 21:15:09 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:15:09 user nova-compute[74189]:     </video>
Oct 25 21:15:09 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:15:09 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:15:09 user nova-compute[74189]:     </rng>
Oct 25 21:15:09 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:15:09 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:15:09 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:15:09 user nova-compute[74189]:     </memballoon>
Oct 25 21:15:09 user nova-compute[74189]:   </devices>
Oct 25 21:15:09 user nova-compute[74189]: </domain>
Oct 25 21:15:09 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:15:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1093579140',display_name='tempest-DeleteServersTestJSON-server-1093579140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1093579140',id=1,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2aaccb94133476fbded17c902219c2a',ramdisk_id='',reservation_id='r-o2zgbk44',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-500805402',owner_user_name='tempest-DeleteServersTestJSON-500805402-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:15:03Z,user_data=None,user_id='1a8198d38ce4478a8fa932223d9b0dcb',uuid=59ab3484-9785-48b4-96fb-1563a6fb8434,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c2c5804-3d81-4e3a-9c17-073b1dc171e3", "address": "fa:16:3e:0c:3e:53", "network": {"id": "606f4918-8904-4548-9cfd-b1e0c1eed7ee", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1638907501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2aaccb94133476fbded17c902219c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c2c5804-3d", "ovs_interfaceid": "9c2c5804-3d81-4e3a-9c17-073b1dc171e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Converting VIF {"id": "9c2c5804-3d81-4e3a-9c17-073b1dc171e3", "address": "fa:16:3e:0c:3e:53", "network": {"id": "606f4918-8904-4548-9cfd-b1e0c1eed7ee", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1638907501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2aaccb94133476fbded17c902219c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c2c5804-3d", "ovs_interfaceid": "9c2c5804-3d81-4e3a-9c17-073b1dc171e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:3e:53,bridge_name='br-int',has_traffic_filtering=True,id=9c2c5804-3d81-4e3a-9c17-073b1dc171e3,network=Network(606f4918-8904-4548-9cfd-b1e0c1eed7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c2c5804-3d') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG os_vif [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:3e:53,bridge_name='br-int',has_traffic_filtering=True,id=9c2c5804-3d81-4e3a-9c17-073b1dc171e3,network=Network(606f4918-8904-4548-9cfd-b1e0c1eed7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c2c5804-3d') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-765c8d51-1043-4bd8-aab1-66fae975b97e req-4b2e5820-bc41-4eb5-981f-c3b0d706dc58 service nova] Releasing lock "refresh_cache-d7c3a99a-ab38-4e88-896d-94ae51a09a48" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd908e6fc-d9f5-50bf-9297-26230af30349', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:15:09 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:09 user sudo[83483]: pam_unix(sudo:session): session closed for user root
Oct 25 21:15:09 user nova-compute[74189]: INFO oslo.privsep.daemon [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Spawned new privsep daemon via rootwrap
Oct 25 21:15:09 user nova-compute[74189]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 25 21:15:09 user nova-compute[74189]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 25 21:15:09 user nova-compute[74189]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 25 21:15:09 user nova-compute[74189]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83502
Oct 25 21:15:09 user nova-compute[74189]: WARNING oslo_privsep.priv_context [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] privsep daemon already running
Oct 25 21:15:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44169902-69, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap44169902-69, col_values=(('qos', UUID('a0c6d81d-0414-44a1-b2c7-06e4043d92ef')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap44169902-69, col_values=(('external_ids', {'iface-id': '44169902-69da-4fe1-8292-a23e0ff15fc7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:37:c6', 'vm-uuid': 'd7c3a99a-ab38-4e88-896d-94ae51a09a48'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:15:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:10 user nova-compute[74189]: INFO os_vif [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:37:c6,bridge_name='br-int',has_traffic_filtering=True,id=44169902-69da-4fe1-8292-a23e0ff15fc7,network=Network(f202171f-dfd8-4a19-9321-788318413ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44169902-69')
Oct 25 21:15:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c2c5804-3d, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c2c5804-3d, col_values=(('qos', UUID('e7244d44-6d98-4278-a585-8c3f132fe7c1')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c2c5804-3d, col_values=(('external_ids', {'iface-id': '9c2c5804-3d81-4e3a-9c17-073b1dc171e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:3e:53', 'vm-uuid': '59ab3484-9785-48b4-96fb-1563a6fb8434'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:15:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:10 user nova-compute[74189]: INFO os_vif [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:3e:53,bridge_name='br-int',has_traffic_filtering=True,id=9c2c5804-3d81-4e3a-9c17-073b1dc171e3,network=Network(606f4918-8904-4548-9cfd-b1e0c1eed7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c2c5804-3d')
Oct 25 21:15:10 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:15:10 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] No VIF found with MAC fa:16:3e:b9:37:c6, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:15:10 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:15:10 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] No VIF found with MAC fa:16:3e:0c:3e:53, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:15:10 user nova-compute[74189]: DEBUG nova.network.neutron [req-698ebc5c-ba53-4a27-b06a-3f71ef2422ad req-49c576d1-e7be-466d-945f-002be527037c service nova] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Updated VIF entry in instance network info cache for port 9c2c5804-3d81-4e3a-9c17-073b1dc171e3. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:15:10 user nova-compute[74189]: DEBUG nova.network.neutron [req-698ebc5c-ba53-4a27-b06a-3f71ef2422ad req-49c576d1-e7be-466d-945f-002be527037c service nova] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Updating instance_info_cache with network_info: [{"id": "9c2c5804-3d81-4e3a-9c17-073b1dc171e3", "address": "fa:16:3e:0c:3e:53", "network": {"id": "606f4918-8904-4548-9cfd-b1e0c1eed7ee", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1638907501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2aaccb94133476fbded17c902219c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c2c5804-3d", "ovs_interfaceid": "9c2c5804-3d81-4e3a-9c17-073b1dc171e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:15:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-698ebc5c-ba53-4a27-b06a-3f71ef2422ad req-49c576d1-e7be-466d-945f-002be527037c service nova] Releasing lock "refresh_cache-59ab3484-9785-48b4-96fb-1563a6fb8434" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:15:11 user nova-compute[74189]: DEBUG nova.network.neutron [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Successfully created port: c6a0280f-def7-4677-910c-7a3a3c6b57df {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:15:12 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:12 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:12 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:12 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:12 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:13 user nova-compute[74189]: DEBUG nova.network.neutron [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Successfully updated port: c6a0280f-def7-4677-910c-7a3a3c6b57df {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:15:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquiring lock "refresh_cache-5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:15:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquired lock "refresh_cache-5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:15:13 user nova-compute[74189]: DEBUG nova.network.neutron [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:15:14 user nova-compute[74189]: DEBUG nova.network.neutron [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:15:14 user nova-compute[74189]: DEBUG nova.compute.manager [req-be7a0091-fa99-4b3f-be72-b7d8f3e1f14d req-c65d4515-7ffa-47dd-8818-fe61e7f761e7 service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Received event network-changed-c6a0280f-def7-4677-910c-7a3a3c6b57df {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:15:14 user nova-compute[74189]: DEBUG nova.compute.manager [req-be7a0091-fa99-4b3f-be72-b7d8f3e1f14d req-c65d4515-7ffa-47dd-8818-fe61e7f761e7 service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Refreshing instance network info cache due to event network-changed-c6a0280f-def7-4677-910c-7a3a3c6b57df. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:15:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-be7a0091-fa99-4b3f-be72-b7d8f3e1f14d req-c65d4515-7ffa-47dd-8818-fe61e7f761e7 service nova] Acquiring lock "refresh_cache-5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:15:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.compute.manager [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:15:15 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Instance spawned successfully.
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:15:15 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Instance spawned successfully.
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.network.neutron [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Updating instance_info_cache with network_info: [{"id": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "address": "fa:16:3e:92:dc:7e", "network": {"id": "197dd483-54ad-4b81-a0d0-26c633b3a101", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1141346509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e426fbc4bb374115a46d927092d62423", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a0280f-de", "ovs_interfaceid": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Releasing lock "refresh_cache-5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.compute.manager [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Instance network_info: |[{"id": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "address": "fa:16:3e:92:dc:7e", "network": {"id": "197dd483-54ad-4b81-a0d0-26c633b3a101", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1141346509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e426fbc4bb374115a46d927092d62423", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a0280f-de", "ovs_interfaceid": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-be7a0091-fa99-4b3f-be72-b7d8f3e1f14d req-c65d4515-7ffa-47dd-8818-fe61e7f761e7 service nova] Acquired lock "refresh_cache-5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.network.neutron [req-be7a0091-fa99-4b3f-be72-b7d8f3e1f14d req-c65d4515-7ffa-47dd-8818-fe61e7f761e7 service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Refreshing network info cache for port c6a0280f-def7-4677-910c-7a3a3c6b57df {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Start _get_guest_xml network_info=[{"id": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "address": "fa:16:3e:92:dc:7e", "network": {"id": "197dd483-54ad-4b81-a0d0-26c633b3a101", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1141346509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e426fbc4bb374115a46d927092d62423", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a0280f-de", "ovs_interfaceid": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:15:15 user nova-compute[74189]: INFO nova.compute.manager [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Took 12.13 seconds to spawn the instance on the hypervisor.
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:15:15 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:15:15 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:15:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2127723699',display_name='tempest-ServerActionsTestOtherB-server-2127723699',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2127723699',id=3,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjedofMSVtj00tqk1jqFMH5AZ5Pyw9+9WP37zpM0w2hcAIIw4fFannJXo68FjlEI0XSKwz6/AZjg4uhqhEM0AXh7nvdUT82CEMoJ2RGXuMes6AOS513uwlo8CUT17ABSg==',key_name='tempest-keypair-611941333',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e426fbc4bb374115a46d927092d62423',ramdisk_id='',reservation_id='r-q0q32lk1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-40176194',owner_user_name='tempest-ServerActionsTestOtherB-40176194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:15:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e81aaad00624abdafe04f6c8de4c5c0',uuid=5d21b93a-b312-4c1b-9e43-ffb4b729c7d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "address": "fa:16:3e:92:dc:7e", "network": {"id": "197dd483-54ad-4b81-a0d0-26c633b3a101", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1141346509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e426fbc4bb374115a46d927092d62423", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a0280f-de", "ovs_interfaceid": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Converting VIF {"id": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "address": "fa:16:3e:92:dc:7e", "network": {"id": "197dd483-54ad-4b81-a0d0-26c633b3a101", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1141346509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e426fbc4bb374115a46d927092d62423", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a0280f-de", "ovs_interfaceid": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:dc:7e,bridge_name='br-int',has_traffic_filtering=True,id=c6a0280f-def7-4677-910c-7a3a3c6b57df,network=Network(197dd483-54ad-4b81-a0d0-26c633b3a101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6a0280f-de') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.objects.instance [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:15:15 user nova-compute[74189]: INFO nova.compute.manager [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Took 12.41 seconds to spawn the instance on the hypervisor.
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.compute.manager [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:15:15 user nova-compute[74189]:   <uuid>5d21b93a-b312-4c1b-9e43-ffb4b729c7d3</uuid>
Oct 25 21:15:15 user nova-compute[74189]:   <name>instance-00000003</name>
Oct 25 21:15:15 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:15:15 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:15:15 user nova-compute[74189]:   <metadata>
Oct 25 21:15:15 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:15:15 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:15:15 user nova-compute[74189]:       <nova:name>tempest-ServerActionsTestOtherB-server-2127723699</nova:name>
Oct 25 21:15:15 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:15:15</nova:creationTime>
Oct 25 21:15:15 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:15:15 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:15:15 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:15:15 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:15:15 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:15:15 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:15:15 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:15:15 user nova-compute[74189]:       <nova:owner>
Oct 25 21:15:15 user nova-compute[74189]:         <nova:user uuid="7e81aaad00624abdafe04f6c8de4c5c0">tempest-ServerActionsTestOtherB-40176194-project-member</nova:user>
Oct 25 21:15:15 user nova-compute[74189]:         <nova:project uuid="e426fbc4bb374115a46d927092d62423">tempest-ServerActionsTestOtherB-40176194</nova:project>
Oct 25 21:15:15 user nova-compute[74189]:       </nova:owner>
Oct 25 21:15:15 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:15:15 user nova-compute[74189]:       <nova:ports>
Oct 25 21:15:15 user nova-compute[74189]:         <nova:port uuid="c6a0280f-def7-4677-910c-7a3a3c6b57df">
Oct 25 21:15:15 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 25 21:15:15 user nova-compute[74189]:         </nova:port>
Oct 25 21:15:15 user nova-compute[74189]:       </nova:ports>
Oct 25 21:15:15 user nova-compute[74189]:     </nova:instance>
Oct 25 21:15:15 user nova-compute[74189]:   </metadata>
Oct 25 21:15:15 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:15:15 user nova-compute[74189]:     <system>
Oct 25 21:15:15 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:15:15 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:15:15 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:15:15 user nova-compute[74189]:       <entry name="serial">5d21b93a-b312-4c1b-9e43-ffb4b729c7d3</entry>
Oct 25 21:15:15 user nova-compute[74189]:       <entry name="uuid">5d21b93a-b312-4c1b-9e43-ffb4b729c7d3</entry>
Oct 25 21:15:15 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:15:15 user nova-compute[74189]:     </system>
Oct 25 21:15:15 user nova-compute[74189]:   </sysinfo>
Oct 25 21:15:15 user nova-compute[74189]:   <os>
Oct 25 21:15:15 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:15:15 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:15:15 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:15:15 user nova-compute[74189]:   </os>
Oct 25 21:15:15 user nova-compute[74189]:   <features>
Oct 25 21:15:15 user nova-compute[74189]:     <acpi/>
Oct 25 21:15:15 user nova-compute[74189]:     <apic/>
Oct 25 21:15:15 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:15:15 user nova-compute[74189]:   </features>
Oct 25 21:15:15 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:15:15 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:15:15 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:15:15 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:15:15 user nova-compute[74189]:   </clock>
Oct 25 21:15:15 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:15:15 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:15:15 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:15:15 user nova-compute[74189]:   </cpu>
Oct 25 21:15:15 user nova-compute[74189]:   <devices>
Oct 25 21:15:15 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:15:15 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:15:15 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk"/>
Oct 25 21:15:15 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:15:15 user nova-compute[74189]:     </disk>
Oct 25 21:15:15 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:15:15 user nova-compute[74189]:       <mac address="fa:16:3e:92:dc:7e"/>
Oct 25 21:15:15 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:15:15 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:15:15 user nova-compute[74189]:       <target dev="tapc6a0280f-de"/>
Oct 25 21:15:15 user nova-compute[74189]:     </interface>
Oct 25 21:15:15 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:15:15 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/console.log" append="off"/>
Oct 25 21:15:15 user nova-compute[74189]:     </serial>
Oct 25 21:15:15 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:15:15 user nova-compute[74189]:     <video>
Oct 25 21:15:15 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:15:15 user nova-compute[74189]:     </video>
Oct 25 21:15:15 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:15:15 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:15:15 user nova-compute[74189]:     </rng>
Oct 25 21:15:15 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:15:15 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:15:15 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:15:15 user nova-compute[74189]:     </memballoon>
Oct 25 21:15:15 user nova-compute[74189]:   </devices>
Oct 25 21:15:15 user nova-compute[74189]: </domain>
Oct 25 21:15:15 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:15:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2127723699',display_name='tempest-ServerActionsTestOtherB-server-2127723699',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2127723699',id=3,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjedofMSVtj00tqk1jqFMH5AZ5Pyw9+9WP37zpM0w2hcAIIw4fFannJXo68FjlEI0XSKwz6/AZjg4uhqhEM0AXh7nvdUT82CEMoJ2RGXuMes6AOS513uwlo8CUT17ABSg==',key_name='tempest-keypair-611941333',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e426fbc4bb374115a46d927092d62423',ramdisk_id='',reservation_id='r-q0q32lk1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-40176194',owner_user_name='tempest-ServerActionsTestOtherB-40176194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:15:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e81aaad00624abdafe04f6c8de4c5c0',uuid=5d21b93a-b312-4c1b-9e43-ffb4b729c7d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "address": "fa:16:3e:92:dc:7e", "network": {"id": "197dd483-54ad-4b81-a0d0-26c633b3a101", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1141346509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e426fbc4bb374115a46d927092d62423", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a0280f-de", "ovs_interfaceid": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Converting VIF {"id": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "address": "fa:16:3e:92:dc:7e", "network": {"id": "197dd483-54ad-4b81-a0d0-26c633b3a101", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1141346509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e426fbc4bb374115a46d927092d62423", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a0280f-de", "ovs_interfaceid": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:dc:7e,bridge_name='br-int',has_traffic_filtering=True,id=c6a0280f-def7-4677-910c-7a3a3c6b57df,network=Network(197dd483-54ad-4b81-a0d0-26c633b3a101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6a0280f-de') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG os_vif [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:dc:7e,bridge_name='br-int',has_traffic_filtering=True,id=c6a0280f-def7-4677-910c-7a3a3c6b57df,network=Network(197dd483-54ad-4b81-a0d0-26c633b3a101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6a0280f-de') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0a599051-42c4-58ad-af42-6ca12a2e31cb', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:15 user nova-compute[74189]: INFO nova.compute.manager [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Took 13.14 seconds to build instance.
Oct 25 21:15:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6a0280f-de, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc6a0280f-de, col_values=(('qos', UUID('243d15ca-834d-4483-8fb7-a029cdcb6a1d')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc6a0280f-de, col_values=(('external_ids', {'iface-id': 'c6a0280f-def7-4677-910c-7a3a3c6b57df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:dc:7e', 'vm-uuid': '5d21b93a-b312-4c1b-9e43-ffb4b729c7d3'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5e6b3c70-0151-4cd2-968f-0cb8475663a4 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Lock "59ab3484-9785-48b4-96fb-1563a6fb8434" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.575s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:15 user nova-compute[74189]: INFO os_vif [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:dc:7e,bridge_name='br-int',has_traffic_filtering=True,id=c6a0280f-def7-4677-910c-7a3a3c6b57df,network=Network(197dd483-54ad-4b81-a0d0-26c633b3a101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6a0280f-de')
Oct 25 21:15:15 user nova-compute[74189]: INFO nova.compute.manager [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Took 13.19 seconds to build instance.
Oct 25 21:15:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9ae9dd51-12de-4a90-be81-b5124a15ddaf tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "d7c3a99a-ab38-4e88-896d-94ae51a09a48" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.634s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:15:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] No VIF found with MAC fa:16:3e:92:dc:7e, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:15:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Acquiring lock "c69c0800-7a6c-4155-9f90-bbcd323276d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "c69c0800-7a6c-4155-9f90-bbcd323276d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:16 user nova-compute[74189]: DEBUG nova.compute.manager [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:15:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:16 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:15:16 user nova-compute[74189]: INFO nova.compute.claims [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Claim successful on node user
Oct 25 21:15:16 user nova-compute[74189]: DEBUG nova.network.neutron [req-be7a0091-fa99-4b3f-be72-b7d8f3e1f14d req-c65d4515-7ffa-47dd-8818-fe61e7f761e7 service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Updated VIF entry in instance network info cache for port c6a0280f-def7-4677-910c-7a3a3c6b57df. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:15:16 user nova-compute[74189]: DEBUG nova.network.neutron [req-be7a0091-fa99-4b3f-be72-b7d8f3e1f14d req-c65d4515-7ffa-47dd-8818-fe61e7f761e7 service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Updating instance_info_cache with network_info: [{"id": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "address": "fa:16:3e:92:dc:7e", "network": {"id": "197dd483-54ad-4b81-a0d0-26c633b3a101", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1141346509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e426fbc4bb374115a46d927092d62423", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a0280f-de", "ovs_interfaceid": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:15:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-be7a0091-fa99-4b3f-be72-b7d8f3e1f14d req-c65d4515-7ffa-47dd-8818-fe61e7f761e7 service nova] Releasing lock "refresh_cache-5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:15:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:17 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:15:17 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:15:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.580s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:17 user nova-compute[74189]: DEBUG nova.compute.manager [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:15:17 user nova-compute[74189]: DEBUG nova.compute.manager [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:15:17 user nova-compute[74189]: DEBUG nova.network.neutron [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:15:17 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:15:17 user nova-compute[74189]: DEBUG nova.compute.manager [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:15:17 user nova-compute[74189]: DEBUG nova.policy [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '522bbceca0c6444cb16bb575f4186c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c2027cbebd4ffd9989ba14156beeba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:15:17 user nova-compute[74189]: DEBUG nova.compute.manager [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:15:17 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:15:17 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Creating image(s)
Oct 25 21:15:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Acquiring lock "/opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "/opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "/opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.210s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.262s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk 1073741824" returned: 0 in 0.074s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.355s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:18 user nova-compute[74189]: DEBUG nova.compute.manager [req-684d94da-8918-4582-a407-932bbfce76e1 req-63de7521-a6c3-42a9-be1d-3e0ede4c97b5 service nova] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Received event network-vif-plugged-9c2c5804-3d81-4e3a-9c17-073b1dc171e3 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:15:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-684d94da-8918-4582-a407-932bbfce76e1 req-63de7521-a6c3-42a9-be1d-3e0ede4c97b5 service nova] Acquiring lock "59ab3484-9785-48b4-96fb-1563a6fb8434-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-684d94da-8918-4582-a407-932bbfce76e1 req-63de7521-a6c3-42a9-be1d-3e0ede4c97b5 service nova] Lock "59ab3484-9785-48b4-96fb-1563a6fb8434-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-684d94da-8918-4582-a407-932bbfce76e1 req-63de7521-a6c3-42a9-be1d-3e0ede4c97b5 service nova] Lock "59ab3484-9785-48b4-96fb-1563a6fb8434-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:18 user nova-compute[74189]: DEBUG nova.compute.manager [req-684d94da-8918-4582-a407-932bbfce76e1 req-63de7521-a6c3-42a9-be1d-3e0ede4c97b5 service nova] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] No waiting events found dispatching network-vif-plugged-9c2c5804-3d81-4e3a-9c17-073b1dc171e3 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:15:18 user nova-compute[74189]: WARNING nova.compute.manager [req-684d94da-8918-4582-a407-932bbfce76e1 req-63de7521-a6c3-42a9-be1d-3e0ede4c97b5 service nova] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Received unexpected event network-vif-plugged-9c2c5804-3d81-4e3a-9c17-073b1dc171e3 for instance with vm_state active and task_state None.
Oct 25 21:15:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.280s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:18 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:15:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk --force-share --output=json" returned: 0 in 0.328s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:19 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Cannot resize image /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:15:19 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:15:19 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Ensure instance console log exists: /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:15:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:20 user nova-compute[74189]: DEBUG nova.compute.manager [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:15:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:15:20 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Instance spawned successfully.
Oct 25 21:15:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:15:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:20 user nova-compute[74189]: INFO nova.compute.manager [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Took 12.03 seconds to spawn the instance on the hypervisor.
Oct 25 21:15:20 user nova-compute[74189]: DEBUG nova.compute.manager [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:15:20 user nova-compute[74189]: DEBUG nova.network.neutron [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Successfully created port: e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:15:20 user nova-compute[74189]: INFO nova.compute.manager [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Took 13.06 seconds to build instance.
Oct 25 21:15:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e5c9e9bb-dc07-48f1-bcfd-dc3219fb1949 tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.195s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:20 user nova-compute[74189]: DEBUG nova.compute.manager [req-d7f5bedf-8fc1-4ec8-a353-4b65197d8769 req-83f79383-1e57-4749-8387-aa9ec8ea83df service nova] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Received event network-vif-plugged-9c2c5804-3d81-4e3a-9c17-073b1dc171e3 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:15:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d7f5bedf-8fc1-4ec8-a353-4b65197d8769 req-83f79383-1e57-4749-8387-aa9ec8ea83df service nova] Acquiring lock "59ab3484-9785-48b4-96fb-1563a6fb8434-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d7f5bedf-8fc1-4ec8-a353-4b65197d8769 req-83f79383-1e57-4749-8387-aa9ec8ea83df service nova] Lock "59ab3484-9785-48b4-96fb-1563a6fb8434-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d7f5bedf-8fc1-4ec8-a353-4b65197d8769 req-83f79383-1e57-4749-8387-aa9ec8ea83df service nova] Lock "59ab3484-9785-48b4-96fb-1563a6fb8434-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:20 user nova-compute[74189]: DEBUG nova.compute.manager [req-d7f5bedf-8fc1-4ec8-a353-4b65197d8769 req-83f79383-1e57-4749-8387-aa9ec8ea83df service nova] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] No waiting events found dispatching network-vif-plugged-9c2c5804-3d81-4e3a-9c17-073b1dc171e3 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:15:20 user nova-compute[74189]: WARNING nova.compute.manager [req-d7f5bedf-8fc1-4ec8-a353-4b65197d8769 req-83f79383-1e57-4749-8387-aa9ec8ea83df service nova] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Received unexpected event network-vif-plugged-9c2c5804-3d81-4e3a-9c17-073b1dc171e3 for instance with vm_state active and task_state None.
Oct 25 21:15:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:22 user nova-compute[74189]: DEBUG nova.network.neutron [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Successfully updated port: e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:15:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Acquiring lock "refresh_cache-c69c0800-7a6c-4155-9f90-bbcd323276d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:15:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Acquired lock "refresh_cache-c69c0800-7a6c-4155-9f90-bbcd323276d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:15:22 user nova-compute[74189]: DEBUG nova.network.neutron [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:15:22 user nova-compute[74189]: DEBUG nova.compute.manager [req-1a57e554-8454-42ee-b30e-f2653ea47104 req-f3deda02-5907-41b6-991e-20c290e4a1c3 service nova] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Received event network-changed-e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:15:22 user nova-compute[74189]: DEBUG nova.compute.manager [req-1a57e554-8454-42ee-b30e-f2653ea47104 req-f3deda02-5907-41b6-991e-20c290e4a1c3 service nova] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Refreshing instance network info cache due to event network-changed-e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:15:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1a57e554-8454-42ee-b30e-f2653ea47104 req-f3deda02-5907-41b6-991e-20c290e4a1c3 service nova] Acquiring lock "refresh_cache-c69c0800-7a6c-4155-9f90-bbcd323276d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:15:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:22 user nova-compute[74189]: DEBUG nova.network.neutron [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:15:22 user nova-compute[74189]: DEBUG nova.network.neutron [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Updating instance_info_cache with network_info: [{"id": "e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc", "address": "fa:16:3e:50:70:e6", "network": {"id": "093e46a2-3a83-46b5-a13b-661868863db1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1577201171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09c2027cbebd4ffd9989ba14156beeba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3d8e995-9e", "ovs_interfaceid": "e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:15:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Releasing lock "refresh_cache-c69c0800-7a6c-4155-9f90-bbcd323276d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:15:22 user nova-compute[74189]: DEBUG nova.compute.manager [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Instance network_info: |[{"id": "e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc", "address": "fa:16:3e:50:70:e6", "network": {"id": "093e46a2-3a83-46b5-a13b-661868863db1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1577201171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09c2027cbebd4ffd9989ba14156beeba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3d8e995-9e", "ovs_interfaceid": "e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:15:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1a57e554-8454-42ee-b30e-f2653ea47104 req-f3deda02-5907-41b6-991e-20c290e4a1c3 service nova] Acquired lock "refresh_cache-c69c0800-7a6c-4155-9f90-bbcd323276d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:15:22 user nova-compute[74189]: DEBUG nova.network.neutron [req-1a57e554-8454-42ee-b30e-f2653ea47104 req-f3deda02-5907-41b6-991e-20c290e4a1c3 service nova] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Refreshing network info cache for port e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:15:22 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Start _get_guest_xml network_info=[{"id": "e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc", "address": "fa:16:3e:50:70:e6", "network": {"id": "093e46a2-3a83-46b5-a13b-661868863db1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1577201171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09c2027cbebd4ffd9989ba14156beeba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3d8e995-9e", "ovs_interfaceid": "e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:15:23 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:15:23 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:15:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:15:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-321773804',display_name='tempest-VolumesAdminNegativeTest-server-321773804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-321773804',id=4,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAcw5K2fqQ5xKMGOSbKRExrPvp5/warLlYZ7C/EesC2xv80e7P00O+2HvP4NZszO8MvSIkHuDG0qMqoqJxbMj3TzgQtSkLFwJ/Q29Px71ky3eISIhv7x5mNa3is6lvenXw==',key_name='tempest-keypair-256484169',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09c2027cbebd4ffd9989ba14156beeba',ramdisk_id='',reservation_id='r-gy5555wd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-892271548',owner_user_name='tempest-VolumesAdminNegativeTest-892271548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:15:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='522bbceca0c6444cb16bb575f4186c5c',uuid=c69c0800-7a6c-4155-9f90-bbcd323276d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc", "address": "fa:16:3e:50:70:e6", "network": {"id": "093e46a2-3a83-46b5-a13b-661868863db1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1577201171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09c2027cbebd4ffd9989ba14156beeba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3d8e995-9e", "ovs_interfaceid": "e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Converting VIF {"id": "e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc", "address": "fa:16:3e:50:70:e6", "network": {"id": "093e46a2-3a83-46b5-a13b-661868863db1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1577201171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09c2027cbebd4ffd9989ba14156beeba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3d8e995-9e", "ovs_interfaceid": "e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:70:e6,bridge_name='br-int',has_traffic_filtering=True,id=e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc,network=Network(093e46a2-3a83-46b5-a13b-661868863db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3d8e995-9e') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG nova.objects.instance [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lazy-loading 'pci_devices' on Instance uuid c69c0800-7a6c-4155-9f90-bbcd323276d3 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:15:23 user nova-compute[74189]:   <uuid>c69c0800-7a6c-4155-9f90-bbcd323276d3</uuid>
Oct 25 21:15:23 user nova-compute[74189]:   <name>instance-00000004</name>
Oct 25 21:15:23 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:15:23 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:15:23 user nova-compute[74189]:   <metadata>
Oct 25 21:15:23 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:15:23 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:15:23 user nova-compute[74189]:       <nova:name>tempest-VolumesAdminNegativeTest-server-321773804</nova:name>
Oct 25 21:15:23 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:15:23</nova:creationTime>
Oct 25 21:15:23 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:15:23 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:15:23 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:15:23 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:15:23 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:15:23 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:15:23 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:15:23 user nova-compute[74189]:       <nova:owner>
Oct 25 21:15:23 user nova-compute[74189]:         <nova:user uuid="522bbceca0c6444cb16bb575f4186c5c">tempest-VolumesAdminNegativeTest-892271548-project-member</nova:user>
Oct 25 21:15:23 user nova-compute[74189]:         <nova:project uuid="09c2027cbebd4ffd9989ba14156beeba">tempest-VolumesAdminNegativeTest-892271548</nova:project>
Oct 25 21:15:23 user nova-compute[74189]:       </nova:owner>
Oct 25 21:15:23 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:15:23 user nova-compute[74189]:       <nova:ports>
Oct 25 21:15:23 user nova-compute[74189]:         <nova:port uuid="e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc">
Oct 25 21:15:23 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 25 21:15:23 user nova-compute[74189]:         </nova:port>
Oct 25 21:15:23 user nova-compute[74189]:       </nova:ports>
Oct 25 21:15:23 user nova-compute[74189]:     </nova:instance>
Oct 25 21:15:23 user nova-compute[74189]:   </metadata>
Oct 25 21:15:23 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:15:23 user nova-compute[74189]:     <system>
Oct 25 21:15:23 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:15:23 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:15:23 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:15:23 user nova-compute[74189]:       <entry name="serial">c69c0800-7a6c-4155-9f90-bbcd323276d3</entry>
Oct 25 21:15:23 user nova-compute[74189]:       <entry name="uuid">c69c0800-7a6c-4155-9f90-bbcd323276d3</entry>
Oct 25 21:15:23 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:15:23 user nova-compute[74189]:     </system>
Oct 25 21:15:23 user nova-compute[74189]:   </sysinfo>
Oct 25 21:15:23 user nova-compute[74189]:   <os>
Oct 25 21:15:23 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:15:23 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:15:23 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:15:23 user nova-compute[74189]:   </os>
Oct 25 21:15:23 user nova-compute[74189]:   <features>
Oct 25 21:15:23 user nova-compute[74189]:     <acpi/>
Oct 25 21:15:23 user nova-compute[74189]:     <apic/>
Oct 25 21:15:23 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:15:23 user nova-compute[74189]:   </features>
Oct 25 21:15:23 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:15:23 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:15:23 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:15:23 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:15:23 user nova-compute[74189]:   </clock>
Oct 25 21:15:23 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:15:23 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:15:23 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:15:23 user nova-compute[74189]:   </cpu>
Oct 25 21:15:23 user nova-compute[74189]:   <devices>
Oct 25 21:15:23 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:15:23 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:15:23 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk"/>
Oct 25 21:15:23 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:15:23 user nova-compute[74189]:     </disk>
Oct 25 21:15:23 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:15:23 user nova-compute[74189]:       <mac address="fa:16:3e:50:70:e6"/>
Oct 25 21:15:23 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:15:23 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:15:23 user nova-compute[74189]:       <target dev="tape3d8e995-9e"/>
Oct 25 21:15:23 user nova-compute[74189]:     </interface>
Oct 25 21:15:23 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:15:23 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/console.log" append="off"/>
Oct 25 21:15:23 user nova-compute[74189]:     </serial>
Oct 25 21:15:23 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:15:23 user nova-compute[74189]:     <video>
Oct 25 21:15:23 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:15:23 user nova-compute[74189]:     </video>
Oct 25 21:15:23 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:15:23 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:15:23 user nova-compute[74189]:     </rng>
Oct 25 21:15:23 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:15:23 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:15:23 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:15:23 user nova-compute[74189]:     </memballoon>
Oct 25 21:15:23 user nova-compute[74189]:   </devices>
Oct 25 21:15:23 user nova-compute[74189]: </domain>
Oct 25 21:15:23 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:15:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-321773804',display_name='tempest-VolumesAdminNegativeTest-server-321773804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-321773804',id=4,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAcw5K2fqQ5xKMGOSbKRExrPvp5/warLlYZ7C/EesC2xv80e7P00O+2HvP4NZszO8MvSIkHuDG0qMqoqJxbMj3TzgQtSkLFwJ/Q29Px71ky3eISIhv7x5mNa3is6lvenXw==',key_name='tempest-keypair-256484169',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09c2027cbebd4ffd9989ba14156beeba',ramdisk_id='',reservation_id='r-gy5555wd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-892271548',owner_user_name='tempest-VolumesAdminNegativeTest-892271548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:15:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='522bbceca0c6444cb16bb575f4186c5c',uuid=c69c0800-7a6c-4155-9f90-bbcd323276d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc", "address": "fa:16:3e:50:70:e6", "network": {"id": "093e46a2-3a83-46b5-a13b-661868863db1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1577201171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09c2027cbebd4ffd9989ba14156beeba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3d8e995-9e", "ovs_interfaceid": "e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Converting VIF {"id": "e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc", "address": "fa:16:3e:50:70:e6", "network": {"id": "093e46a2-3a83-46b5-a13b-661868863db1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1577201171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09c2027cbebd4ffd9989ba14156beeba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3d8e995-9e", "ovs_interfaceid": "e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:70:e6,bridge_name='br-int',has_traffic_filtering=True,id=e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc,network=Network(093e46a2-3a83-46b5-a13b-661868863db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3d8e995-9e') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG os_vif [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:70:e6,bridge_name='br-int',has_traffic_filtering=True,id=e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc,network=Network(093e46a2-3a83-46b5-a13b-661868863db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3d8e995-9e') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d859b9a-991e-5fc2-973c-1a7898d60798', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3d8e995-9e, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape3d8e995-9e, col_values=(('qos', UUID('bbc421f1-9439-4a79-8859-1ad619d08f28')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape3d8e995-9e, col_values=(('external_ids', {'iface-id': 'e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:70:e6', 'vm-uuid': 'c69c0800-7a6c-4155-9f90-bbcd323276d3'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:23 user nova-compute[74189]: INFO os_vif [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:70:e6,bridge_name='br-int',has_traffic_filtering=True,id=e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc,network=Network(093e46a2-3a83-46b5-a13b-661868863db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3d8e995-9e')
Oct 25 21:15:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:15:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] No VIF found with MAC fa:16:3e:50:70:e6, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:15:24 user nova-compute[74189]: DEBUG nova.network.neutron [req-1a57e554-8454-42ee-b30e-f2653ea47104 req-f3deda02-5907-41b6-991e-20c290e4a1c3 service nova] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Updated VIF entry in instance network info cache for port e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:15:24 user nova-compute[74189]: DEBUG nova.network.neutron [req-1a57e554-8454-42ee-b30e-f2653ea47104 req-f3deda02-5907-41b6-991e-20c290e4a1c3 service nova] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Updating instance_info_cache with network_info: [{"id": "e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc", "address": "fa:16:3e:50:70:e6", "network": {"id": "093e46a2-3a83-46b5-a13b-661868863db1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1577201171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09c2027cbebd4ffd9989ba14156beeba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3d8e995-9e", "ovs_interfaceid": "e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:15:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1a57e554-8454-42ee-b30e-f2653ea47104 req-f3deda02-5907-41b6-991e-20c290e4a1c3 service nova] Releasing lock "refresh_cache-c69c0800-7a6c-4155-9f90-bbcd323276d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:15:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:28 user nova-compute[74189]: DEBUG nova.compute.manager [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:15:28 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:15:28 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Instance spawned successfully.
Oct 25 21:15:28 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:15:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:28 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:28 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:28 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:28 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:28 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:28 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:28 user nova-compute[74189]: INFO nova.compute.manager [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Took 10.55 seconds to spawn the instance on the hypervisor.
Oct 25 21:15:28 user nova-compute[74189]: DEBUG nova.compute.manager [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:15:28 user nova-compute[74189]: INFO nova.compute.manager [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Took 11.69 seconds to build instance.
Oct 25 21:15:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-63470e5b-1756-40dd-8cf1-06e71094f78a tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "c69c0800-7a6c-4155-9f90-bbcd323276d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.838s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:28 user nova-compute[74189]: DEBUG nova.compute.manager [req-f9b8b613-99f4-454c-b9cf-1e241a842720 req-cc63f168-7cec-488a-9d99-880356fbbb25 service nova] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Received event network-vif-plugged-44169902-69da-4fe1-8292-a23e0ff15fc7 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:15:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f9b8b613-99f4-454c-b9cf-1e241a842720 req-cc63f168-7cec-488a-9d99-880356fbbb25 service nova] Acquiring lock "d7c3a99a-ab38-4e88-896d-94ae51a09a48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f9b8b613-99f4-454c-b9cf-1e241a842720 req-cc63f168-7cec-488a-9d99-880356fbbb25 service nova] Lock "d7c3a99a-ab38-4e88-896d-94ae51a09a48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f9b8b613-99f4-454c-b9cf-1e241a842720 req-cc63f168-7cec-488a-9d99-880356fbbb25 service nova] Lock "d7c3a99a-ab38-4e88-896d-94ae51a09a48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:28 user nova-compute[74189]: DEBUG nova.compute.manager [req-f9b8b613-99f4-454c-b9cf-1e241a842720 req-cc63f168-7cec-488a-9d99-880356fbbb25 service nova] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] No waiting events found dispatching network-vif-plugged-44169902-69da-4fe1-8292-a23e0ff15fc7 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:15:28 user nova-compute[74189]: WARNING nova.compute.manager [req-f9b8b613-99f4-454c-b9cf-1e241a842720 req-cc63f168-7cec-488a-9d99-880356fbbb25 service nova] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Received unexpected event network-vif-plugged-44169902-69da-4fe1-8292-a23e0ff15fc7 for instance with vm_state active and task_state None.
Oct 25 21:15:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:31 user nova-compute[74189]: DEBUG nova.compute.manager [req-d2a84f8e-c539-42a6-8939-ebab6b88562d req-cdb7aa06-af79-4ea2-916f-4f3d01a3c2a8 service nova] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Received event network-vif-plugged-44169902-69da-4fe1-8292-a23e0ff15fc7 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:15:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d2a84f8e-c539-42a6-8939-ebab6b88562d req-cdb7aa06-af79-4ea2-916f-4f3d01a3c2a8 service nova] Acquiring lock "d7c3a99a-ab38-4e88-896d-94ae51a09a48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d2a84f8e-c539-42a6-8939-ebab6b88562d req-cdb7aa06-af79-4ea2-916f-4f3d01a3c2a8 service nova] Lock "d7c3a99a-ab38-4e88-896d-94ae51a09a48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d2a84f8e-c539-42a6-8939-ebab6b88562d req-cdb7aa06-af79-4ea2-916f-4f3d01a3c2a8 service nova] Lock "d7c3a99a-ab38-4e88-896d-94ae51a09a48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:31 user nova-compute[74189]: DEBUG nova.compute.manager [req-d2a84f8e-c539-42a6-8939-ebab6b88562d req-cdb7aa06-af79-4ea2-916f-4f3d01a3c2a8 service nova] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] No waiting events found dispatching network-vif-plugged-44169902-69da-4fe1-8292-a23e0ff15fc7 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:15:31 user nova-compute[74189]: WARNING nova.compute.manager [req-d2a84f8e-c539-42a6-8939-ebab6b88562d req-cdb7aa06-af79-4ea2-916f-4f3d01a3c2a8 service nova] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Received unexpected event network-vif-plugged-44169902-69da-4fe1-8292-a23e0ff15fc7 for instance with vm_state active and task_state None.
Oct 25 21:15:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Acquiring lock "c4c57363-0107-4567-9842-44a0522f8326" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lock "c4c57363-0107-4567-9842-44a0522f8326" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:32 user nova-compute[74189]: DEBUG nova.compute.manager [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:15:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:32 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:15:32 user nova-compute[74189]: INFO nova.compute.claims [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Claim successful on node user
Oct 25 21:15:32 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:15:33 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:15:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.579s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:33 user nova-compute[74189]: DEBUG nova.compute.manager [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:15:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:33 user nova-compute[74189]: DEBUG nova.compute.manager [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:15:33 user nova-compute[74189]: DEBUG nova.network.neutron [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:15:33 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 25 21:15:33 user nova-compute[74189]: DEBUG nova.compute.manager [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:15:33 user nova-compute[74189]: DEBUG nova.policy [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7da73c191b3342b9b5f3834e0d111fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9669b7ed3a8846fb8e90800fe65a271d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:15:33 user nova-compute[74189]: DEBUG nova.compute.manager [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:15:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:15:33 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Creating image(s)
Oct 25 21:15:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Acquiring lock "/opt/stack/data/nova/instances/c4c57363-0107-4567-9842-44a0522f8326/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lock "/opt/stack/data/nova/instances/c4c57363-0107-4567-9842-44a0522f8326/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lock "/opt/stack/data/nova/instances/c4c57363-0107-4567-9842-44a0522f8326/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Acquiring lock "070cffac7a621c3286603ac36d65087ce49fdde9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lock "070cffac7a621c3286603ac36d65087ce49fdde9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/070cffac7a621c3286603ac36d65087ce49fdde9.part --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:34 user nova-compute[74189]: DEBUG nova.network.neutron [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Successfully created port: 032dd7a9-5ab8-4e42-883a-3ce412b9ee1d {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:15:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/070cffac7a621c3286603ac36d65087ce49fdde9.part --force-share --output=json" returned: 0 in 0.364s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:34 user nova-compute[74189]: DEBUG nova.virt.images [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] e871b7fb-9cf2-4a9a-b6a0-c207d71e6165 was qcow2, converting to raw {{(pid=74189) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 21:15:34 user nova-compute[74189]: DEBUG nova.privsep.utils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74189) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 21:15:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/070cffac7a621c3286603ac36d65087ce49fdde9.part /opt/stack/data/nova/instances/_base/070cffac7a621c3286603ac36d65087ce49fdde9.converted {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/070cffac7a621c3286603ac36d65087ce49fdde9.part /opt/stack/data/nova/instances/_base/070cffac7a621c3286603ac36d65087ce49fdde9.converted" returned: 0 in 0.238s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/070cffac7a621c3286603ac36d65087ce49fdde9.converted --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/070cffac7a621c3286603ac36d65087ce49fdde9.converted --force-share --output=json" returned: 0 in 0.229s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lock "070cffac7a621c3286603ac36d65087ce49fdde9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.357s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/070cffac7a621c3286603ac36d65087ce49fdde9 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/070cffac7a621c3286603ac36d65087ce49fdde9 --force-share --output=json" returned: 0 in 0.238s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Acquiring lock "070cffac7a621c3286603ac36d65087ce49fdde9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lock "070cffac7a621c3286603ac36d65087ce49fdde9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/070cffac7a621c3286603ac36d65087ce49fdde9 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG nova.network.neutron [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Successfully updated port: 032dd7a9-5ab8-4e42-883a-3ce412b9ee1d {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-08a7614b-b9db-4187-ad57-19c193549efc req-2a046ea6-ecb4-4256-bdc4-1b8ad7f8b618 service nova] [instance: c4c57363-0107-4567-9842-44a0522f8326] Received event network-changed-032dd7a9-5ab8-4e42-883a-3ce412b9ee1d {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-08a7614b-b9db-4187-ad57-19c193549efc req-2a046ea6-ecb4-4256-bdc4-1b8ad7f8b618 service nova] [instance: c4c57363-0107-4567-9842-44a0522f8326] Refreshing instance network info cache due to event network-changed-032dd7a9-5ab8-4e42-883a-3ce412b9ee1d. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-08a7614b-b9db-4187-ad57-19c193549efc req-2a046ea6-ecb4-4256-bdc4-1b8ad7f8b618 service nova] Acquiring lock "refresh_cache-c4c57363-0107-4567-9842-44a0522f8326" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-08a7614b-b9db-4187-ad57-19c193549efc req-2a046ea6-ecb4-4256-bdc4-1b8ad7f8b618 service nova] Acquired lock "refresh_cache-c4c57363-0107-4567-9842-44a0522f8326" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG nova.network.neutron [req-08a7614b-b9db-4187-ad57-19c193549efc req-2a046ea6-ecb4-4256-bdc4-1b8ad7f8b618 service nova] [instance: c4c57363-0107-4567-9842-44a0522f8326] Refreshing network info cache for port 032dd7a9-5ab8-4e42-883a-3ce412b9ee1d {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Acquiring lock "refresh_cache-c4c57363-0107-4567-9842-44a0522f8326" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG nova.network.neutron [req-08a7614b-b9db-4187-ad57-19c193549efc req-2a046ea6-ecb4-4256-bdc4-1b8ad7f8b618 service nova] [instance: c4c57363-0107-4567-9842-44a0522f8326] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/070cffac7a621c3286603ac36d65087ce49fdde9 --force-share --output=json" returned: 0 in 0.270s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/070cffac7a621c3286603ac36d65087ce49fdde9,backing_fmt=raw /opt/stack/data/nova/instances/c4c57363-0107-4567-9842-44a0522f8326/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/070cffac7a621c3286603ac36d65087ce49fdde9,backing_fmt=raw /opt/stack/data/nova/instances/c4c57363-0107-4567-9842-44a0522f8326/disk 1073741824" returned: 0 in 0.067s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lock "070cffac7a621c3286603ac36d65087ce49fdde9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.344s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/070cffac7a621c3286603ac36d65087ce49fdde9 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG nova.network.neutron [req-08a7614b-b9db-4187-ad57-19c193549efc req-2a046ea6-ecb4-4256-bdc4-1b8ad7f8b618 service nova] [instance: c4c57363-0107-4567-9842-44a0522f8326] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-08a7614b-b9db-4187-ad57-19c193549efc req-2a046ea6-ecb4-4256-bdc4-1b8ad7f8b618 service nova] Releasing lock "refresh_cache-c4c57363-0107-4567-9842-44a0522f8326" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Acquired lock "refresh_cache-c4c57363-0107-4567-9842-44a0522f8326" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG nova.network.neutron [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/070cffac7a621c3286603ac36d65087ce49fdde9 --force-share --output=json" returned: 0 in 0.298s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c4c57363-0107-4567-9842-44a0522f8326/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4c57363-0107-4567-9842-44a0522f8326/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-6a2fed37-fcab-4ea6-a9e9-906159d9a8c5 req-35de9e94-acd2-4841-9092-d271ab5ff3de service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Received event network-vif-plugged-c6a0280f-def7-4677-910c-7a3a3c6b57df {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-6a2fed37-fcab-4ea6-a9e9-906159d9a8c5 req-35de9e94-acd2-4841-9092-d271ab5ff3de service nova] Acquiring lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-6a2fed37-fcab-4ea6-a9e9-906159d9a8c5 req-35de9e94-acd2-4841-9092-d271ab5ff3de service nova] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-6a2fed37-fcab-4ea6-a9e9-906159d9a8c5 req-35de9e94-acd2-4841-9092-d271ab5ff3de service nova] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-6a2fed37-fcab-4ea6-a9e9-906159d9a8c5 req-35de9e94-acd2-4841-9092-d271ab5ff3de service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] No waiting events found dispatching network-vif-plugged-c6a0280f-def7-4677-910c-7a3a3c6b57df {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:15:35 user nova-compute[74189]: WARNING nova.compute.manager [req-6a2fed37-fcab-4ea6-a9e9-906159d9a8c5 req-35de9e94-acd2-4841-9092-d271ab5ff3de service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Received unexpected event network-vif-plugged-c6a0280f-def7-4677-910c-7a3a3c6b57df for instance with vm_state active and task_state None.
Oct 25 21:15:35 user nova-compute[74189]: DEBUG nova.network.neutron [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4c57363-0107-4567-9842-44a0522f8326/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Cannot resize image /opt/stack/data/nova/instances/c4c57363-0107-4567-9842-44a0522f8326/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Ensure instance console log exists: /opt/stack/data/nova/instances/c4c57363-0107-4567-9842-44a0522f8326/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Acquiring lock "ea8d22c5-3868-43d1-b101-c6cff480dea6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lock "ea8d22c5-3868-43d1-b101-c6cff480dea6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.compute.manager [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:15:36 user nova-compute[74189]: INFO nova.compute.claims [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Claim successful on node user
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.network.neutron [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Updating instance_info_cache with network_info: [{"id": "032dd7a9-5ab8-4e42-883a-3ce412b9ee1d", "address": "fa:16:3e:06:5b:93", "network": {"id": "fc681f29-44fb-4260-abab-c3cf730ae62f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-404557441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9669b7ed3a8846fb8e90800fe65a271d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap032dd7a9-5a", "ovs_interfaceid": "032dd7a9-5ab8-4e42-883a-3ce412b9ee1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Releasing lock "refresh_cache-c4c57363-0107-4567-9842-44a0522f8326" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.compute.manager [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Instance network_info: |[{"id": "032dd7a9-5ab8-4e42-883a-3ce412b9ee1d", "address": "fa:16:3e:06:5b:93", "network": {"id": "fc681f29-44fb-4260-abab-c3cf730ae62f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-404557441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9669b7ed3a8846fb8e90800fe65a271d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap032dd7a9-5a", "ovs_interfaceid": "032dd7a9-5ab8-4e42-883a-3ce412b9ee1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Start _get_guest_xml network_info=[{"id": "032dd7a9-5ab8-4e42-883a-3ce412b9ee1d", "address": "fa:16:3e:06:5b:93", "network": {"id": "fc681f29-44fb-4260-abab-c3cf730ae62f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-404557441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9669b7ed3a8846fb8e90800fe65a271d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap032dd7a9-5a", "ovs_interfaceid": "032dd7a9-5ab8-4e42-883a-3ce412b9ee1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:15:24Z,direct_url=<?>,disk_format='qcow2',id=e871b7fb-9cf2-4a9a-b6a0-c207d71e6165,min_disk=0,min_ram=0,name='',owner='7864e0fe8a4f4d4390d28dd9f6f8dc87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:15:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'device_name': '/dev/sda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'scsi', 'boot_index': 0, 'encryption_options': None, 'image_id': 'e871b7fb-9cf2-4a9a-b6a0-c207d71e6165'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:15:36 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:15:36 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:15:24Z,direct_url=<?>,disk_format='qcow2',id=e871b7fb-9cf2-4a9a-b6a0-c207d71e6165,min_disk=0,min_ram=0,name='',owner='7864e0fe8a4f4d4390d28dd9f6f8dc87',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:15:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:15:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-744723852',display_name='tempest-AttachSCSIVolumeTestJSON-server-744723852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-744723852',id=5,image_ref='e871b7fb-9cf2-4a9a-b6a0-c207d71e6165',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeaMxDdhks0ED/wk48raKzDK/GDMU91AjruHiPN6NzfVkrqeyudIJHeoVHnBu3lKbVmS3zDsfNC+rKhkPr/Cly3df4/PJPioaygqlr4LjcOUo/Ugz6PyY0OVB8PJ/4/pw==',key_name='tempest-keypair-109554160',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9669b7ed3a8846fb8e90800fe65a271d',ramdisk_id='',reservation_id='r-fmr8zu4v',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e871b7fb-9cf2-4a9a-b6a0-c207d71e6165',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-706086211',owner_user_name='tempest-AttachSCSIVolumeTestJSON-706086211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:15:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7da73c191b3342b9b5f3834e0d111fb2',uuid=c4c57363-0107-4567-9842-44a0522f8326,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "032dd7a9-5ab8-4e42-883a-3ce412b9ee1d", "address": "fa:16:3e:06:5b:93", "network": {"id": "fc681f29-44fb-4260-abab-c3cf730ae62f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-404557441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9669b7ed3a8846fb8e90800fe65a271d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap032dd7a9-5a", "ovs_interfaceid": "032dd7a9-5ab8-4e42-883a-3ce412b9ee1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Converting VIF {"id": "032dd7a9-5ab8-4e42-883a-3ce412b9ee1d", "address": "fa:16:3e:06:5b:93", "network": {"id": "fc681f29-44fb-4260-abab-c3cf730ae62f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-404557441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9669b7ed3a8846fb8e90800fe65a271d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap032dd7a9-5a", "ovs_interfaceid": "032dd7a9-5ab8-4e42-883a-3ce412b9ee1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:5b:93,bridge_name='br-int',has_traffic_filtering=True,id=032dd7a9-5ab8-4e42-883a-3ce412b9ee1d,network=Network(fc681f29-44fb-4260-abab-c3cf730ae62f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap032dd7a9-5a') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.objects.instance [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lazy-loading 'pci_devices' on Instance uuid c4c57363-0107-4567-9842-44a0522f8326 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:15:36 user nova-compute[74189]:   <uuid>c4c57363-0107-4567-9842-44a0522f8326</uuid>
Oct 25 21:15:36 user nova-compute[74189]:   <name>instance-00000005</name>
Oct 25 21:15:36 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:15:36 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:15:36 user nova-compute[74189]:   <metadata>
Oct 25 21:15:36 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:15:36 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:15:36 user nova-compute[74189]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-744723852</nova:name>
Oct 25 21:15:36 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:15:36</nova:creationTime>
Oct 25 21:15:36 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:15:36 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:15:36 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:15:36 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:15:36 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:15:36 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:15:36 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:15:36 user nova-compute[74189]:       <nova:owner>
Oct 25 21:15:36 user nova-compute[74189]:         <nova:user uuid="7da73c191b3342b9b5f3834e0d111fb2">tempest-AttachSCSIVolumeTestJSON-706086211-project-member</nova:user>
Oct 25 21:15:36 user nova-compute[74189]:         <nova:project uuid="9669b7ed3a8846fb8e90800fe65a271d">tempest-AttachSCSIVolumeTestJSON-706086211</nova:project>
Oct 25 21:15:36 user nova-compute[74189]:       </nova:owner>
Oct 25 21:15:36 user nova-compute[74189]:       <nova:root type="image" uuid="e871b7fb-9cf2-4a9a-b6a0-c207d71e6165"/>
Oct 25 21:15:36 user nova-compute[74189]:       <nova:ports>
Oct 25 21:15:36 user nova-compute[74189]:         <nova:port uuid="032dd7a9-5ab8-4e42-883a-3ce412b9ee1d">
Oct 25 21:15:36 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 25 21:15:36 user nova-compute[74189]:         </nova:port>
Oct 25 21:15:36 user nova-compute[74189]:       </nova:ports>
Oct 25 21:15:36 user nova-compute[74189]:     </nova:instance>
Oct 25 21:15:36 user nova-compute[74189]:   </metadata>
Oct 25 21:15:36 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:15:36 user nova-compute[74189]:     <system>
Oct 25 21:15:36 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:15:36 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:15:36 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:15:36 user nova-compute[74189]:       <entry name="serial">c4c57363-0107-4567-9842-44a0522f8326</entry>
Oct 25 21:15:36 user nova-compute[74189]:       <entry name="uuid">c4c57363-0107-4567-9842-44a0522f8326</entry>
Oct 25 21:15:36 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:15:36 user nova-compute[74189]:     </system>
Oct 25 21:15:36 user nova-compute[74189]:   </sysinfo>
Oct 25 21:15:36 user nova-compute[74189]:   <os>
Oct 25 21:15:36 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:15:36 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:15:36 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:15:36 user nova-compute[74189]:   </os>
Oct 25 21:15:36 user nova-compute[74189]:   <features>
Oct 25 21:15:36 user nova-compute[74189]:     <acpi/>
Oct 25 21:15:36 user nova-compute[74189]:     <apic/>
Oct 25 21:15:36 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:15:36 user nova-compute[74189]:   </features>
Oct 25 21:15:36 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:15:36 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:15:36 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:15:36 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:15:36 user nova-compute[74189]:   </clock>
Oct 25 21:15:36 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:15:36 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:15:36 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:15:36 user nova-compute[74189]:   </cpu>
Oct 25 21:15:36 user nova-compute[74189]:   <devices>
Oct 25 21:15:36 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:15:36 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:15:36 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/c4c57363-0107-4567-9842-44a0522f8326/disk"/>
Oct 25 21:15:36 user nova-compute[74189]:       <target dev="sda" bus="scsi"/>
Oct 25 21:15:36 user nova-compute[74189]:       <address type="drive" controller="0" unit="0"/>
Oct 25 21:15:36 user nova-compute[74189]:     </disk>
Oct 25 21:15:36 user nova-compute[74189]:     <disk type="file" device="cdrom">
Oct 25 21:15:36 user nova-compute[74189]:       <driver name="qemu" type="raw" cache="none"/>
Oct 25 21:15:36 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/c4c57363-0107-4567-9842-44a0522f8326/disk.config"/>
Oct 25 21:15:36 user nova-compute[74189]:       <target dev="sdb" bus="scsi"/>
Oct 25 21:15:36 user nova-compute[74189]:       <address type="drive" controller="0" unit="1"/>
Oct 25 21:15:36 user nova-compute[74189]:     </disk>
Oct 25 21:15:36 user nova-compute[74189]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 25 21:15:36 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:15:36 user nova-compute[74189]:       <mac address="fa:16:3e:06:5b:93"/>
Oct 25 21:15:36 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:15:36 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:15:36 user nova-compute[74189]:       <target dev="tap032dd7a9-5a"/>
Oct 25 21:15:36 user nova-compute[74189]:     </interface>
Oct 25 21:15:36 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:15:36 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/c4c57363-0107-4567-9842-44a0522f8326/console.log" append="off"/>
Oct 25 21:15:36 user nova-compute[74189]:     </serial>
Oct 25 21:15:36 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:15:36 user nova-compute[74189]:     <video>
Oct 25 21:15:36 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:15:36 user nova-compute[74189]:     </video>
Oct 25 21:15:36 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:15:36 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:15:36 user nova-compute[74189]:     </rng>
Oct 25 21:15:36 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:15:36 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:15:36 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:15:36 user nova-compute[74189]:     </memballoon>
Oct 25 21:15:36 user nova-compute[74189]:   </devices>
Oct 25 21:15:36 user nova-compute[74189]: </domain>
Oct 25 21:15:36 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:15:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-744723852',display_name='tempest-AttachSCSIVolumeTestJSON-server-744723852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-744723852',id=5,image_ref='e871b7fb-9cf2-4a9a-b6a0-c207d71e6165',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeaMxDdhks0ED/wk48raKzDK/GDMU91AjruHiPN6NzfVkrqeyudIJHeoVHnBu3lKbVmS3zDsfNC+rKhkPr/Cly3df4/PJPioaygqlr4LjcOUo/Ugz6PyY0OVB8PJ/4/pw==',key_name='tempest-keypair-109554160',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9669b7ed3a8846fb8e90800fe65a271d',ramdisk_id='',reservation_id='r-fmr8zu4v',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e871b7fb-9cf2-4a9a-b6a0-c207d71e6165',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-706086211',owner_user_name='tempest-AttachSCSIVolumeTestJSON-706086211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:15:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7da73c191b3342b9b5f3834e0d111fb2',uuid=c4c57363-0107-4567-9842-44a0522f8326,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "032dd7a9-5ab8-4e42-883a-3ce412b9ee1d", "address": "fa:16:3e:06:5b:93", "network": {"id": "fc681f29-44fb-4260-abab-c3cf730ae62f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-404557441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9669b7ed3a8846fb8e90800fe65a271d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap032dd7a9-5a", "ovs_interfaceid": "032dd7a9-5ab8-4e42-883a-3ce412b9ee1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Converting VIF {"id": "032dd7a9-5ab8-4e42-883a-3ce412b9ee1d", "address": "fa:16:3e:06:5b:93", "network": {"id": "fc681f29-44fb-4260-abab-c3cf730ae62f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-404557441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9669b7ed3a8846fb8e90800fe65a271d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap032dd7a9-5a", "ovs_interfaceid": "032dd7a9-5ab8-4e42-883a-3ce412b9ee1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:5b:93,bridge_name='br-int',has_traffic_filtering=True,id=032dd7a9-5ab8-4e42-883a-3ce412b9ee1d,network=Network(fc681f29-44fb-4260-abab-c3cf730ae62f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap032dd7a9-5a') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG os_vif [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:5b:93,bridge_name='br-int',has_traffic_filtering=True,id=032dd7a9-5ab8-4e42-883a-3ce412b9ee1d,network=Network(fc681f29-44fb-4260-abab-c3cf730ae62f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap032dd7a9-5a') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2bd06196-3808-5aee-a5a3-c2b88b4ecd8f', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap032dd7a9-5a, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap032dd7a9-5a, col_values=(('qos', UUID('9abe90e0-e7cc-46a1-a5ef-9525e249aa31')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap032dd7a9-5a, col_values=(('external_ids', {'iface-id': '032dd7a9-5ab8-4e42-883a-3ce412b9ee1d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:5b:93', 'vm-uuid': 'c4c57363-0107-4567-9842-44a0522f8326'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:36 user nova-compute[74189]: INFO os_vif [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:5b:93,bridge_name='br-int',has_traffic_filtering=True,id=032dd7a9-5ab8-4e42-883a-3ce412b9ee1d,network=Network(fc681f29-44fb-4260-abab-c3cf730ae62f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap032dd7a9-5a')
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] No BDM found with device name sda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] No VIF found with MAC fa:16:3e:06:5b:93, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:15:36 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Using config drive
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.compute.manager [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.compute.manager [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.network.neutron [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:15:36 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Creating config drive at /opt/stack/data/nova/instances/c4c57363-0107-4567-9842-44a0522f8326/disk.config
Oct 25 21:15:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c4c57363-0107-4567-9842-44a0522f8326/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppot4bicy {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:36 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:15:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c4c57363-0107-4567-9842-44a0522f8326/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppot4bicy" returned: 0 in 0.061s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:36 user nova-compute[74189]: DEBUG nova.compute.manager [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:15:37 user nova-compute[74189]: DEBUG nova.compute.manager [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:15:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:15:37 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Creating image(s)
Oct 25 21:15:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lock "/opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lock "/opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:37 user nova-compute[74189]: DEBUG nova.policy [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a147e32cb7fd45aaa1398a1332e6956a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6d05f10a0647e9a014e78f2a7dab78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:15:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.169s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.194s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk 1073741824" returned: 0 in 0.056s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.208s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:37 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:15:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:37 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Cannot resize image /opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:15:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:15:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Ensure instance console log exists: /opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:15:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:37 user nova-compute[74189]: DEBUG nova.compute.manager [req-5c445dab-2c76-403a-9b53-eb5b3cfca4e2 req-25358c6c-e4ca-4617-ac49-80f27c916819 service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Received event network-vif-plugged-c6a0280f-def7-4677-910c-7a3a3c6b57df {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:15:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-5c445dab-2c76-403a-9b53-eb5b3cfca4e2 req-25358c6c-e4ca-4617-ac49-80f27c916819 service nova] Acquiring lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-5c445dab-2c76-403a-9b53-eb5b3cfca4e2 req-25358c6c-e4ca-4617-ac49-80f27c916819 service nova] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-5c445dab-2c76-403a-9b53-eb5b3cfca4e2 req-25358c6c-e4ca-4617-ac49-80f27c916819 service nova] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:37 user nova-compute[74189]: DEBUG nova.compute.manager [req-5c445dab-2c76-403a-9b53-eb5b3cfca4e2 req-25358c6c-e4ca-4617-ac49-80f27c916819 service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] No waiting events found dispatching network-vif-plugged-c6a0280f-def7-4677-910c-7a3a3c6b57df {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:15:37 user nova-compute[74189]: WARNING nova.compute.manager [req-5c445dab-2c76-403a-9b53-eb5b3cfca4e2 req-25358c6c-e4ca-4617-ac49-80f27c916819 service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Received unexpected event network-vif-plugged-c6a0280f-def7-4677-910c-7a3a3c6b57df for instance with vm_state active and task_state None.
Oct 25 21:15:38 user nova-compute[74189]: DEBUG nova.network.neutron [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Successfully created port: a151161f-1633-405f-ac74-9f379531d89a {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:15:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG nova.network.neutron [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Successfully updated port: a151161f-1633-405f-ac74-9f379531d89a {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Acquiring lock "refresh_cache-ea8d22c5-3868-43d1-b101-c6cff480dea6" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Acquired lock "refresh_cache-ea8d22c5-3868-43d1-b101-c6cff480dea6" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG nova.network.neutron [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG nova.network.neutron [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG nova.compute.manager [req-3017747b-9700-45a4-9a4a-170e1dd64461 req-f18b9284-84d6-4862-bdfc-bc0517e021a3 service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Received event network-changed-a151161f-1633-405f-ac74-9f379531d89a {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG nova.compute.manager [req-3017747b-9700-45a4-9a4a-170e1dd64461 req-f18b9284-84d6-4862-bdfc-bc0517e021a3 service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Refreshing instance network info cache due to event network-changed-a151161f-1633-405f-ac74-9f379531d89a. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3017747b-9700-45a4-9a4a-170e1dd64461 req-f18b9284-84d6-4862-bdfc-bc0517e021a3 service nova] Acquiring lock "refresh_cache-ea8d22c5-3868-43d1-b101-c6cff480dea6" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG nova.network.neutron [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Updating instance_info_cache with network_info: [{"id": "a151161f-1633-405f-ac74-9f379531d89a", "address": "fa:16:3e:63:71:94", "network": {"id": "62a86fdc-b28d-442a-9d62-0c3286ad0abb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1182690237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6d05f10a0647e9a014e78f2a7dab78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa151161f-16", "ovs_interfaceid": "a151161f-1633-405f-ac74-9f379531d89a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Acquiring lock "f52fc510-3640-468a-8a9c-b716b9d17a01" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Lock "f52fc510-3640-468a-8a9c-b716b9d17a01" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Releasing lock "refresh_cache-ea8d22c5-3868-43d1-b101-c6cff480dea6" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG nova.compute.manager [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Instance network_info: |[{"id": "a151161f-1633-405f-ac74-9f379531d89a", "address": "fa:16:3e:63:71:94", "network": {"id": "62a86fdc-b28d-442a-9d62-0c3286ad0abb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1182690237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6d05f10a0647e9a014e78f2a7dab78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa151161f-16", "ovs_interfaceid": "a151161f-1633-405f-ac74-9f379531d89a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3017747b-9700-45a4-9a4a-170e1dd64461 req-f18b9284-84d6-4862-bdfc-bc0517e021a3 service nova] Acquired lock "refresh_cache-ea8d22c5-3868-43d1-b101-c6cff480dea6" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG nova.network.neutron [req-3017747b-9700-45a4-9a4a-170e1dd64461 req-f18b9284-84d6-4862-bdfc-bc0517e021a3 service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Refreshing network info cache for port a151161f-1633-405f-ac74-9f379531d89a {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Start _get_guest_xml network_info=[{"id": "a151161f-1633-405f-ac74-9f379531d89a", "address": "fa:16:3e:63:71:94", "network": {"id": "62a86fdc-b28d-442a-9d62-0c3286ad0abb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1182690237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6d05f10a0647e9a014e78f2a7dab78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa151161f-16", "ovs_interfaceid": "a151161f-1633-405f-ac74-9f379531d89a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG nova.compute.manager [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:15:39 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:15:39 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:15:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-781387297',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-781387297',id=6,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHJgDbw7K7bwNJyj3WQeM4O7X1T/XxzeuPN+AM4eJ62yayGmYQQS1OGbI1fYrJusZqdcuogdpmdUBe6qoNmEvj36GKw2Ywp/JElU+pyp8QCNHY9uIrm3I9Zf5tuFbEg3Q==',key_name='tempest-keypair-159731972',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d6d05f10a0647e9a014e78f2a7dab78',ramdisk_id='',reservation_id='r-oi1337uc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1187636517',owner_user_name='tempest-TaggedAttachmentsTest-1187636517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:15:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a147e32cb7fd45aaa1398a1332e6956a',uuid=ea8d22c5-3868-43d1-b101-c6cff480dea6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a151161f-1633-405f-ac74-9f379531d89a", "address": "fa:16:3e:63:71:94", "network": {"id": "62a86fdc-b28d-442a-9d62-0c3286ad0abb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1182690237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6d05f10a0647e9a014e78f2a7dab78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa151161f-16", "ovs_interfaceid": "a151161f-1633-405f-ac74-9f379531d89a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Converting VIF {"id": "a151161f-1633-405f-ac74-9f379531d89a", "address": "fa:16:3e:63:71:94", "network": {"id": "62a86fdc-b28d-442a-9d62-0c3286ad0abb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1182690237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6d05f10a0647e9a014e78f2a7dab78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa151161f-16", "ovs_interfaceid": "a151161f-1633-405f-ac74-9f379531d89a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:71:94,bridge_name='br-int',has_traffic_filtering=True,id=a151161f-1633-405f-ac74-9f379531d89a,network=Network(62a86fdc-b28d-442a-9d62-0c3286ad0abb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa151161f-16') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG nova.objects.instance [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lazy-loading 'pci_devices' on Instance uuid ea8d22c5-3868-43d1-b101-c6cff480dea6 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:15:39 user nova-compute[74189]:   <uuid>ea8d22c5-3868-43d1-b101-c6cff480dea6</uuid>
Oct 25 21:15:39 user nova-compute[74189]:   <name>instance-00000006</name>
Oct 25 21:15:39 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:15:39 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:15:39 user nova-compute[74189]:   <metadata>
Oct 25 21:15:39 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:15:39 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:15:39 user nova-compute[74189]:       <nova:name>tempest-device-tagging-server-781387297</nova:name>
Oct 25 21:15:39 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:15:39</nova:creationTime>
Oct 25 21:15:39 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:15:39 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:15:39 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:15:39 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:15:39 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:15:39 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:15:39 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:15:39 user nova-compute[74189]:       <nova:owner>
Oct 25 21:15:39 user nova-compute[74189]:         <nova:user uuid="a147e32cb7fd45aaa1398a1332e6956a">tempest-TaggedAttachmentsTest-1187636517-project-member</nova:user>
Oct 25 21:15:39 user nova-compute[74189]:         <nova:project uuid="7d6d05f10a0647e9a014e78f2a7dab78">tempest-TaggedAttachmentsTest-1187636517</nova:project>
Oct 25 21:15:39 user nova-compute[74189]:       </nova:owner>
Oct 25 21:15:39 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:15:39 user nova-compute[74189]:       <nova:ports>
Oct 25 21:15:39 user nova-compute[74189]:         <nova:port uuid="a151161f-1633-405f-ac74-9f379531d89a">
Oct 25 21:15:39 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 25 21:15:39 user nova-compute[74189]:         </nova:port>
Oct 25 21:15:39 user nova-compute[74189]:       </nova:ports>
Oct 25 21:15:39 user nova-compute[74189]:     </nova:instance>
Oct 25 21:15:39 user nova-compute[74189]:   </metadata>
Oct 25 21:15:39 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:15:39 user nova-compute[74189]:     <system>
Oct 25 21:15:39 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:15:39 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:15:39 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:15:39 user nova-compute[74189]:       <entry name="serial">ea8d22c5-3868-43d1-b101-c6cff480dea6</entry>
Oct 25 21:15:39 user nova-compute[74189]:       <entry name="uuid">ea8d22c5-3868-43d1-b101-c6cff480dea6</entry>
Oct 25 21:15:39 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:15:39 user nova-compute[74189]:     </system>
Oct 25 21:15:39 user nova-compute[74189]:   </sysinfo>
Oct 25 21:15:39 user nova-compute[74189]:   <os>
Oct 25 21:15:39 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:15:39 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:15:39 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:15:39 user nova-compute[74189]:   </os>
Oct 25 21:15:39 user nova-compute[74189]:   <features>
Oct 25 21:15:39 user nova-compute[74189]:     <acpi/>
Oct 25 21:15:39 user nova-compute[74189]:     <apic/>
Oct 25 21:15:39 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:15:39 user nova-compute[74189]:   </features>
Oct 25 21:15:39 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:15:39 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:15:39 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:15:39 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:15:39 user nova-compute[74189]:   </clock>
Oct 25 21:15:39 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:15:39 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:15:39 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:15:39 user nova-compute[74189]:   </cpu>
Oct 25 21:15:39 user nova-compute[74189]:   <devices>
Oct 25 21:15:39 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:15:39 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:15:39 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk"/>
Oct 25 21:15:39 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:15:39 user nova-compute[74189]:     </disk>
Oct 25 21:15:39 user nova-compute[74189]:     <disk type="file" device="cdrom">
Oct 25 21:15:39 user nova-compute[74189]:       <driver name="qemu" type="raw" cache="none"/>
Oct 25 21:15:39 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk.config"/>
Oct 25 21:15:39 user nova-compute[74189]:       <target dev="hda" bus="ide"/>
Oct 25 21:15:39 user nova-compute[74189]:     </disk>
Oct 25 21:15:39 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:15:39 user nova-compute[74189]:       <mac address="fa:16:3e:63:71:94"/>
Oct 25 21:15:39 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:15:39 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:15:39 user nova-compute[74189]:       <target dev="tapa151161f-16"/>
Oct 25 21:15:39 user nova-compute[74189]:     </interface>
Oct 25 21:15:39 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:15:39 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/console.log" append="off"/>
Oct 25 21:15:39 user nova-compute[74189]:     </serial>
Oct 25 21:15:39 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:15:39 user nova-compute[74189]:     <video>
Oct 25 21:15:39 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:15:39 user nova-compute[74189]:     </video>
Oct 25 21:15:39 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:15:39 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:15:39 user nova-compute[74189]:     </rng>
Oct 25 21:15:39 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:15:39 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:15:39 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:15:39 user nova-compute[74189]:     </memballoon>
Oct 25 21:15:39 user nova-compute[74189]:   </devices>
Oct 25 21:15:39 user nova-compute[74189]: </domain>
Oct 25 21:15:39 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-781387297',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-781387297',id=6,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHJgDbw7K7bwNJyj3WQeM4O7X1T/XxzeuPN+AM4eJ62yayGmYQQS1OGbI1fYrJusZqdcuogdpmdUBe6qoNmEvj36GKw2Ywp/JElU+pyp8QCNHY9uIrm3I9Zf5tuFbEg3Q==',key_name='tempest-keypair-159731972',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d6d05f10a0647e9a014e78f2a7dab78',ramdisk_id='',reservation_id='r-oi1337uc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1187636517',owner_user_name='tempest-TaggedAttachmentsTest-1187636517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:15:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a147e32cb7fd45aaa1398a1332e6956a',uuid=ea8d22c5-3868-43d1-b101-c6cff480dea6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a151161f-1633-405f-ac74-9f379531d89a", "address": "fa:16:3e:63:71:94", "network": {"id": "62a86fdc-b28d-442a-9d62-0c3286ad0abb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1182690237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6d05f10a0647e9a014e78f2a7dab78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa151161f-16", "ovs_interfaceid": "a151161f-1633-405f-ac74-9f379531d89a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Converting VIF {"id": "a151161f-1633-405f-ac74-9f379531d89a", "address": "fa:16:3e:63:71:94", "network": {"id": "62a86fdc-b28d-442a-9d62-0c3286ad0abb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1182690237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6d05f10a0647e9a014e78f2a7dab78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa151161f-16", "ovs_interfaceid": "a151161f-1633-405f-ac74-9f379531d89a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:71:94,bridge_name='br-int',has_traffic_filtering=True,id=a151161f-1633-405f-ac74-9f379531d89a,network=Network(62a86fdc-b28d-442a-9d62-0c3286ad0abb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa151161f-16') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG os_vif [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:71:94,bridge_name='br-int',has_traffic_filtering=True,id=a151161f-1633-405f-ac74-9f379531d89a,network=Network(62a86fdc-b28d-442a-9d62-0c3286ad0abb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa151161f-16') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a29b361d-b8d8-53ae-855d-8b28ad112a37', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:15:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa151161f-16, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa151161f-16, col_values=(('qos', UUID('d368cd3a-403e-41d4-982b-920332245cdd')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa151161f-16, col_values=(('external_ids', {'iface-id': 'a151161f-1633-405f-ac74-9f379531d89a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:71:94', 'vm-uuid': 'ea8d22c5-3868-43d1-b101-c6cff480dea6'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:15:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:40 user nova-compute[74189]: INFO os_vif [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:71:94,bridge_name='br-int',has_traffic_filtering=True,id=a151161f-1633-405f-ac74-9f379531d89a,network=Network(62a86fdc-b28d-442a-9d62-0c3286ad0abb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa151161f-16')
Oct 25 21:15:40 user nova-compute[74189]: DEBUG nova.compute.manager [req-2ac6ecd7-d2d7-4712-99bf-0db67dfbcf4b req-522915b3-8e6a-42e3-8f39-f208d1352406 service nova] [instance: c4c57363-0107-4567-9842-44a0522f8326] Received event network-vif-plugged-032dd7a9-5ab8-4e42-883a-3ce412b9ee1d {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:15:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2ac6ecd7-d2d7-4712-99bf-0db67dfbcf4b req-522915b3-8e6a-42e3-8f39-f208d1352406 service nova] Acquiring lock "c4c57363-0107-4567-9842-44a0522f8326-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2ac6ecd7-d2d7-4712-99bf-0db67dfbcf4b req-522915b3-8e6a-42e3-8f39-f208d1352406 service nova] Lock "c4c57363-0107-4567-9842-44a0522f8326-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2ac6ecd7-d2d7-4712-99bf-0db67dfbcf4b req-522915b3-8e6a-42e3-8f39-f208d1352406 service nova] Lock "c4c57363-0107-4567-9842-44a0522f8326-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:40 user nova-compute[74189]: DEBUG nova.compute.manager [req-2ac6ecd7-d2d7-4712-99bf-0db67dfbcf4b req-522915b3-8e6a-42e3-8f39-f208d1352406 service nova] [instance: c4c57363-0107-4567-9842-44a0522f8326] No waiting events found dispatching network-vif-plugged-032dd7a9-5ab8-4e42-883a-3ce412b9ee1d {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:15:40 user nova-compute[74189]: WARNING nova.compute.manager [req-2ac6ecd7-d2d7-4712-99bf-0db67dfbcf4b req-522915b3-8e6a-42e3-8f39-f208d1352406 service nova] [instance: c4c57363-0107-4567-9842-44a0522f8326] Received unexpected event network-vif-plugged-032dd7a9-5ab8-4e42-883a-3ce412b9ee1d for instance with vm_state building and task_state spawning.
Oct 25 21:15:40 user nova-compute[74189]: DEBUG nova.compute.manager [req-2ac6ecd7-d2d7-4712-99bf-0db67dfbcf4b req-522915b3-8e6a-42e3-8f39-f208d1352406 service nova] [instance: c4c57363-0107-4567-9842-44a0522f8326] Received event network-vif-plugged-032dd7a9-5ab8-4e42-883a-3ce412b9ee1d {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:15:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2ac6ecd7-d2d7-4712-99bf-0db67dfbcf4b req-522915b3-8e6a-42e3-8f39-f208d1352406 service nova] Acquiring lock "c4c57363-0107-4567-9842-44a0522f8326-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2ac6ecd7-d2d7-4712-99bf-0db67dfbcf4b req-522915b3-8e6a-42e3-8f39-f208d1352406 service nova] Lock "c4c57363-0107-4567-9842-44a0522f8326-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2ac6ecd7-d2d7-4712-99bf-0db67dfbcf4b req-522915b3-8e6a-42e3-8f39-f208d1352406 service nova] Lock "c4c57363-0107-4567-9842-44a0522f8326-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:40 user nova-compute[74189]: DEBUG nova.compute.manager [req-2ac6ecd7-d2d7-4712-99bf-0db67dfbcf4b req-522915b3-8e6a-42e3-8f39-f208d1352406 service nova] [instance: c4c57363-0107-4567-9842-44a0522f8326] No waiting events found dispatching network-vif-plugged-032dd7a9-5ab8-4e42-883a-3ce412b9ee1d {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:15:40 user nova-compute[74189]: WARNING nova.compute.manager [req-2ac6ecd7-d2d7-4712-99bf-0db67dfbcf4b req-522915b3-8e6a-42e3-8f39-f208d1352406 service nova] [instance: c4c57363-0107-4567-9842-44a0522f8326] Received unexpected event network-vif-plugged-032dd7a9-5ab8-4e42-883a-3ce412b9ee1d for instance with vm_state building and task_state spawning.
Oct 25 21:15:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:40 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:15:40 user nova-compute[74189]: INFO nova.compute.claims [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Claim successful on node user
Oct 25 21:15:40 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:15:40 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] No BDM found with device name hda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:15:40 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] No VIF found with MAC fa:16:3e:63:71:94, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:15:40 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Using config drive
Oct 25 21:15:40 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Creating config drive at /opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk.config
Oct 25 21:15:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpji8l1dt5 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpji8l1dt5" returned: 0 in 0.090s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:40 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:15:40 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:15:40 user nova-compute[74189]: DEBUG nova.network.neutron [req-3017747b-9700-45a4-9a4a-170e1dd64461 req-f18b9284-84d6-4862-bdfc-bc0517e021a3 service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Updated VIF entry in instance network info cache for port a151161f-1633-405f-ac74-9f379531d89a. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:15:40 user nova-compute[74189]: DEBUG nova.network.neutron [req-3017747b-9700-45a4-9a4a-170e1dd64461 req-f18b9284-84d6-4862-bdfc-bc0517e021a3 service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Updating instance_info_cache with network_info: [{"id": "a151161f-1633-405f-ac74-9f379531d89a", "address": "fa:16:3e:63:71:94", "network": {"id": "62a86fdc-b28d-442a-9d62-0c3286ad0abb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1182690237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6d05f10a0647e9a014e78f2a7dab78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa151161f-16", "ovs_interfaceid": "a151161f-1633-405f-ac74-9f379531d89a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:15:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3017747b-9700-45a4-9a4a-170e1dd64461 req-f18b9284-84d6-4862-bdfc-bc0517e021a3 service nova] Releasing lock "refresh_cache-ea8d22c5-3868-43d1-b101-c6cff480dea6" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:15:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.645s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:40 user nova-compute[74189]: DEBUG nova.compute.manager [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:15:40 user nova-compute[74189]: DEBUG nova.compute.manager [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:15:40 user nova-compute[74189]: DEBUG nova.network.neutron [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:15:40 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:15:40 user nova-compute[74189]: DEBUG nova.compute.manager [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:15:40 user nova-compute[74189]: DEBUG nova.policy [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '09d355b05b7b4e669602aa766ff8f7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3ea66cfd844c37bcc97a430f2eee69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:15:41 user nova-compute[74189]: DEBUG nova.compute.manager [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:15:41 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:15:41 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Creating image(s)
Oct 25 21:15:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Acquiring lock "/opt/stack/data/nova/instances/f52fc510-3640-468a-8a9c-b716b9d17a01/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Lock "/opt/stack/data/nova/instances/f52fc510-3640-468a-8a9c-b716b9d17a01/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Lock "/opt/stack/data/nova/instances/f52fc510-3640-468a-8a9c-b716b9d17a01/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:41 user nova-compute[74189]: DEBUG nova.compute.manager [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:15:41 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:15:41 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: c4c57363-0107-4567-9842-44a0522f8326] Instance spawned successfully.
Oct 25 21:15:41 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:15:41 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:41 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:41 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:41 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:41 user nova-compute[74189]: INFO nova.compute.manager [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Took 7.97 seconds to spawn the instance on the hypervisor.
Oct 25 21:15:41 user nova-compute[74189]: DEBUG nova.compute.manager [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:15:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.257s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.007s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:41 user nova-compute[74189]: INFO nova.compute.manager [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Took 9.09 seconds to build instance.
Oct 25 21:15:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.197s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/f52fc510-3640-468a-8a9c-b716b9d17a01/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2e147437-84c8-4d22-8180-79bb745cbd97 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lock "c4c57363-0107-4567-9842-44a0522f8326" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.262s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/f52fc510-3640-468a-8a9c-b716b9d17a01/disk 1073741824" returned: 0 in 0.070s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:41 user nova-compute[74189]: DEBUG nova.network.neutron [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Successfully created port: dd205313-c8a4-433d-8271-6abe9cf77ede {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:15:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.202s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:41 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f52fc510-3640-468a-8a9c-b716b9d17a01/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:15:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52fc510-3640-468a-8a9c-b716b9d17a01/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Acquiring lock "e1272f33-ef5e-48e6-912f-e0beae6dde11" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Lock "e1272f33-ef5e-48e6-912f-e0beae6dde11" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:41 user nova-compute[74189]: DEBUG nova.compute.manager [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:15:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:42 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:15:42 user nova-compute[74189]: INFO nova.compute.claims [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Claim successful on node user
Oct 25 21:15:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52fc510-3640-468a-8a9c-b716b9d17a01/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:42 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Cannot resize image /opt/stack/data/nova/instances/f52fc510-3640-468a-8a9c-b716b9d17a01/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:15:42 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:15:42 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Ensure instance console log exists: /opt/stack/data/nova/instances/f52fc510-3640-468a-8a9c-b716b9d17a01/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:15:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:42 user nova-compute[74189]: DEBUG nova.network.neutron [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Successfully updated port: dd205313-c8a4-433d-8271-6abe9cf77ede {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:15:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Acquiring lock "refresh_cache-f52fc510-3640-468a-8a9c-b716b9d17a01" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:15:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Acquired lock "refresh_cache-f52fc510-3640-468a-8a9c-b716b9d17a01" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:15:42 user nova-compute[74189]: DEBUG nova.network.neutron [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:15:42 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:15:42 user nova-compute[74189]: DEBUG nova.network.neutron [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:15:42 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:15:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.631s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:42 user nova-compute[74189]: DEBUG nova.compute.manager [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:15:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:42 user nova-compute[74189]: DEBUG nova.compute.manager [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:15:42 user nova-compute[74189]: DEBUG nova.network.neutron [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:15:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:42 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:15:42 user nova-compute[74189]: DEBUG nova.compute.manager [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:15:42 user nova-compute[74189]: DEBUG nova.compute.manager [req-123c3806-c4ae-4080-a03f-9dd72e1226d4 req-97f8ccac-b933-4f69-b9c4-83503cb6dbf6 service nova] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Received event network-changed-dd205313-c8a4-433d-8271-6abe9cf77ede {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:15:42 user nova-compute[74189]: DEBUG nova.compute.manager [req-123c3806-c4ae-4080-a03f-9dd72e1226d4 req-97f8ccac-b933-4f69-b9c4-83503cb6dbf6 service nova] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Refreshing instance network info cache due to event network-changed-dd205313-c8a4-433d-8271-6abe9cf77ede. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:15:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-123c3806-c4ae-4080-a03f-9dd72e1226d4 req-97f8ccac-b933-4f69-b9c4-83503cb6dbf6 service nova] Acquiring lock "refresh_cache-f52fc510-3640-468a-8a9c-b716b9d17a01" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:15:42 user nova-compute[74189]: DEBUG nova.policy [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6595fd7dc5c54e2d9e6ba26a38a03180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b22e5790c544d08ba63bf8f2eeb425b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG nova.compute.manager [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:15:43 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Creating image(s)
Oct 25 21:15:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1272f33-ef5e-48e6-912f-e0beae6dde11/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Lock "/opt/stack/data/nova/instances/e1272f33-ef5e-48e6-912f-e0beae6dde11/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Lock "/opt/stack/data/nova/instances/e1272f33-ef5e-48e6-912f-e0beae6dde11/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG nova.network.neutron [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Updating instance_info_cache with network_info: [{"id": "dd205313-c8a4-433d-8271-6abe9cf77ede", "address": "fa:16:3e:50:6e:57", "network": {"id": "10a55176-55d4-4629-890b-4de824ceda02", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1760980393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea3ea66cfd844c37bcc97a430f2eee69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd205313-c8", "ovs_interfaceid": "dd205313-c8a4-433d-8271-6abe9cf77ede", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Releasing lock "refresh_cache-f52fc510-3640-468a-8a9c-b716b9d17a01" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG nova.compute.manager [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Instance network_info: |[{"id": "dd205313-c8a4-433d-8271-6abe9cf77ede", "address": "fa:16:3e:50:6e:57", "network": {"id": "10a55176-55d4-4629-890b-4de824ceda02", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1760980393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea3ea66cfd844c37bcc97a430f2eee69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd205313-c8", "ovs_interfaceid": "dd205313-c8a4-433d-8271-6abe9cf77ede", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-123c3806-c4ae-4080-a03f-9dd72e1226d4 req-97f8ccac-b933-4f69-b9c4-83503cb6dbf6 service nova] Acquired lock "refresh_cache-f52fc510-3640-468a-8a9c-b716b9d17a01" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG nova.network.neutron [req-123c3806-c4ae-4080-a03f-9dd72e1226d4 req-97f8ccac-b933-4f69-b9c4-83503cb6dbf6 service nova] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Refreshing network info cache for port dd205313-c8a4-433d-8271-6abe9cf77ede {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Start _get_guest_xml network_info=[{"id": "dd205313-c8a4-433d-8271-6abe9cf77ede", "address": "fa:16:3e:50:6e:57", "network": {"id": "10a55176-55d4-4629-890b-4de824ceda02", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1760980393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea3ea66cfd844c37bcc97a430f2eee69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd205313-c8", "ovs_interfaceid": "dd205313-c8a4-433d-8271-6abe9cf77ede", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.188s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:43 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:15:43 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:15:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:15:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-515576057',display_name='tempest-TestVolumeSwap-server-515576057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-515576057',id=7,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADlB+TJ3G77Yn+fbANsqvygKinLXdlQlhX6bggrE6U3tpQR5Pkwny+l0DCwd/hW0KV0mr8acwyGoiJim0gNZTxQFCrigJ4O44ymmtim5N7f/NBIsJ6NafADKCrOstGvXA==',key_name='tempest-keypair-1168601867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea3ea66cfd844c37bcc97a430f2eee69',ramdisk_id='',reservation_id='r-husynio0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1625296795',owner_user_name='tempest-TestVolumeSwap-1625296795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:15:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09d355b05b7b4e669602aa766ff8f7fa',uuid=f52fc510-3640-468a-8a9c-b716b9d17a01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd205313-c8a4-433d-8271-6abe9cf77ede", "address": "fa:16:3e:50:6e:57", "network": {"id": "10a55176-55d4-4629-890b-4de824ceda02", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1760980393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea3ea66cfd844c37bcc97a430f2eee69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd205313-c8", "ovs_interfaceid": "dd205313-c8a4-433d-8271-6abe9cf77ede", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Converting VIF {"id": "dd205313-c8a4-433d-8271-6abe9cf77ede", "address": "fa:16:3e:50:6e:57", "network": {"id": "10a55176-55d4-4629-890b-4de824ceda02", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1760980393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea3ea66cfd844c37bcc97a430f2eee69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd205313-c8", "ovs_interfaceid": "dd205313-c8a4-433d-8271-6abe9cf77ede", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:6e:57,bridge_name='br-int',has_traffic_filtering=True,id=dd205313-c8a4-433d-8271-6abe9cf77ede,network=Network(10a55176-55d4-4629-890b-4de824ceda02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd205313-c8') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG nova.objects.instance [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Lazy-loading 'pci_devices' on Instance uuid f52fc510-3640-468a-8a9c-b716b9d17a01 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.192s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/e1272f33-ef5e-48e6-912f-e0beae6dde11/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:15:43 user nova-compute[74189]:   <uuid>f52fc510-3640-468a-8a9c-b716b9d17a01</uuid>
Oct 25 21:15:43 user nova-compute[74189]:   <name>instance-00000007</name>
Oct 25 21:15:43 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:15:43 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:15:43 user nova-compute[74189]:   <metadata>
Oct 25 21:15:43 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:15:43 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:15:43 user nova-compute[74189]:       <nova:name>tempest-TestVolumeSwap-server-515576057</nova:name>
Oct 25 21:15:43 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:15:43</nova:creationTime>
Oct 25 21:15:43 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:15:43 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:15:43 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:15:43 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:15:43 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:15:43 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:15:43 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:15:43 user nova-compute[74189]:       <nova:owner>
Oct 25 21:15:43 user nova-compute[74189]:         <nova:user uuid="09d355b05b7b4e669602aa766ff8f7fa">tempest-TestVolumeSwap-1625296795-project-member</nova:user>
Oct 25 21:15:43 user nova-compute[74189]:         <nova:project uuid="ea3ea66cfd844c37bcc97a430f2eee69">tempest-TestVolumeSwap-1625296795</nova:project>
Oct 25 21:15:43 user nova-compute[74189]:       </nova:owner>
Oct 25 21:15:43 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:15:43 user nova-compute[74189]:       <nova:ports>
Oct 25 21:15:43 user nova-compute[74189]:         <nova:port uuid="dd205313-c8a4-433d-8271-6abe9cf77ede">
Oct 25 21:15:43 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 25 21:15:43 user nova-compute[74189]:         </nova:port>
Oct 25 21:15:43 user nova-compute[74189]:       </nova:ports>
Oct 25 21:15:43 user nova-compute[74189]:     </nova:instance>
Oct 25 21:15:43 user nova-compute[74189]:   </metadata>
Oct 25 21:15:43 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:15:43 user nova-compute[74189]:     <system>
Oct 25 21:15:43 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:15:43 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:15:43 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:15:43 user nova-compute[74189]:       <entry name="serial">f52fc510-3640-468a-8a9c-b716b9d17a01</entry>
Oct 25 21:15:43 user nova-compute[74189]:       <entry name="uuid">f52fc510-3640-468a-8a9c-b716b9d17a01</entry>
Oct 25 21:15:43 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:15:43 user nova-compute[74189]:     </system>
Oct 25 21:15:43 user nova-compute[74189]:   </sysinfo>
Oct 25 21:15:43 user nova-compute[74189]:   <os>
Oct 25 21:15:43 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:15:43 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:15:43 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:15:43 user nova-compute[74189]:   </os>
Oct 25 21:15:43 user nova-compute[74189]:   <features>
Oct 25 21:15:43 user nova-compute[74189]:     <acpi/>
Oct 25 21:15:43 user nova-compute[74189]:     <apic/>
Oct 25 21:15:43 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:15:43 user nova-compute[74189]:   </features>
Oct 25 21:15:43 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:15:43 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:15:43 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:15:43 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:15:43 user nova-compute[74189]:   </clock>
Oct 25 21:15:43 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:15:43 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:15:43 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:15:43 user nova-compute[74189]:   </cpu>
Oct 25 21:15:43 user nova-compute[74189]:   <devices>
Oct 25 21:15:43 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:15:43 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:15:43 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/f52fc510-3640-468a-8a9c-b716b9d17a01/disk"/>
Oct 25 21:15:43 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:15:43 user nova-compute[74189]:     </disk>
Oct 25 21:15:43 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:15:43 user nova-compute[74189]:       <mac address="fa:16:3e:50:6e:57"/>
Oct 25 21:15:43 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:15:43 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:15:43 user nova-compute[74189]:       <target dev="tapdd205313-c8"/>
Oct 25 21:15:43 user nova-compute[74189]:     </interface>
Oct 25 21:15:43 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:15:43 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/f52fc510-3640-468a-8a9c-b716b9d17a01/console.log" append="off"/>
Oct 25 21:15:43 user nova-compute[74189]:     </serial>
Oct 25 21:15:43 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:15:43 user nova-compute[74189]:     <video>
Oct 25 21:15:43 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:15:43 user nova-compute[74189]:     </video>
Oct 25 21:15:43 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:15:43 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:15:43 user nova-compute[74189]:     </rng>
Oct 25 21:15:43 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:15:43 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:15:43 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:15:43 user nova-compute[74189]:     </memballoon>
Oct 25 21:15:43 user nova-compute[74189]:   </devices>
Oct 25 21:15:43 user nova-compute[74189]: </domain>
Oct 25 21:15:43 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:15:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-515576057',display_name='tempest-TestVolumeSwap-server-515576057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-515576057',id=7,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADlB+TJ3G77Yn+fbANsqvygKinLXdlQlhX6bggrE6U3tpQR5Pkwny+l0DCwd/hW0KV0mr8acwyGoiJim0gNZTxQFCrigJ4O44ymmtim5N7f/NBIsJ6NafADKCrOstGvXA==',key_name='tempest-keypair-1168601867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea3ea66cfd844c37bcc97a430f2eee69',ramdisk_id='',reservation_id='r-husynio0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1625296795',owner_user_name='tempest-TestVolumeSwap-1625296795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:15:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09d355b05b7b4e669602aa766ff8f7fa',uuid=f52fc510-3640-468a-8a9c-b716b9d17a01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd205313-c8a4-433d-8271-6abe9cf77ede", "address": "fa:16:3e:50:6e:57", "network": {"id": "10a55176-55d4-4629-890b-4de824ceda02", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1760980393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea3ea66cfd844c37bcc97a430f2eee69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd205313-c8", "ovs_interfaceid": "dd205313-c8a4-433d-8271-6abe9cf77ede", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Converting VIF {"id": "dd205313-c8a4-433d-8271-6abe9cf77ede", "address": "fa:16:3e:50:6e:57", "network": {"id": "10a55176-55d4-4629-890b-4de824ceda02", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1760980393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea3ea66cfd844c37bcc97a430f2eee69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd205313-c8", "ovs_interfaceid": "dd205313-c8a4-433d-8271-6abe9cf77ede", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:6e:57,bridge_name='br-int',has_traffic_filtering=True,id=dd205313-c8a4-433d-8271-6abe9cf77ede,network=Network(10a55176-55d4-4629-890b-4de824ceda02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd205313-c8') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG os_vif [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:6e:57,bridge_name='br-int',has_traffic_filtering=True,id=dd205313-c8a4-433d-8271-6abe9cf77ede,network=Network(10a55176-55d4-4629-890b-4de824ceda02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd205313-c8') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/e1272f33-ef5e-48e6-912f-e0beae6dde11/disk 1073741824" returned: 0 in 0.088s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '96e59b3d-8f67-50a5-8198-6679e7b7c51f', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd205313-c8, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdd205313-c8, col_values=(('qos', UUID('2b69ae6b-84d3-47c4-b6f5-c8f3d466458a')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdd205313-c8, col_values=(('external_ids', {'iface-id': 'dd205313-c8a4-433d-8271-6abe9cf77ede', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:6e:57', 'vm-uuid': 'f52fc510-3640-468a-8a9c-b716b9d17a01'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:43 user nova-compute[74189]: INFO os_vif [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:6e:57,bridge_name='br-int',has_traffic_filtering=True,id=dd205313-c8a4-433d-8271-6abe9cf77ede,network=Network(10a55176-55d4-4629-890b-4de824ceda02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd205313-c8')
Oct 25 21:15:43 user nova-compute[74189]: DEBUG nova.network.neutron [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Successfully created port: ad8e4120-613d-45c1-b25e-63ee1ed052d9 {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] No VIF found with MAC fa:16:3e:50:6e:57, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.243s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1272f33-ef5e-48e6-912f-e0beae6dde11/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:15:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1272f33-ef5e-48e6-912f-e0beae6dde11/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1272f33-ef5e-48e6-912f-e0beae6dde11/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:44 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Cannot resize image /opt/stack/data/nova/instances/e1272f33-ef5e-48e6-912f-e0beae6dde11/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:15:44 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:15:44 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Ensure instance console log exists: /opt/stack/data/nova/instances/e1272f33-ef5e-48e6-912f-e0beae6dde11/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:15:44 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:44 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:44 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:44 user nova-compute[74189]: DEBUG nova.network.neutron [req-123c3806-c4ae-4080-a03f-9dd72e1226d4 req-97f8ccac-b933-4f69-b9c4-83503cb6dbf6 service nova] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Updated VIF entry in instance network info cache for port dd205313-c8a4-433d-8271-6abe9cf77ede. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:15:44 user nova-compute[74189]: DEBUG nova.network.neutron [req-123c3806-c4ae-4080-a03f-9dd72e1226d4 req-97f8ccac-b933-4f69-b9c4-83503cb6dbf6 service nova] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Updating instance_info_cache with network_info: [{"id": "dd205313-c8a4-433d-8271-6abe9cf77ede", "address": "fa:16:3e:50:6e:57", "network": {"id": "10a55176-55d4-4629-890b-4de824ceda02", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1760980393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea3ea66cfd844c37bcc97a430f2eee69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd205313-c8", "ovs_interfaceid": "dd205313-c8a4-433d-8271-6abe9cf77ede", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:15:44 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-123c3806-c4ae-4080-a03f-9dd72e1226d4 req-97f8ccac-b933-4f69-b9c4-83503cb6dbf6 service nova] Releasing lock "refresh_cache-f52fc510-3640-468a-8a9c-b716b9d17a01" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG nova.compute.manager [req-40d5d72c-ef88-49e4-9427-168f3f70e090 req-1bcf541a-c4d1-432c-be6c-9193af31541e service nova] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Received event network-vif-plugged-e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-40d5d72c-ef88-49e4-9427-168f3f70e090 req-1bcf541a-c4d1-432c-be6c-9193af31541e service nova] Acquiring lock "c69c0800-7a6c-4155-9f90-bbcd323276d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-40d5d72c-ef88-49e4-9427-168f3f70e090 req-1bcf541a-c4d1-432c-be6c-9193af31541e service nova] Lock "c69c0800-7a6c-4155-9f90-bbcd323276d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-40d5d72c-ef88-49e4-9427-168f3f70e090 req-1bcf541a-c4d1-432c-be6c-9193af31541e service nova] Lock "c69c0800-7a6c-4155-9f90-bbcd323276d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG nova.compute.manager [req-40d5d72c-ef88-49e4-9427-168f3f70e090 req-1bcf541a-c4d1-432c-be6c-9193af31541e service nova] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] No waiting events found dispatching network-vif-plugged-e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:15:45 user nova-compute[74189]: WARNING nova.compute.manager [req-40d5d72c-ef88-49e4-9427-168f3f70e090 req-1bcf541a-c4d1-432c-be6c-9193af31541e service nova] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Received unexpected event network-vif-plugged-e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc for instance with vm_state active and task_state None.
Oct 25 21:15:45 user nova-compute[74189]: DEBUG nova.compute.manager [req-40d5d72c-ef88-49e4-9427-168f3f70e090 req-1bcf541a-c4d1-432c-be6c-9193af31541e service nova] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Received event network-vif-plugged-e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-40d5d72c-ef88-49e4-9427-168f3f70e090 req-1bcf541a-c4d1-432c-be6c-9193af31541e service nova] Acquiring lock "c69c0800-7a6c-4155-9f90-bbcd323276d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-40d5d72c-ef88-49e4-9427-168f3f70e090 req-1bcf541a-c4d1-432c-be6c-9193af31541e service nova] Lock "c69c0800-7a6c-4155-9f90-bbcd323276d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-40d5d72c-ef88-49e4-9427-168f3f70e090 req-1bcf541a-c4d1-432c-be6c-9193af31541e service nova] Lock "c69c0800-7a6c-4155-9f90-bbcd323276d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG nova.compute.manager [req-40d5d72c-ef88-49e4-9427-168f3f70e090 req-1bcf541a-c4d1-432c-be6c-9193af31541e service nova] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] No waiting events found dispatching network-vif-plugged-e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:15:45 user nova-compute[74189]: WARNING nova.compute.manager [req-40d5d72c-ef88-49e4-9427-168f3f70e090 req-1bcf541a-c4d1-432c-be6c-9193af31541e service nova] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Received unexpected event network-vif-plugged-e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc for instance with vm_state active and task_state None.
Oct 25 21:15:45 user nova-compute[74189]: DEBUG nova.compute.manager [req-40d5d72c-ef88-49e4-9427-168f3f70e090 req-1bcf541a-c4d1-432c-be6c-9193af31541e service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Received event network-vif-plugged-a151161f-1633-405f-ac74-9f379531d89a {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-40d5d72c-ef88-49e4-9427-168f3f70e090 req-1bcf541a-c4d1-432c-be6c-9193af31541e service nova] Acquiring lock "ea8d22c5-3868-43d1-b101-c6cff480dea6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-40d5d72c-ef88-49e4-9427-168f3f70e090 req-1bcf541a-c4d1-432c-be6c-9193af31541e service nova] Lock "ea8d22c5-3868-43d1-b101-c6cff480dea6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-40d5d72c-ef88-49e4-9427-168f3f70e090 req-1bcf541a-c4d1-432c-be6c-9193af31541e service nova] Lock "ea8d22c5-3868-43d1-b101-c6cff480dea6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG nova.compute.manager [req-40d5d72c-ef88-49e4-9427-168f3f70e090 req-1bcf541a-c4d1-432c-be6c-9193af31541e service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] No waiting events found dispatching network-vif-plugged-a151161f-1633-405f-ac74-9f379531d89a {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:15:45 user nova-compute[74189]: WARNING nova.compute.manager [req-40d5d72c-ef88-49e4-9427-168f3f70e090 req-1bcf541a-c4d1-432c-be6c-9193af31541e service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Received unexpected event network-vif-plugged-a151161f-1633-405f-ac74-9f379531d89a for instance with vm_state building and task_state spawning.
Oct 25 21:15:45 user nova-compute[74189]: DEBUG nova.compute.manager [req-40d5d72c-ef88-49e4-9427-168f3f70e090 req-1bcf541a-c4d1-432c-be6c-9193af31541e service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Received event network-vif-plugged-a151161f-1633-405f-ac74-9f379531d89a {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-40d5d72c-ef88-49e4-9427-168f3f70e090 req-1bcf541a-c4d1-432c-be6c-9193af31541e service nova] Acquiring lock "ea8d22c5-3868-43d1-b101-c6cff480dea6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-40d5d72c-ef88-49e4-9427-168f3f70e090 req-1bcf541a-c4d1-432c-be6c-9193af31541e service nova] Lock "ea8d22c5-3868-43d1-b101-c6cff480dea6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-40d5d72c-ef88-49e4-9427-168f3f70e090 req-1bcf541a-c4d1-432c-be6c-9193af31541e service nova] Lock "ea8d22c5-3868-43d1-b101-c6cff480dea6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG nova.compute.manager [req-40d5d72c-ef88-49e4-9427-168f3f70e090 req-1bcf541a-c4d1-432c-be6c-9193af31541e service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] No waiting events found dispatching network-vif-plugged-a151161f-1633-405f-ac74-9f379531d89a {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:15:45 user nova-compute[74189]: WARNING nova.compute.manager [req-40d5d72c-ef88-49e4-9427-168f3f70e090 req-1bcf541a-c4d1-432c-be6c-9193af31541e service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Received unexpected event network-vif-plugged-a151161f-1633-405f-ac74-9f379531d89a for instance with vm_state building and task_state spawning.
Oct 25 21:15:45 user nova-compute[74189]: DEBUG nova.compute.manager [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:15:45 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Instance spawned successfully.
Oct 25 21:15:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG nova.network.neutron [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Successfully updated port: ad8e4120-613d-45c1-b25e-63ee1ed052d9 {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Acquiring lock "refresh_cache-e1272f33-ef5e-48e6-912f-e0beae6dde11" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Acquired lock "refresh_cache-e1272f33-ef5e-48e6-912f-e0beae6dde11" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG nova.network.neutron [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG nova.compute.manager [req-b779043d-ea56-41e9-8e2f-e9ecba82362f req-6bb71550-c7e6-4747-a6e8-433c933c3752 service nova] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Received event network-changed-ad8e4120-613d-45c1-b25e-63ee1ed052d9 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG nova.compute.manager [req-b779043d-ea56-41e9-8e2f-e9ecba82362f req-6bb71550-c7e6-4747-a6e8-433c933c3752 service nova] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Refreshing instance network info cache due to event network-changed-ad8e4120-613d-45c1-b25e-63ee1ed052d9. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b779043d-ea56-41e9-8e2f-e9ecba82362f req-6bb71550-c7e6-4747-a6e8-433c933c3752 service nova] Acquiring lock "refresh_cache-e1272f33-ef5e-48e6-912f-e0beae6dde11" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG nova.network.neutron [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:45 user nova-compute[74189]: INFO nova.compute.manager [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Took 8.40 seconds to spawn the instance on the hypervisor.
Oct 25 21:15:45 user nova-compute[74189]: DEBUG nova.compute.manager [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:15:45 user nova-compute[74189]: INFO nova.compute.manager [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Took 9.56 seconds to build instance.
Oct 25 21:15:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-71012095-44c4-4532-a8ed-090d74cab088 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lock "ea8d22c5-3868-43d1-b101-c6cff480dea6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.708s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG nova.network.neutron [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Updating instance_info_cache with network_info: [{"id": "ad8e4120-613d-45c1-b25e-63ee1ed052d9", "address": "fa:16:3e:33:77:40", "network": {"id": "a4d0bc71-5f07-4a91-8ea3-627594c5f0d2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1082591514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b22e5790c544d08ba63bf8f2eeb425b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8e4120-61", "ovs_interfaceid": "ad8e4120-613d-45c1-b25e-63ee1ed052d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Releasing lock "refresh_cache-e1272f33-ef5e-48e6-912f-e0beae6dde11" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG nova.compute.manager [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Instance network_info: |[{"id": "ad8e4120-613d-45c1-b25e-63ee1ed052d9", "address": "fa:16:3e:33:77:40", "network": {"id": "a4d0bc71-5f07-4a91-8ea3-627594c5f0d2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1082591514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b22e5790c544d08ba63bf8f2eeb425b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8e4120-61", "ovs_interfaceid": "ad8e4120-613d-45c1-b25e-63ee1ed052d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b779043d-ea56-41e9-8e2f-e9ecba82362f req-6bb71550-c7e6-4747-a6e8-433c933c3752 service nova] Acquired lock "refresh_cache-e1272f33-ef5e-48e6-912f-e0beae6dde11" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG nova.network.neutron [req-b779043d-ea56-41e9-8e2f-e9ecba82362f req-6bb71550-c7e6-4747-a6e8-433c933c3752 service nova] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Refreshing network info cache for port ad8e4120-613d-45c1-b25e-63ee1ed052d9 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:15:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Start _get_guest_xml network_info=[{"id": "ad8e4120-613d-45c1-b25e-63ee1ed052d9", "address": "fa:16:3e:33:77:40", "network": {"id": "a4d0bc71-5f07-4a91-8ea3-627594c5f0d2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1082591514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b22e5790c544d08ba63bf8f2eeb425b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8e4120-61", "ovs_interfaceid": "ad8e4120-613d-45c1-b25e-63ee1ed052d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:15:45 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:15:46 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:15:46 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:15:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1234970439',display_name='tempest-VolumesAssistedSnapshotsTest-server-1234970439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1234970439',id=8,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSGIHoF/6n7L84xa+oreHnlIlSd/eZUSS35ohRf3ewDruld1xoPkfMt9xG3K3ZDOu7wP97HRATeRjig5gsLDP7M/e/UOp6/7xRTtBPUozRo/MHSvGY8NcW4dfW0SD183w==',key_name='tempest-keypair-42847081',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b22e5790c544d08ba63bf8f2eeb425b',ramdisk_id='',reservation_id='r-ms0915ec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-123079009',owner_user_name='tempest-VolumesAssistedSnapshotsTest-123079009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:15:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6595fd7dc5c54e2d9e6ba26a38a03180',uuid=e1272f33-ef5e-48e6-912f-e0beae6dde11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad8e4120-613d-45c1-b25e-63ee1ed052d9", "address": "fa:16:3e:33:77:40", "network": {"id": "a4d0bc71-5f07-4a91-8ea3-627594c5f0d2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1082591514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b22e5790c544d08ba63bf8f2eeb425b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8e4120-61", "ovs_interfaceid": "ad8e4120-613d-45c1-b25e-63ee1ed052d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Converting VIF {"id": "ad8e4120-613d-45c1-b25e-63ee1ed052d9", "address": "fa:16:3e:33:77:40", "network": {"id": "a4d0bc71-5f07-4a91-8ea3-627594c5f0d2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1082591514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b22e5790c544d08ba63bf8f2eeb425b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8e4120-61", "ovs_interfaceid": "ad8e4120-613d-45c1-b25e-63ee1ed052d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:77:40,bridge_name='br-int',has_traffic_filtering=True,id=ad8e4120-613d-45c1-b25e-63ee1ed052d9,network=Network(a4d0bc71-5f07-4a91-8ea3-627594c5f0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad8e4120-61') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG nova.objects.instance [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Lazy-loading 'pci_devices' on Instance uuid e1272f33-ef5e-48e6-912f-e0beae6dde11 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:15:46 user nova-compute[74189]:   <uuid>e1272f33-ef5e-48e6-912f-e0beae6dde11</uuid>
Oct 25 21:15:46 user nova-compute[74189]:   <name>instance-00000008</name>
Oct 25 21:15:46 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:15:46 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:15:46 user nova-compute[74189]:   <metadata>
Oct 25 21:15:46 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:15:46 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:15:46 user nova-compute[74189]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1234970439</nova:name>
Oct 25 21:15:46 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:15:46</nova:creationTime>
Oct 25 21:15:46 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:15:46 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:15:46 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:15:46 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:15:46 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:15:46 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:15:46 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:15:46 user nova-compute[74189]:       <nova:owner>
Oct 25 21:15:46 user nova-compute[74189]:         <nova:user uuid="6595fd7dc5c54e2d9e6ba26a38a03180">tempest-VolumesAssistedSnapshotsTest-123079009-project-member</nova:user>
Oct 25 21:15:46 user nova-compute[74189]:         <nova:project uuid="2b22e5790c544d08ba63bf8f2eeb425b">tempest-VolumesAssistedSnapshotsTest-123079009</nova:project>
Oct 25 21:15:46 user nova-compute[74189]:       </nova:owner>
Oct 25 21:15:46 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:15:46 user nova-compute[74189]:       <nova:ports>
Oct 25 21:15:46 user nova-compute[74189]:         <nova:port uuid="ad8e4120-613d-45c1-b25e-63ee1ed052d9">
Oct 25 21:15:46 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 25 21:15:46 user nova-compute[74189]:         </nova:port>
Oct 25 21:15:46 user nova-compute[74189]:       </nova:ports>
Oct 25 21:15:46 user nova-compute[74189]:     </nova:instance>
Oct 25 21:15:46 user nova-compute[74189]:   </metadata>
Oct 25 21:15:46 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:15:46 user nova-compute[74189]:     <system>
Oct 25 21:15:46 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:15:46 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:15:46 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:15:46 user nova-compute[74189]:       <entry name="serial">e1272f33-ef5e-48e6-912f-e0beae6dde11</entry>
Oct 25 21:15:46 user nova-compute[74189]:       <entry name="uuid">e1272f33-ef5e-48e6-912f-e0beae6dde11</entry>
Oct 25 21:15:46 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:15:46 user nova-compute[74189]:     </system>
Oct 25 21:15:46 user nova-compute[74189]:   </sysinfo>
Oct 25 21:15:46 user nova-compute[74189]:   <os>
Oct 25 21:15:46 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:15:46 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:15:46 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:15:46 user nova-compute[74189]:   </os>
Oct 25 21:15:46 user nova-compute[74189]:   <features>
Oct 25 21:15:46 user nova-compute[74189]:     <acpi/>
Oct 25 21:15:46 user nova-compute[74189]:     <apic/>
Oct 25 21:15:46 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:15:46 user nova-compute[74189]:   </features>
Oct 25 21:15:46 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:15:46 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:15:46 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:15:46 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:15:46 user nova-compute[74189]:   </clock>
Oct 25 21:15:46 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:15:46 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:15:46 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:15:46 user nova-compute[74189]:   </cpu>
Oct 25 21:15:46 user nova-compute[74189]:   <devices>
Oct 25 21:15:46 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:15:46 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:15:46 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/e1272f33-ef5e-48e6-912f-e0beae6dde11/disk"/>
Oct 25 21:15:46 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:15:46 user nova-compute[74189]:     </disk>
Oct 25 21:15:46 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:15:46 user nova-compute[74189]:       <mac address="fa:16:3e:33:77:40"/>
Oct 25 21:15:46 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:15:46 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:15:46 user nova-compute[74189]:       <target dev="tapad8e4120-61"/>
Oct 25 21:15:46 user nova-compute[74189]:     </interface>
Oct 25 21:15:46 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:15:46 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/e1272f33-ef5e-48e6-912f-e0beae6dde11/console.log" append="off"/>
Oct 25 21:15:46 user nova-compute[74189]:     </serial>
Oct 25 21:15:46 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:15:46 user nova-compute[74189]:     <video>
Oct 25 21:15:46 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:15:46 user nova-compute[74189]:     </video>
Oct 25 21:15:46 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:15:46 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:15:46 user nova-compute[74189]:     </rng>
Oct 25 21:15:46 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:15:46 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:15:46 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:15:46 user nova-compute[74189]:     </memballoon>
Oct 25 21:15:46 user nova-compute[74189]:   </devices>
Oct 25 21:15:46 user nova-compute[74189]: </domain>
Oct 25 21:15:46 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:15:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1234970439',display_name='tempest-VolumesAssistedSnapshotsTest-server-1234970439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1234970439',id=8,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSGIHoF/6n7L84xa+oreHnlIlSd/eZUSS35ohRf3ewDruld1xoPkfMt9xG3K3ZDOu7wP97HRATeRjig5gsLDP7M/e/UOp6/7xRTtBPUozRo/MHSvGY8NcW4dfW0SD183w==',key_name='tempest-keypair-42847081',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b22e5790c544d08ba63bf8f2eeb425b',ramdisk_id='',reservation_id='r-ms0915ec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-123079009',owner_user_name='tempest-VolumesAssistedSnapshotsTest-123079009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:15:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6595fd7dc5c54e2d9e6ba26a38a03180',uuid=e1272f33-ef5e-48e6-912f-e0beae6dde11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad8e4120-613d-45c1-b25e-63ee1ed052d9", "address": "fa:16:3e:33:77:40", "network": {"id": "a4d0bc71-5f07-4a91-8ea3-627594c5f0d2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1082591514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b22e5790c544d08ba63bf8f2eeb425b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8e4120-61", "ovs_interfaceid": "ad8e4120-613d-45c1-b25e-63ee1ed052d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Converting VIF {"id": "ad8e4120-613d-45c1-b25e-63ee1ed052d9", "address": "fa:16:3e:33:77:40", "network": {"id": "a4d0bc71-5f07-4a91-8ea3-627594c5f0d2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1082591514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b22e5790c544d08ba63bf8f2eeb425b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8e4120-61", "ovs_interfaceid": "ad8e4120-613d-45c1-b25e-63ee1ed052d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:77:40,bridge_name='br-int',has_traffic_filtering=True,id=ad8e4120-613d-45c1-b25e-63ee1ed052d9,network=Network(a4d0bc71-5f07-4a91-8ea3-627594c5f0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad8e4120-61') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG os_vif [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:77:40,bridge_name='br-int',has_traffic_filtering=True,id=ad8e4120-613d-45c1-b25e-63ee1ed052d9,network=Network(a4d0bc71-5f07-4a91-8ea3-627594c5f0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad8e4120-61') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79645bf5-56d0-5a61-98a0-1b6309102321', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad8e4120-61, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad8e4120-61, col_values=(('qos', UUID('ec019caf-d574-4916-b868-bc2d4613c5f9')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad8e4120-61, col_values=(('external_ids', {'iface-id': 'ad8e4120-613d-45c1-b25e-63ee1ed052d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:77:40', 'vm-uuid': 'e1272f33-ef5e-48e6-912f-e0beae6dde11'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:46 user nova-compute[74189]: INFO os_vif [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:77:40,bridge_name='br-int',has_traffic_filtering=True,id=ad8e4120-613d-45c1-b25e-63ee1ed052d9,network=Network(a4d0bc71-5f07-4a91-8ea3-627594c5f0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad8e4120-61')
Oct 25 21:15:46 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] No VIF found with MAC fa:16:3e:33:77:40, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG nova.network.neutron [req-b779043d-ea56-41e9-8e2f-e9ecba82362f req-6bb71550-c7e6-4747-a6e8-433c933c3752 service nova] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Updated VIF entry in instance network info cache for port ad8e4120-613d-45c1-b25e-63ee1ed052d9. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG nova.network.neutron [req-b779043d-ea56-41e9-8e2f-e9ecba82362f req-6bb71550-c7e6-4747-a6e8-433c933c3752 service nova] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Updating instance_info_cache with network_info: [{"id": "ad8e4120-613d-45c1-b25e-63ee1ed052d9", "address": "fa:16:3e:33:77:40", "network": {"id": "a4d0bc71-5f07-4a91-8ea3-627594c5f0d2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1082591514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b22e5790c544d08ba63bf8f2eeb425b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8e4120-61", "ovs_interfaceid": "ad8e4120-613d-45c1-b25e-63ee1ed052d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:15:46 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b779043d-ea56-41e9-8e2f-e9ecba82362f req-6bb71550-c7e6-4747-a6e8-433c933c3752 service nova] Releasing lock "refresh_cache-e1272f33-ef5e-48e6-912f-e0beae6dde11" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:15:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:48 user nova-compute[74189]: DEBUG nova.compute.manager [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:15:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:15:48 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Instance spawned successfully.
Oct 25 21:15:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:15:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:48 user nova-compute[74189]: INFO nova.compute.manager [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Took 7.74 seconds to spawn the instance on the hypervisor.
Oct 25 21:15:48 user nova-compute[74189]: DEBUG nova.compute.manager [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:15:49 user nova-compute[74189]: INFO nova.compute.manager [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Took 9.12 seconds to build instance.
Oct 25 21:15:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dfd0b408-577b-4fb1-b283-403abbda48b0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Lock "f52fc510-3640-468a-8a9c-b716b9d17a01" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.432s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:51 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:51 user nova-compute[74189]: DEBUG nova.compute.manager [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:15:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:15:51 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Instance spawned successfully.
Oct 25 21:15:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:15:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:15:51 user nova-compute[74189]: INFO nova.compute.manager [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Took 8.79 seconds to spawn the instance on the hypervisor.
Oct 25 21:15:51 user nova-compute[74189]: DEBUG nova.compute.manager [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:15:52 user nova-compute[74189]: INFO nova.compute.manager [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Took 10.06 seconds to build instance.
Oct 25 21:15:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-cb8af520-8fa5-4338-bc21-35f1d59e2b28 tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Lock "e1272f33-ef5e-48e6-912f-e0beae6dde11" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.180s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:52 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:53 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:15:53 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Cleaning up deleted instances {{(pid=74189) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 21:15:53 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] There are 0 instances to clean {{(pid=74189) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 21:15:53 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:15:53 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74189) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 21:15:53 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:15:54 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:15:55 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:15:55 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:15:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:15:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.004s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:15:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:15:55 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:15:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4c57363-0107-4567-9842-44a0522f8326/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4c57363-0107-4567-9842-44a0522f8326/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4c57363-0107-4567-9842-44a0522f8326/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4c57363-0107-4567-9842-44a0522f8326/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk --force-share --output=json" returned: 0 in 0.314s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:15:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52fc510-3640-468a-8a9c-b716b9d17a01/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52fc510-3640-468a-8a9c-b716b9d17a01/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52fc510-3640-468a-8a9c-b716b9d17a01/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52fc510-3640-468a-8a9c-b716b9d17a01/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ab3484-9785-48b4-96fb-1563a6fb8434/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ab3484-9785-48b4-96fb-1563a6fb8434/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ab3484-9785-48b4-96fb-1563a6fb8434/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ab3484-9785-48b4-96fb-1563a6fb8434/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1272f33-ef5e-48e6-912f-e0beae6dde11/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1272f33-ef5e-48e6-912f-e0beae6dde11/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:15:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1272f33-ef5e-48e6-912f-e0beae6dde11/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:15:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1272f33-ef5e-48e6-912f-e0beae6dde11/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:16:00 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:16:00 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:16:00 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=7769MB free_disk=25.609844207763672GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:16:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:16:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:16:00 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 59ab3484-9785-48b4-96fb-1563a6fb8434 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:16:00 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance d7c3a99a-ab38-4e88-896d-94ae51a09a48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:16:00 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:16:00 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance c69c0800-7a6c-4155-9f90-bbcd323276d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:16:00 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance c4c57363-0107-4567-9842-44a0522f8326 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:16:00 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance ea8d22c5-3868-43d1-b101-c6cff480dea6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:16:00 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance f52fc510-3640-468a-8a9c-b716b9d17a01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:16:00 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance e1272f33-ef5e-48e6-912f-e0beae6dde11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:16:00 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:16:00 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:16:01 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:16:01 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:16:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:16:01 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:16:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.658s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:16:02 user nova-compute[74189]: DEBUG nova.compute.manager [req-8a133932-c47c-43dd-8b57-8bac9ddb3dd0 req-245184e9-daf0-4f4c-aabe-5067566c8848 service nova] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Received event network-vif-plugged-dd205313-c8a4-433d-8271-6abe9cf77ede {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:16:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8a133932-c47c-43dd-8b57-8bac9ddb3dd0 req-245184e9-daf0-4f4c-aabe-5067566c8848 service nova] Acquiring lock "f52fc510-3640-468a-8a9c-b716b9d17a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:16:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8a133932-c47c-43dd-8b57-8bac9ddb3dd0 req-245184e9-daf0-4f4c-aabe-5067566c8848 service nova] Lock "f52fc510-3640-468a-8a9c-b716b9d17a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:16:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8a133932-c47c-43dd-8b57-8bac9ddb3dd0 req-245184e9-daf0-4f4c-aabe-5067566c8848 service nova] Lock "f52fc510-3640-468a-8a9c-b716b9d17a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:16:02 user nova-compute[74189]: DEBUG nova.compute.manager [req-8a133932-c47c-43dd-8b57-8bac9ddb3dd0 req-245184e9-daf0-4f4c-aabe-5067566c8848 service nova] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] No waiting events found dispatching network-vif-plugged-dd205313-c8a4-433d-8271-6abe9cf77ede {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:16:02 user nova-compute[74189]: WARNING nova.compute.manager [req-8a133932-c47c-43dd-8b57-8bac9ddb3dd0 req-245184e9-daf0-4f4c-aabe-5067566c8848 service nova] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Received unexpected event network-vif-plugged-dd205313-c8a4-433d-8271-6abe9cf77ede for instance with vm_state active and task_state None.
Oct 25 21:16:02 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:16:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:16:02 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:16:02 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:16:02 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Rebuilding the list of instances to heal {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 21:16:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-59ab3484-9785-48b4-96fb-1563a6fb8434" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:16:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-59ab3484-9785-48b4-96fb-1563a6fb8434" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:16:02 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:16:02 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lazy-loading 'info_cache' on Instance uuid 59ab3484-9785-48b4-96fb-1563a6fb8434 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:16:03 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Updating instance_info_cache with network_info: [{"id": "9c2c5804-3d81-4e3a-9c17-073b1dc171e3", "address": "fa:16:3e:0c:3e:53", "network": {"id": "606f4918-8904-4548-9cfd-b1e0c1eed7ee", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1638907501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2aaccb94133476fbded17c902219c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c2c5804-3d", "ovs_interfaceid": "9c2c5804-3d81-4e3a-9c17-073b1dc171e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:16:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-59ab3484-9785-48b4-96fb-1563a6fb8434" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:16:03 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:16:03 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:16:03 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:16:03 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:16:03 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:16:03 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:16:04 user nova-compute[74189]: DEBUG nova.compute.manager [req-377d2c5a-b7c6-485b-87bc-e6d55b0f418c req-9db9b58b-39dc-41d9-b911-524d943d4e72 service nova] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Received event network-vif-plugged-dd205313-c8a4-433d-8271-6abe9cf77ede {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:16:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-377d2c5a-b7c6-485b-87bc-e6d55b0f418c req-9db9b58b-39dc-41d9-b911-524d943d4e72 service nova] Acquiring lock "f52fc510-3640-468a-8a9c-b716b9d17a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:16:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-377d2c5a-b7c6-485b-87bc-e6d55b0f418c req-9db9b58b-39dc-41d9-b911-524d943d4e72 service nova] Lock "f52fc510-3640-468a-8a9c-b716b9d17a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:16:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-377d2c5a-b7c6-485b-87bc-e6d55b0f418c req-9db9b58b-39dc-41d9-b911-524d943d4e72 service nova] Lock "f52fc510-3640-468a-8a9c-b716b9d17a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:16:04 user nova-compute[74189]: DEBUG nova.compute.manager [req-377d2c5a-b7c6-485b-87bc-e6d55b0f418c req-9db9b58b-39dc-41d9-b911-524d943d4e72 service nova] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] No waiting events found dispatching network-vif-plugged-dd205313-c8a4-433d-8271-6abe9cf77ede {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:16:04 user nova-compute[74189]: WARNING nova.compute.manager [req-377d2c5a-b7c6-485b-87bc-e6d55b0f418c req-9db9b58b-39dc-41d9-b911-524d943d4e72 service nova] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Received unexpected event network-vif-plugged-dd205313-c8a4-433d-8271-6abe9cf77ede for instance with vm_state active and task_state None.
Oct 25 21:16:04 user nova-compute[74189]: DEBUG nova.compute.manager [req-377d2c5a-b7c6-485b-87bc-e6d55b0f418c req-9db9b58b-39dc-41d9-b911-524d943d4e72 service nova] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Received event network-vif-plugged-ad8e4120-613d-45c1-b25e-63ee1ed052d9 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:16:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-377d2c5a-b7c6-485b-87bc-e6d55b0f418c req-9db9b58b-39dc-41d9-b911-524d943d4e72 service nova] Acquiring lock "e1272f33-ef5e-48e6-912f-e0beae6dde11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:16:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-377d2c5a-b7c6-485b-87bc-e6d55b0f418c req-9db9b58b-39dc-41d9-b911-524d943d4e72 service nova] Lock "e1272f33-ef5e-48e6-912f-e0beae6dde11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:16:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-377d2c5a-b7c6-485b-87bc-e6d55b0f418c req-9db9b58b-39dc-41d9-b911-524d943d4e72 service nova] Lock "e1272f33-ef5e-48e6-912f-e0beae6dde11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:16:04 user nova-compute[74189]: DEBUG nova.compute.manager [req-377d2c5a-b7c6-485b-87bc-e6d55b0f418c req-9db9b58b-39dc-41d9-b911-524d943d4e72 service nova] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] No waiting events found dispatching network-vif-plugged-ad8e4120-613d-45c1-b25e-63ee1ed052d9 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:16:04 user nova-compute[74189]: WARNING nova.compute.manager [req-377d2c5a-b7c6-485b-87bc-e6d55b0f418c req-9db9b58b-39dc-41d9-b911-524d943d4e72 service nova] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Received unexpected event network-vif-plugged-ad8e4120-613d-45c1-b25e-63ee1ed052d9 for instance with vm_state active and task_state None.
Oct 25 21:16:04 user nova-compute[74189]: DEBUG nova.compute.manager [req-377d2c5a-b7c6-485b-87bc-e6d55b0f418c req-9db9b58b-39dc-41d9-b911-524d943d4e72 service nova] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Received event network-vif-plugged-ad8e4120-613d-45c1-b25e-63ee1ed052d9 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:16:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-377d2c5a-b7c6-485b-87bc-e6d55b0f418c req-9db9b58b-39dc-41d9-b911-524d943d4e72 service nova] Acquiring lock "e1272f33-ef5e-48e6-912f-e0beae6dde11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:16:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-377d2c5a-b7c6-485b-87bc-e6d55b0f418c req-9db9b58b-39dc-41d9-b911-524d943d4e72 service nova] Lock "e1272f33-ef5e-48e6-912f-e0beae6dde11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:16:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-377d2c5a-b7c6-485b-87bc-e6d55b0f418c req-9db9b58b-39dc-41d9-b911-524d943d4e72 service nova] Lock "e1272f33-ef5e-48e6-912f-e0beae6dde11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:16:04 user nova-compute[74189]: DEBUG nova.compute.manager [req-377d2c5a-b7c6-485b-87bc-e6d55b0f418c req-9db9b58b-39dc-41d9-b911-524d943d4e72 service nova] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] No waiting events found dispatching network-vif-plugged-ad8e4120-613d-45c1-b25e-63ee1ed052d9 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:16:04 user nova-compute[74189]: WARNING nova.compute.manager [req-377d2c5a-b7c6-485b-87bc-e6d55b0f418c req-9db9b58b-39dc-41d9-b911-524d943d4e72 service nova] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Received unexpected event network-vif-plugged-ad8e4120-613d-45c1-b25e-63ee1ed052d9 for instance with vm_state active and task_state None.
Oct 25 21:16:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:16:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:16:11 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:16:12 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:16:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:16:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:16:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:16:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:16:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Acquiring lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:16:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:16:24 user nova-compute[74189]: DEBUG nova.compute.manager [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:16:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:16:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:16:24 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:16:24 user nova-compute[74189]: INFO nova.compute.claims [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Claim successful on node user
Oct 25 21:16:24 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Refreshing inventories for resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 21:16:24 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Updating ProviderTree inventory for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 21:16:24 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Updating inventory in ProviderTree for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 21:16:24 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Refreshing aggregate associations for resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc, aggregates: None {{(pid=74189) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 21:16:24 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Refreshing trait associations for resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING {{(pid=74189) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 21:16:25 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:16:25 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:16:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.665s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:16:25 user nova-compute[74189]: DEBUG nova.compute.manager [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:16:25 user nova-compute[74189]: DEBUG nova.compute.manager [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:16:25 user nova-compute[74189]: DEBUG nova.network.neutron [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:16:25 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:16:25 user nova-compute[74189]: DEBUG nova.compute.manager [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:16:25 user nova-compute[74189]: DEBUG nova.policy [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df67ddee61b04820b0968636a2eddbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa384e522324f0fa297ca277820909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:16:25 user nova-compute[74189]: INFO nova.virt.block_device [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Booting with volume e6efe932-902f-41f8-82f4-1773bc305e0e at /dev/vda
Oct 25 21:16:25 user nova-compute[74189]: DEBUG os_brick.utils [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:16:25 user nova-compute[74189]: INFO oslo.privsep.daemon [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmppk1_bntf/privsep.sock']
Oct 25 21:16:25 user sudo[85076]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmppk1_bntf/privsep.sock
Oct 25 21:16:25 user sudo[85076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 25 21:16:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:16:26 user nova-compute[74189]: DEBUG nova.network.neutron [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Successfully created port: d28e4203-5fff-4a0b-b360-fe29bfa131b8 {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:16:27 user sudo[85076]: pam_unix(sudo:session): session closed for user root
Oct 25 21:16:27 user nova-compute[74189]: DEBUG nova.network.neutron [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Successfully updated port: d28e4203-5fff-4a0b-b360-fe29bfa131b8 {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:16:27 user nova-compute[74189]: INFO oslo.privsep.daemon [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Spawned new privsep daemon via rootwrap
Oct 25 21:16:27 user nova-compute[74189]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 25 21:16:27 user nova-compute[74189]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 25 21:16:27 user nova-compute[74189]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 25 21:16:27 user nova-compute[74189]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85079
Oct 25 21:16:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Acquiring lock "refresh_cache-a05b75c0-c064-42c5-aca7-c4b07cfabcfb" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:16:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Acquired lock "refresh_cache-a05b75c0-c064-42c5-aca7-c4b07cfabcfb" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:16:27 user nova-compute[74189]: DEBUG nova.network.neutron [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:16:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-bf91f902-fd74-4eaf-9737-5351d5546206 req-b99c4931-57b9-486a-b108-0198ee6b8ffd service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Received event network-changed-d28e4203-5fff-4a0b-b360-fe29bfa131b8 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:16:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-bf91f902-fd74-4eaf-9737-5351d5546206 req-b99c4931-57b9-486a-b108-0198ee6b8ffd service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Refreshing instance network info cache due to event network-changed-d28e4203-5fff-4a0b-b360-fe29bfa131b8. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:16:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bf91f902-fd74-4eaf-9737-5351d5546206 req-b99c4931-57b9-486a-b108-0198ee6b8ffd service nova] Acquiring lock "refresh_cache-a05b75c0-c064-42c5-aca7-c4b07cfabcfb" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:16:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb46055-8630-4765-bc8a-e182db0c4091]: (2,) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:16:27 user nova-compute[74189]: DEBUG nova.network.neutron [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:16:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:16:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:16:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1524df4-1c98-4419-8ab2-964d7d641fd4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:16:27 user nova-compute[74189]: WARNING os_brick.initiator.connectors.nvmeof [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 25 21:16:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:16:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:16:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[322358bc-361d-439a-9a12-3a521cf02b36]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:16:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:16:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:16:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[92490df6-668f-4220-9a7d-37b861483056]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:16:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2364e18-ea5e-4b1c-8782-76658460e070]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:16:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:16:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:16:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:16:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:16:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:16:27 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:16:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f87dc92-1cfa-4d34-9cbd-53cc4e3bcfc5]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:16:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:16:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:16:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:16:27 user nova-compute[74189]: DEBUG os_brick.utils [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] <== get_connector_properties: return (1786ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:16:27 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Updating existing volume attachment record: 7d899b8c-97f9-49d7-90c2-aa04cf69c4e2 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:16:27 user nova-compute[74189]: DEBUG nova.network.neutron [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Updating instance_info_cache with network_info: [{"id": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "address": "fa:16:3e:88:75:56", "network": {"id": "75c09903-d1c6-4197-bc70-cfe7f3e7a772", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1909568880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa384e522324f0fa297ca277820909f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd28e4203-5f", "ovs_interfaceid": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:16:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Releasing lock "refresh_cache-a05b75c0-c064-42c5-aca7-c4b07cfabcfb" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:16:27 user nova-compute[74189]: DEBUG nova.compute.manager [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Instance network_info: |[{"id": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "address": "fa:16:3e:88:75:56", "network": {"id": "75c09903-d1c6-4197-bc70-cfe7f3e7a772", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1909568880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa384e522324f0fa297ca277820909f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd28e4203-5f", "ovs_interfaceid": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:16:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bf91f902-fd74-4eaf-9737-5351d5546206 req-b99c4931-57b9-486a-b108-0198ee6b8ffd service nova] Acquired lock "refresh_cache-a05b75c0-c064-42c5-aca7-c4b07cfabcfb" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:16:27 user nova-compute[74189]: DEBUG nova.network.neutron [req-bf91f902-fd74-4eaf-9737-5351d5546206 req-b99c4931-57b9-486a-b108-0198ee6b8ffd service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Refreshing network info cache for port d28e4203-5fff-4a0b-b360-fe29bfa131b8 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:16:28 user nova-compute[74189]: DEBUG nova.network.neutron [req-bf91f902-fd74-4eaf-9737-5351d5546206 req-b99c4931-57b9-486a-b108-0198ee6b8ffd service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Updated VIF entry in instance network info cache for port d28e4203-5fff-4a0b-b360-fe29bfa131b8. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:16:28 user nova-compute[74189]: DEBUG nova.network.neutron [req-bf91f902-fd74-4eaf-9737-5351d5546206 req-b99c4931-57b9-486a-b108-0198ee6b8ffd service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Updating instance_info_cache with network_info: [{"id": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "address": "fa:16:3e:88:75:56", "network": {"id": "75c09903-d1c6-4197-bc70-cfe7f3e7a772", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1909568880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa384e522324f0fa297ca277820909f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd28e4203-5f", "ovs_interfaceid": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:16:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bf91f902-fd74-4eaf-9737-5351d5546206 req-b99c4931-57b9-486a-b108-0198ee6b8ffd service nova] Releasing lock "refresh_cache-a05b75c0-c064-42c5-aca7-c4b07cfabcfb" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:16:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:16:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:16:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:16:46 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:16:51 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:16:53 user nova-compute[74189]: DEBUG nova.compute.manager [None req-28c814a1-6730-47d4-92fc-55ccda72609b tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:16:53 user nova-compute[74189]: INFO nova.compute.manager [None req-28c814a1-6730-47d4-92fc-55ccda72609b tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] instance snapshotting
Oct 25 21:16:53 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-28c814a1-6730-47d4-92fc-55ccda72609b tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Beginning live snapshot process
Oct 25 21:16:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-28c814a1-6730-47d4-92fc-55ccda72609b tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json -f qcow2 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:16:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-28c814a1-6730-47d4-92fc-55ccda72609b tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json -f qcow2" returned: 0 in 0.190s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:16:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-28c814a1-6730-47d4-92fc-55ccda72609b tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json -f qcow2 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:16:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-28c814a1-6730-47d4-92fc-55ccda72609b tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json -f qcow2" returned: 0 in 0.208s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:16:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-28c814a1-6730-47d4-92fc-55ccda72609b tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:16:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-28c814a1-6730-47d4-92fc-55ccda72609b tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.220s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:16:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-28c814a1-6730-47d4-92fc-55ccda72609b tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp95r_b665/24380db648b745b786b1ff6eedc93fb6.delta 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:16:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-28c814a1-6730-47d4-92fc-55ccda72609b tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp95r_b665/24380db648b745b786b1ff6eedc93fb6.delta 1073741824" returned: 0 in 0.051s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:16:54 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-28c814a1-6730-47d4-92fc-55ccda72609b tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 25 21:16:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-28c814a1-6730-47d4-92fc-55ccda72609b tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74189) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 25 21:16:54 user nova-compute[74189]: INFO nova.virt.libvirt.host [None req-28c814a1-6730-47d4-92fc-55ccda72609b tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] UEFI support detected
Oct 25 21:16:55 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-28c814a1-6730-47d4-92fc-55ccda72609b tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74189) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 21:16:55 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-28c814a1-6730-47d4-92fc-55ccda72609b tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74189) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 21:16:55 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-28c814a1-6730-47d4-92fc-55ccda72609b tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 25 21:16:55 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:16:55 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:16:55 user nova-compute[74189]: DEBUG nova.privsep.utils [None req-28c814a1-6730-47d4-92fc-55ccda72609b tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74189) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 21:16:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-28c814a1-6730-47d4-92fc-55ccda72609b tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp95r_b665/24380db648b745b786b1ff6eedc93fb6.delta /opt/stack/data/nova/instances/snapshots/tmp95r_b665/24380db648b745b786b1ff6eedc93fb6 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:16:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:16:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:16:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:16:55 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:16:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4c57363-0107-4567-9842-44a0522f8326/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:16:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:16:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:16:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 21:16:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:16:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:16:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:16:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4c57363-0107-4567-9842-44a0522f8326/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:16:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4c57363-0107-4567-9842-44a0522f8326/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:16:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4c57363-0107-4567-9842-44a0522f8326/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:16:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:16:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-28c814a1-6730-47d4-92fc-55ccda72609b tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp95r_b665/24380db648b745b786b1ff6eedc93fb6.delta /opt/stack/data/nova/instances/snapshots/tmp95r_b665/24380db648b745b786b1ff6eedc93fb6" returned: 0 in 0.715s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:16:56 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-28c814a1-6730-47d4-92fc-55ccda72609b tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Snapshot extracted, beginning image upload
Oct 25 21:16:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:16:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:16:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:16:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:16:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:16:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:16:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:16:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:16:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:16:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:16:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:16:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52fc510-3640-468a-8a9c-b716b9d17a01/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:16:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Acquiring lock "59ab3484-9785-48b4-96fb-1563a6fb8434" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:16:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Lock "59ab3484-9785-48b4-96fb-1563a6fb8434" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:16:57 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Lazy-loading 'flavor' on Instance uuid 59ab3484-9785-48b4-96fb-1563a6fb8434 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:16:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52fc510-3640-468a-8a9c-b716b9d17a01/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:16:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52fc510-3640-468a-8a9c-b716b9d17a01/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Lock "59ab3484-9785-48b4-96fb-1563a6fb8434" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.128s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG nova.compute.manager [req-ffea635d-4663-41d2-bb53-754470a1e41e req-95bcd775-f125-4396-aa3c-9acc17e027a2 service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Received event network-changed-c6a0280f-def7-4677-910c-7a3a3c6b57df {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG nova.compute.manager [req-ffea635d-4663-41d2-bb53-754470a1e41e req-95bcd775-f125-4396-aa3c-9acc17e027a2 service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Refreshing instance network info cache due to event network-changed-c6a0280f-def7-4677-910c-7a3a3c6b57df. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ffea635d-4663-41d2-bb53-754470a1e41e req-95bcd775-f125-4396-aa3c-9acc17e027a2 service nova] Acquiring lock "refresh_cache-5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ffea635d-4663-41d2-bb53-754470a1e41e req-95bcd775-f125-4396-aa3c-9acc17e027a2 service nova] Acquired lock "refresh_cache-5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG nova.network.neutron [req-ffea635d-4663-41d2-bb53-754470a1e41e req-95bcd775-f125-4396-aa3c-9acc17e027a2 service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Refreshing network info cache for port c6a0280f-def7-4677-910c-7a3a3c6b57df {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52fc510-3640-468a-8a9c-b716b9d17a01/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Acquiring lock "59ab3484-9785-48b4-96fb-1563a6fb8434" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Lock "59ab3484-9785-48b4-96fb-1563a6fb8434" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:16:58 user nova-compute[74189]: INFO nova.compute.manager [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Attaching volume 5915584e-8d73-4327-9d13-20acd535b65b to /dev/vdb
Oct 25 21:16:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG os_brick.utils [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f5df76-add8-41bf-817b-3f632d87ecc9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3a38fa-9a44-472b-bf65-5af4684aa712]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce502955-6a28-4974-a1e0-1fb7e008dd67]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0086ab79-440c-42c9-9552-7804f9ed2e69]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:16:58 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:16:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca3a846-0667-40d7-ac7b-b8e18b9386e0]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG os_brick.utils [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Updating existing volume attachment record: 78c52540-8738-4cd8-b1e7-eb693e98b088 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ab3484-9785-48b4-96fb-1563a6fb8434/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ab3484-9785-48b4-96fb-1563a6fb8434/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ab3484-9785-48b4-96fb-1563a6fb8434/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ab3484-9785-48b4-96fb-1563a6fb8434/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:16:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1272f33-ef5e-48e6-912f-e0beae6dde11/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:16:59 user nova-compute[74189]: DEBUG nova.network.neutron [req-ffea635d-4663-41d2-bb53-754470a1e41e req-95bcd775-f125-4396-aa3c-9acc17e027a2 service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Updated VIF entry in instance network info cache for port c6a0280f-def7-4677-910c-7a3a3c6b57df. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:16:59 user nova-compute[74189]: DEBUG nova.network.neutron [req-ffea635d-4663-41d2-bb53-754470a1e41e req-95bcd775-f125-4396-aa3c-9acc17e027a2 service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Updating instance_info_cache with network_info: [{"id": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "address": "fa:16:3e:92:dc:7e", "network": {"id": "197dd483-54ad-4b81-a0d0-26c633b3a101", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1141346509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e426fbc4bb374115a46d927092d62423", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a0280f-de", "ovs_interfaceid": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:16:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ffea635d-4663-41d2-bb53-754470a1e41e req-95bcd775-f125-4396-aa3c-9acc17e027a2 service nova] Releasing lock "refresh_cache-5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:16:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1272f33-ef5e-48e6-912f-e0beae6dde11/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:16:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1272f33-ef5e-48e6-912f-e0beae6dde11/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:16:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1272f33-ef5e-48e6-912f-e0beae6dde11/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:16:59 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:16:59 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:16:59 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=7472MB free_disk=25.484664916992188GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:16:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:16:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:16:59 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-28c814a1-6730-47d4-92fc-55ccda72609b tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Snapshot image upload complete
Oct 25 21:16:59 user nova-compute[74189]: INFO nova.compute.manager [None req-28c814a1-6730-47d4-92fc-55ccda72609b tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Took 6.47 seconds to snapshot the instance on the hypervisor.
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 59ab3484-9785-48b4-96fb-1563a6fb8434 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance d7c3a99a-ab38-4e88-896d-94ae51a09a48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance c69c0800-7a6c-4155-9f90-bbcd323276d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance c4c57363-0107-4567-9842-44a0522f8326 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance ea8d22c5-3868-43d1-b101-c6cff480dea6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance f52fc510-3640-468a-8a9c-b716b9d17a01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance e1272f33-ef5e-48e6-912f-e0beae6dde11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance a05b75c0-c064-42c5-aca7-c4b07cfabcfb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.compute.manager [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:17:00 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Creating image(s)
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Did not create local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Ensure instance console log exists: /opt/stack/data/nova/instances/a05b75c0-c064-42c5-aca7-c4b07cfabcfb/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Start _get_guest_xml network_info=[{"id": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "address": "fa:16:3e:88:75:56", "network": {"id": "75c09903-d1c6-4197-bc70-cfe7f3e7a772", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1909568880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa384e522324f0fa297ca277820909f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd28e4203-5f", "ovs_interfaceid": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fKgarFiL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a05b75c0-c064-42c5-aca7-c4b07cfabcfb', 'attached_at': '', 'detached_at': '', 'volume_id': 'e6efe932-902f-41f8-82f4-1773bc305e0e', 'serial': 'e6efe932-902f-41f8-82f4-1773bc305e0e'}, 'attachment_id': '7d899b8c-97f9-49d7-90c2-aa04cf69c4e2', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:17:00 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:17:00 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG os_brick.initiator.connector [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Factory for ISCSI on None {{(pid=74189) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.009s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fKgarFiL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:17:00 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:17:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:17:00 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:17:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:17:00 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23b15b5-150a-409b-bbfd-1239fd0d0df1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:17:00 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d5ac29-bf57-4608-a298-aceb239e6956]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e] added
Oct 25 21:17:00 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[739a2f61-7f13-4d92-b42f-9ebfa38889a5]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed0e473-0f86-4d2d-a386-8bba40e9c1f8]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fKgarFiL {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.614s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fKgarFiL" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f7e6db-0ed7-4154-8f1a-a209d3ae3b9f]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fKgarFiL'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e187c17-7424-480f-b675-327140467416]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9138d8e8-0547-4b28-ae18-755746edc02e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 21:17:00 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 21:17:00 user nova-compute[74189]:  {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:17:00 user nova-compute[74189]: WARNING os_brick.initiator.connectors.iscsi [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 21:17:00 user nova-compute[74189]: 
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[db01db2f-578e-4e84-aeba-6f4293084c46]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e, portal: 172.16.0.220,3260]
Oct 25 21:17:00 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e, portal: 172.16.0.220,3260] successful.
Oct 25 21:17:00 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5ca7c8-8986-448c-853d-e2639c4e9fc8]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b31d76-bbc7-459c-8e2b-02d6887b00ed]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:17:00 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:17:00 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a07f3c4-fe4c-43cc-99ea-f4114c5f6395]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:00 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-d7c3a99a-ab38-4e88-896d-94ae51a09a48" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-d7c3a99a-ab38-4e88-896d-94ae51a09a48" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fKgarFiL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23733653333316463', 'path': '/dev/sdb'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733653333316463', 'path': '/dev/sdb'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:16:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1904014555',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1904014555',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVLWL/l3Vh79OaGgsN5D2te6r87t4qcVR5zA3W/Bg4mTE1zl7sJSoyjbQnhD3AeWV9gsQAwGKkMtvg9ZV6+YMk7vzNB4DgcV0PFaLz2rgjVpHTuxF9n1BWLqiTcunhiVw==',key_name='tempest-keypair-1447510267',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4aa384e522324f0fa297ca277820909f',ramdisk_id='',reservation_id='r-z4gtu1al',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1192138157',owner_user_name='tempest-ServerActionsV293TestJSON-1192138157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:16:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df67ddee61b04820b0968636a2eddbed',uuid=a05b75c0-c064-42c5-aca7-c4b07cfabcfb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "address": "fa:16:3e:88:75:56", "network": {"id": "75c09903-d1c6-4197-bc70-cfe7f3e7a772", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1909568880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa384e522324f0fa297ca277820909f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd28e4203-5f", "ovs_interfaceid": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Converting VIF {"id": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "address": "fa:16:3e:88:75:56", "network": {"id": "75c09903-d1c6-4197-bc70-cfe7f3e7a772", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1909568880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa384e522324f0fa297ca277820909f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd28e4203-5f", "ovs_interfaceid": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:75:56,bridge_name='br-int',has_traffic_filtering=True,id=d28e4203-5fff-4a0b-b360-fe29bfa131b8,network=Network(75c09903-d1c6-4197-bc70-cfe7f3e7a772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd28e4203-5f') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG nova.objects.instance [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lazy-loading 'pci_devices' on Instance uuid a05b75c0-c064-42c5-aca7-c4b07cfabcfb {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:17:01 user nova-compute[74189]:   <uuid>a05b75c0-c064-42c5-aca7-c4b07cfabcfb</uuid>
Oct 25 21:17:01 user nova-compute[74189]:   <name>instance-00000009</name>
Oct 25 21:17:01 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:17:01 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:17:01 user nova-compute[74189]:   <metadata>
Oct 25 21:17:01 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:17:01 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:17:01 user nova-compute[74189]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1904014555</nova:name>
Oct 25 21:17:01 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:17:00</nova:creationTime>
Oct 25 21:17:01 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:17:01 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:17:01 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:17:01 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:17:01 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:17:01 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:17:01 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:17:01 user nova-compute[74189]:       <nova:owner>
Oct 25 21:17:01 user nova-compute[74189]:         <nova:user uuid="df67ddee61b04820b0968636a2eddbed">tempest-ServerActionsV293TestJSON-1192138157-project-member</nova:user>
Oct 25 21:17:01 user nova-compute[74189]:         <nova:project uuid="4aa384e522324f0fa297ca277820909f">tempest-ServerActionsV293TestJSON-1192138157</nova:project>
Oct 25 21:17:01 user nova-compute[74189]:       </nova:owner>
Oct 25 21:17:01 user nova-compute[74189]:       <nova:ports>
Oct 25 21:17:01 user nova-compute[74189]:         <nova:port uuid="d28e4203-5fff-4a0b-b360-fe29bfa131b8">
Oct 25 21:17:01 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 25 21:17:01 user nova-compute[74189]:         </nova:port>
Oct 25 21:17:01 user nova-compute[74189]:       </nova:ports>
Oct 25 21:17:01 user nova-compute[74189]:     </nova:instance>
Oct 25 21:17:01 user nova-compute[74189]:   </metadata>
Oct 25 21:17:01 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:17:01 user nova-compute[74189]:     <system>
Oct 25 21:17:01 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:17:01 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:17:01 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:17:01 user nova-compute[74189]:       <entry name="serial">a05b75c0-c064-42c5-aca7-c4b07cfabcfb</entry>
Oct 25 21:17:01 user nova-compute[74189]:       <entry name="uuid">a05b75c0-c064-42c5-aca7-c4b07cfabcfb</entry>
Oct 25 21:17:01 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:17:01 user nova-compute[74189]:     </system>
Oct 25 21:17:01 user nova-compute[74189]:   </sysinfo>
Oct 25 21:17:01 user nova-compute[74189]:   <os>
Oct 25 21:17:01 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:17:01 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:17:01 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:17:01 user nova-compute[74189]:   </os>
Oct 25 21:17:01 user nova-compute[74189]:   <features>
Oct 25 21:17:01 user nova-compute[74189]:     <acpi/>
Oct 25 21:17:01 user nova-compute[74189]:     <apic/>
Oct 25 21:17:01 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:17:01 user nova-compute[74189]:   </features>
Oct 25 21:17:01 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:17:01 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:17:01 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:17:01 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:17:01 user nova-compute[74189]:   </clock>
Oct 25 21:17:01 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:17:01 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:17:01 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:17:01 user nova-compute[74189]:   </cpu>
Oct 25 21:17:01 user nova-compute[74189]:   <devices>
Oct 25 21:17:01 user nova-compute[74189]:     <disk type="block" device="disk">
Oct 25 21:17:01 user nova-compute[74189]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:17:01 user nova-compute[74189]:       <source dev="/dev/sdb"/>
Oct 25 21:17:01 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:17:01 user nova-compute[74189]:       <serial>e6efe932-902f-41f8-82f4-1773bc305e0e</serial>
Oct 25 21:17:01 user nova-compute[74189]:     </disk>
Oct 25 21:17:01 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:17:01 user nova-compute[74189]:       <mac address="fa:16:3e:88:75:56"/>
Oct 25 21:17:01 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:17:01 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:17:01 user nova-compute[74189]:       <target dev="tapd28e4203-5f"/>
Oct 25 21:17:01 user nova-compute[74189]:     </interface>
Oct 25 21:17:01 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:17:01 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/a05b75c0-c064-42c5-aca7-c4b07cfabcfb/console.log" append="off"/>
Oct 25 21:17:01 user nova-compute[74189]:     </serial>
Oct 25 21:17:01 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:17:01 user nova-compute[74189]:     <video>
Oct 25 21:17:01 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:17:01 user nova-compute[74189]:     </video>
Oct 25 21:17:01 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:17:01 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:17:01 user nova-compute[74189]:     </rng>
Oct 25 21:17:01 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:17:01 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:17:01 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:17:01 user nova-compute[74189]:     </memballoon>
Oct 25 21:17:01 user nova-compute[74189]:   </devices>
Oct 25 21:17:01 user nova-compute[74189]: </domain>
Oct 25 21:17:01 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:16:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1904014555',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1904014555',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVLWL/l3Vh79OaGgsN5D2te6r87t4qcVR5zA3W/Bg4mTE1zl7sJSoyjbQnhD3AeWV9gsQAwGKkMtvg9ZV6+YMk7vzNB4DgcV0PFaLz2rgjVpHTuxF9n1BWLqiTcunhiVw==',key_name='tempest-keypair-1447510267',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4aa384e522324f0fa297ca277820909f',ramdisk_id='',reservation_id='r-z4gtu1al',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1192138157',owner_user_name='tempest-ServerActionsV293TestJSON-1192138157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:16:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df67ddee61b04820b0968636a2eddbed',uuid=a05b75c0-c064-42c5-aca7-c4b07cfabcfb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "address": "fa:16:3e:88:75:56", "network": {"id": "75c09903-d1c6-4197-bc70-cfe7f3e7a772", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1909568880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa384e522324f0fa297ca277820909f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd28e4203-5f", "ovs_interfaceid": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Converting VIF {"id": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "address": "fa:16:3e:88:75:56", "network": {"id": "75c09903-d1c6-4197-bc70-cfe7f3e7a772", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1909568880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa384e522324f0fa297ca277820909f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd28e4203-5f", "ovs_interfaceid": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:75:56,bridge_name='br-int',has_traffic_filtering=True,id=d28e4203-5fff-4a0b-b360-fe29bfa131b8,network=Network(75c09903-d1c6-4197-bc70-cfe7f3e7a772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd28e4203-5f') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG os_vif [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:75:56,bridge_name='br-int',has_traffic_filtering=True,id=d28e4203-5fff-4a0b-b360-fe29bfa131b8,network=Network(75c09903-d1c6-4197-bc70-cfe7f3e7a772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd28e4203-5f') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e7fc0d96-a22d-5586-abba-8e20fdea4cd6', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd28e4203-5f, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd28e4203-5f, col_values=(('qos', UUID('9145ac1d-b125-4d92-9f1c-f7483b2a609f')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd28e4203-5f, col_values=(('external_ids', {'iface-id': 'd28e4203-5fff-4a0b-b360-fe29bfa131b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:75:56', 'vm-uuid': 'a05b75c0-c064-42c5-aca7-c4b07cfabcfb'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:01 user nova-compute[74189]: INFO os_vif [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:75:56,bridge_name='br-int',has_traffic_filtering=True,id=d28e4203-5fff-4a0b-b360-fe29bfa131b8,network=Network(75c09903-d1c6-4197-bc70-cfe7f3e7a772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd28e4203-5f')
Oct 25 21:17:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:17:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] No VIF found with MAC fa:16:3e:88:75:56, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:17:02 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Updating instance_info_cache with network_info: [{"id": "44169902-69da-4fe1-8292-a23e0ff15fc7", "address": "fa:16:3e:b9:37:c6", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44169902-69", "ovs_interfaceid": "44169902-69da-4fe1-8292-a23e0ff15fc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:17:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-d7c3a99a-ab38-4e88-896d-94ae51a09a48" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:17:02 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:17:02 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:17:02 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:17:02 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:17:02 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:17:02 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:17:02 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:17:02 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:17:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-2f504efd-89bf-4ed9-82f2-a0fcde083a5e req-6ac4649e-bd5b-4560-a620-9443ff75a3d7 service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Received event network-vif-plugged-d28e4203-5fff-4a0b-b360-fe29bfa131b8 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:17:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2f504efd-89bf-4ed9-82f2-a0fcde083a5e req-6ac4649e-bd5b-4560-a620-9443ff75a3d7 service nova] Acquiring lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:17:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2f504efd-89bf-4ed9-82f2-a0fcde083a5e req-6ac4649e-bd5b-4560-a620-9443ff75a3d7 service nova] Lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:17:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2f504efd-89bf-4ed9-82f2-a0fcde083a5e req-6ac4649e-bd5b-4560-a620-9443ff75a3d7 service nova] Lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:17:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-2f504efd-89bf-4ed9-82f2-a0fcde083a5e req-6ac4649e-bd5b-4560-a620-9443ff75a3d7 service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] No waiting events found dispatching network-vif-plugged-d28e4203-5fff-4a0b-b360-fe29bfa131b8 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:17:03 user nova-compute[74189]: WARNING nova.compute.manager [req-2f504efd-89bf-4ed9-82f2-a0fcde083a5e req-6ac4649e-bd5b-4560-a620-9443ff75a3d7 service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Received unexpected event network-vif-plugged-d28e4203-5fff-4a0b-b360-fe29bfa131b8 for instance with vm_state building and task_state spawning.
Oct 25 21:17:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:05 user nova-compute[74189]: DEBUG nova.compute.manager [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:17:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:17:05 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Instance spawned successfully.
Oct 25 21:17:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:17:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:17:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:17:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:17:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:17:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:17:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:17:05 user nova-compute[74189]: DEBUG nova.compute.manager [req-50db3978-bdcd-4b39-91f3-4ecd4a931022 req-d5df726b-be91-44f2-8a1d-b12007fa6e43 service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Received event network-vif-plugged-d28e4203-5fff-4a0b-b360-fe29bfa131b8 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:17:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-50db3978-bdcd-4b39-91f3-4ecd4a931022 req-d5df726b-be91-44f2-8a1d-b12007fa6e43 service nova] Acquiring lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:17:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-50db3978-bdcd-4b39-91f3-4ecd4a931022 req-d5df726b-be91-44f2-8a1d-b12007fa6e43 service nova] Lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:17:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-50db3978-bdcd-4b39-91f3-4ecd4a931022 req-d5df726b-be91-44f2-8a1d-b12007fa6e43 service nova] Lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:17:05 user nova-compute[74189]: DEBUG nova.compute.manager [req-50db3978-bdcd-4b39-91f3-4ecd4a931022 req-d5df726b-be91-44f2-8a1d-b12007fa6e43 service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] No waiting events found dispatching network-vif-plugged-d28e4203-5fff-4a0b-b360-fe29bfa131b8 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:17:05 user nova-compute[74189]: WARNING nova.compute.manager [req-50db3978-bdcd-4b39-91f3-4ecd4a931022 req-d5df726b-be91-44f2-8a1d-b12007fa6e43 service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Received unexpected event network-vif-plugged-d28e4203-5fff-4a0b-b360-fe29bfa131b8 for instance with vm_state building and task_state spawning.
Oct 25 21:17:05 user nova-compute[74189]: INFO nova.compute.manager [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Took 5.23 seconds to spawn the instance on the hypervisor.
Oct 25 21:17:05 user nova-compute[74189]: DEBUG nova.compute.manager [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:17:05 user nova-compute[74189]: INFO nova.compute.manager [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Took 41.25 seconds to build instance.
Oct 25 21:17:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-579e42f6-40cc-47a3-88d1-224c20b55ab3 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.349s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:17:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:08 user nova-compute[74189]: DEBUG nova.compute.manager [req-e8b2cd6f-7ba4-44e7-96ec-11e01f2abe6b req-fd717b29-1e13-4b44-9473-65fcab934d91 service nova] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Received event network-changed-e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:17:08 user nova-compute[74189]: DEBUG nova.compute.manager [req-e8b2cd6f-7ba4-44e7-96ec-11e01f2abe6b req-fd717b29-1e13-4b44-9473-65fcab934d91 service nova] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Refreshing instance network info cache due to event network-changed-e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:17:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e8b2cd6f-7ba4-44e7-96ec-11e01f2abe6b req-fd717b29-1e13-4b44-9473-65fcab934d91 service nova] Acquiring lock "refresh_cache-c69c0800-7a6c-4155-9f90-bbcd323276d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:17:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e8b2cd6f-7ba4-44e7-96ec-11e01f2abe6b req-fd717b29-1e13-4b44-9473-65fcab934d91 service nova] Acquired lock "refresh_cache-c69c0800-7a6c-4155-9f90-bbcd323276d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:17:08 user nova-compute[74189]: DEBUG nova.network.neutron [req-e8b2cd6f-7ba4-44e7-96ec-11e01f2abe6b req-fd717b29-1e13-4b44-9473-65fcab934d91 service nova] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Refreshing network info cache for port e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:17:08 user nova-compute[74189]: DEBUG nova.network.neutron [req-e8b2cd6f-7ba4-44e7-96ec-11e01f2abe6b req-fd717b29-1e13-4b44-9473-65fcab934d91 service nova] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Updated VIF entry in instance network info cache for port e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:17:08 user nova-compute[74189]: DEBUG nova.network.neutron [req-e8b2cd6f-7ba4-44e7-96ec-11e01f2abe6b req-fd717b29-1e13-4b44-9473-65fcab934d91 service nova] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Updating instance_info_cache with network_info: [{"id": "e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc", "address": "fa:16:3e:50:70:e6", "network": {"id": "093e46a2-3a83-46b5-a13b-661868863db1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1577201171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09c2027cbebd4ffd9989ba14156beeba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3d8e995-9e", "ovs_interfaceid": "e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:17:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e8b2cd6f-7ba4-44e7-96ec-11e01f2abe6b req-fd717b29-1e13-4b44-9473-65fcab934d91 service nova] Releasing lock "refresh_cache-c69c0800-7a6c-4155-9f90-bbcd323276d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:17:11 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:12 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Acquiring lock "c69c0800-7a6c-4155-9f90-bbcd323276d3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:17:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "c69c0800-7a6c-4155-9f90-bbcd323276d3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:17:14 user nova-compute[74189]: DEBUG nova.objects.instance [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lazy-loading 'flavor' on Instance uuid c69c0800-7a6c-4155-9f90-bbcd323276d3 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:17:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "c69c0800-7a6c-4155-9f90-bbcd323276d3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:17:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Acquiring lock "c69c0800-7a6c-4155-9f90-bbcd323276d3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:17:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "c69c0800-7a6c-4155-9f90-bbcd323276d3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:17:15 user nova-compute[74189]: INFO nova.compute.manager [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Attaching volume 9682943b-f798-4b94-8f02-2ccc165c64e0 to /dev/vdb
Oct 25 21:17:15 user nova-compute[74189]: DEBUG os_brick.utils [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:17:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:15 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5845b4-5339-41c0-9b5c-f11d11e34bf2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:15 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[892b0bba-5342-4823-b881-5eaef0f3e218]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:15 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[594a2e92-7bde-44dc-87fc-672b1cc9964f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:15 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[625f78dc-50d6-4784-9150-a6af2c51daec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:17:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:17:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:17:15 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:17:15 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6308ccf0-23a7-473e-883e-89ff858b03a5]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:17:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:17:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:17:15 user nova-compute[74189]: DEBUG os_brick.utils [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:17:15 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Updating existing volume attachment record: a2322206-db83-4710-8a88-0efc139dd00b {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:17:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Acquiring lock "2486ac33-a881-4be1-a24e-2ff263e51818" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:17:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Lock "2486ac33-a881-4be1-a24e-2ff263e51818" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:17:18 user nova-compute[74189]: DEBUG nova.compute.manager [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:17:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:17:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:17:18 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:17:18 user nova-compute[74189]: INFO nova.compute.claims [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Claim successful on node user
Oct 25 21:17:18 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:17:18 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:17:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.627s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:17:18 user nova-compute[74189]: DEBUG nova.compute.manager [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG nova.compute.manager [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG nova.network.neutron [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:17:19 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:17:19 user nova-compute[74189]: DEBUG nova.compute.manager [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:17:19 user nova-compute[74189]: INFO nova.virt.block_device [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Booting with volume 41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 at /dev/vda
Oct 25 21:17:19 user nova-compute[74189]: DEBUG nova.policy [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81350af1f40549588189c612bf5ec551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e30ef76a7fd4aa39509e875017185d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG os_brick.utils [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed786469-350e-478b-86f4-bb1ce1c204ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3981b7e9-3ce7-4ba1-aed5-dcc071b52918]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba27e36-53f7-4106-b7db-ef402437adf1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bc7872-3e72-460b-9594-e8d7f6cb92f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:17:19 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:17:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[08777a43-7fb6-451d-9abb-af26d6ead67c]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG os_brick.utils [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Updating existing volume attachment record: f4e88b25-b05b-48a9-a145-d66273a75aac {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG nova.network.neutron [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Successfully created port: a334be31-0990-4647-b215-2553698e0050 {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DtywrEVX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:17:19 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:17:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:17:19 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:17:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:17:19 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:17:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a89047-9a66-4d9a-a646-ec84e254ec8d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:17:19 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb25389-f2d4-4972-8195-44ef13c5b0c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b] added
Oct 25 21:17:19 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7d4e01-b70b-4e3e-87a9-f8324ac4489c]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.039s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c9ed96-66c4-4b96-a7a8-849d35e95d3b]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DtywrEVX {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DtywrEVX" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c619e221-649c-45bc-bd00-288a15a65c44]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DtywrEVX'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bfe029-febe-43d4-ba66-108903e3095d]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4084d86b-16ca-4842-acfc-a55753a956e2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:17:20 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:17:20 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[26673483-c87a-4e18-b106-a74395ff91f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b, portal: 172.16.0.220,3260]
Oct 25 21:17:20 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b, portal: 172.16.0.220,3260] successful.
Oct 25 21:17:20 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96f0e78-d488-4c1c-bd6a-fe8c71bd30cb]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb679c7-5151-41f2-a472-e70af9c6fd23]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:17:20 user nova-compute[74189]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b (non-flash)
Oct 25 21:17:20 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:17:20 user nova-compute[74189]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b (non-flash)
Oct 25 21:17:20 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.069s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d35f70-1f7c-4da4-b36c-76cb34a237a1]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG nova.network.neutron [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Successfully created port: 81b93608-6fb4-4753-8328-df418f6d3ffe {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:17:20 user nova-compute[74189]: DEBUG nova.network.neutron [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Successfully created port: 3fad83a5-d1c9-43d7-9dbd-16970bbb93b3 {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:17:21 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:17:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DtywrEVX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:17:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:17:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] <== connect_volume: return (1429ms) {'type': 'block', 'scsi_wwn': '23762336535363938', 'path': '/dev/sdc'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:17:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762336535363938', 'path': '/dev/sdc'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:17:21 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Lazy-loading 'flavor' on Instance uuid 59ab3484-9785-48b4-96fb-1563a6fb8434 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:17:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 21:17:21 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:17:21 user nova-compute[74189]:   <source dev="/dev/sdc"/>
Oct 25 21:17:21 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:17:21 user nova-compute[74189]:   <serial>5915584e-8d73-4327-9d13-20acd535b65b</serial>
Oct 25 21:17:21 user nova-compute[74189]: </disk>
Oct 25 21:17:21 user nova-compute[74189]:  {{(pid=74189) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 21:17:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:17:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:17:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] No VIF found with MAC fa:16:3e:0c:3e:53, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:17:21 user nova-compute[74189]: DEBUG nova.network.neutron [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Successfully created port: 532714b6-a025-43e3-bf7b-87f8159ed408 {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:17:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a7dfbb18-634f-4049-8388-b8b6b5f3dc31 tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Lock "59ab3484-9785-48b4-96fb-1563a6fb8434" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.707s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:17:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:22 user nova-compute[74189]: DEBUG nova.network.neutron [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Successfully created port: a918de57-be1e-4ddd-b593-533130578da6 {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:17:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Acquiring lock "59ab3484-9785-48b4-96fb-1563a6fb8434" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:17:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Lock "59ab3484-9785-48b4-96fb-1563a6fb8434" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:17:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Acquiring lock "59ab3484-9785-48b4-96fb-1563a6fb8434-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:17:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Lock "59ab3484-9785-48b4-96fb-1563a6fb8434-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:17:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Lock "59ab3484-9785-48b4-96fb-1563a6fb8434-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:17:22 user nova-compute[74189]: INFO nova.compute.manager [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Terminating instance
Oct 25 21:17:22 user nova-compute[74189]: DEBUG nova.compute.manager [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:17:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:22 user nova-compute[74189]: DEBUG nova.compute.manager [req-f9c72bfb-a50c-4b5b-b562-31376802e0f5 req-675f2305-5f96-47f7-9057-c4d6aba0e9e4 service nova] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Received event network-vif-unplugged-9c2c5804-3d81-4e3a-9c17-073b1dc171e3 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:17:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f9c72bfb-a50c-4b5b-b562-31376802e0f5 req-675f2305-5f96-47f7-9057-c4d6aba0e9e4 service nova] Acquiring lock "59ab3484-9785-48b4-96fb-1563a6fb8434-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:17:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f9c72bfb-a50c-4b5b-b562-31376802e0f5 req-675f2305-5f96-47f7-9057-c4d6aba0e9e4 service nova] Lock "59ab3484-9785-48b4-96fb-1563a6fb8434-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:17:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f9c72bfb-a50c-4b5b-b562-31376802e0f5 req-675f2305-5f96-47f7-9057-c4d6aba0e9e4 service nova] Lock "59ab3484-9785-48b4-96fb-1563a6fb8434-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:17:22 user nova-compute[74189]: DEBUG nova.compute.manager [req-f9c72bfb-a50c-4b5b-b562-31376802e0f5 req-675f2305-5f96-47f7-9057-c4d6aba0e9e4 service nova] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] No waiting events found dispatching network-vif-unplugged-9c2c5804-3d81-4e3a-9c17-073b1dc171e3 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:17:22 user nova-compute[74189]: DEBUG nova.compute.manager [req-f9c72bfb-a50c-4b5b-b562-31376802e0f5 req-675f2305-5f96-47f7-9057-c4d6aba0e9e4 service nova] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Received event network-vif-unplugged-9c2c5804-3d81-4e3a-9c17-073b1dc171e3 for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG nova.network.neutron [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Successfully updated port: a334be31-0990-4647-b215-2553698e0050 {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG nova.compute.manager [req-b5e963d1-0608-4433-91e2-816104d68c23 req-c4a683db-82ce-407d-ac5b-d30c66a1e194 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-changed-a334be31-0990-4647-b215-2553698e0050 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG nova.compute.manager [req-b5e963d1-0608-4433-91e2-816104d68c23 req-c4a683db-82ce-407d-ac5b-d30c66a1e194 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Refreshing instance network info cache due to event network-changed-a334be31-0990-4647-b215-2553698e0050. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b5e963d1-0608-4433-91e2-816104d68c23 req-c4a683db-82ce-407d-ac5b-d30c66a1e194 service nova] Acquiring lock "refresh_cache-2486ac33-a881-4be1-a24e-2ff263e51818" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b5e963d1-0608-4433-91e2-816104d68c23 req-c4a683db-82ce-407d-ac5b-d30c66a1e194 service nova] Acquired lock "refresh_cache-2486ac33-a881-4be1-a24e-2ff263e51818" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG nova.network.neutron [req-b5e963d1-0608-4433-91e2-816104d68c23 req-c4a683db-82ce-407d-ac5b-d30c66a1e194 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Refreshing network info cache for port a334be31-0990-4647-b215-2553698e0050 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG nova.compute.manager [req-8b4ccf2a-913f-478e-9762-aac55c7524f9 req-28fc4a16-0a33-4131-a99f-8483133c8a1f service nova] [instance: c4c57363-0107-4567-9842-44a0522f8326] Received event network-changed-032dd7a9-5ab8-4e42-883a-3ce412b9ee1d {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG nova.compute.manager [req-8b4ccf2a-913f-478e-9762-aac55c7524f9 req-28fc4a16-0a33-4131-a99f-8483133c8a1f service nova] [instance: c4c57363-0107-4567-9842-44a0522f8326] Refreshing instance network info cache due to event network-changed-032dd7a9-5ab8-4e42-883a-3ce412b9ee1d. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8b4ccf2a-913f-478e-9762-aac55c7524f9 req-28fc4a16-0a33-4131-a99f-8483133c8a1f service nova] Acquiring lock "refresh_cache-c4c57363-0107-4567-9842-44a0522f8326" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8b4ccf2a-913f-478e-9762-aac55c7524f9 req-28fc4a16-0a33-4131-a99f-8483133c8a1f service nova] Acquired lock "refresh_cache-c4c57363-0107-4567-9842-44a0522f8326" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG nova.network.neutron [req-8b4ccf2a-913f-478e-9762-aac55c7524f9 req-28fc4a16-0a33-4131-a99f-8483133c8a1f service nova] [instance: c4c57363-0107-4567-9842-44a0522f8326] Refreshing network info cache for port 032dd7a9-5ab8-4e42-883a-3ce412b9ee1d {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG nova.network.neutron [req-b5e963d1-0608-4433-91e2-816104d68c23 req-c4a683db-82ce-407d-ac5b-d30c66a1e194 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:17:23 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Instance destroyed successfully.
Oct 25 21:17:23 user nova-compute[74189]: DEBUG nova.objects.instance [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Lazy-loading 'resources' on Instance uuid 59ab3484-9785-48b4-96fb-1563a6fb8434 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:15:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1093579140',display_name='tempest-DeleteServersTestJSON-server-1093579140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1093579140',id=1,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:15:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2aaccb94133476fbded17c902219c2a',ramdisk_id='',reservation_id='r-o2zgbk44',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-500805402',owner_user_name='tempest-DeleteServersTestJSON-500805402-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:15:15Z,user_data=None,user_id='1a8198d38ce4478a8fa932223d9b0dcb',uuid=59ab3484-9785-48b4-96fb-1563a6fb8434,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c2c5804-3d81-4e3a-9c17-073b1dc171e3", "address": "fa:16:3e:0c:3e:53", "network": {"id": "606f4918-8904-4548-9cfd-b1e0c1eed7ee", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1638907501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2aaccb94133476fbded17c902219c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c2c5804-3d", "ovs_interfaceid": "9c2c5804-3d81-4e3a-9c17-073b1dc171e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Converting VIF {"id": "9c2c5804-3d81-4e3a-9c17-073b1dc171e3", "address": "fa:16:3e:0c:3e:53", "network": {"id": "606f4918-8904-4548-9cfd-b1e0c1eed7ee", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1638907501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2aaccb94133476fbded17c902219c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c2c5804-3d", "ovs_interfaceid": "9c2c5804-3d81-4e3a-9c17-073b1dc171e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:3e:53,bridge_name='br-int',has_traffic_filtering=True,id=9c2c5804-3d81-4e3a-9c17-073b1dc171e3,network=Network(606f4918-8904-4548-9cfd-b1e0c1eed7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c2c5804-3d') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG os_vif [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:3e:53,bridge_name='br-int',has_traffic_filtering=True,id=9c2c5804-3d81-4e3a-9c17-073b1dc171e3,network=Network(606f4918-8904-4548-9cfd-b1e0c1eed7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c2c5804-3d') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c2c5804-3d, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7244d44-6d98-4278-a585-8c3f132fe7c1) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:23 user nova-compute[74189]: INFO os_vif [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:3e:53,bridge_name='br-int',has_traffic_filtering=True,id=9c2c5804-3d81-4e3a-9c17-073b1dc171e3,network=Network(606f4918-8904-4548-9cfd-b1e0c1eed7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c2c5804-3d')
Oct 25 21:17:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DtywrEVX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:17:23 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:17:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e088878b-df7c-4c28-9651-dc7f7cd32ac5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:17:23 user nova-compute[74189]: No targets found.
Oct 25 21:17:23 user nova-compute[74189]: iSNS:
Oct 25 21:17:23 user nova-compute[74189]: No targets found.
Oct 25 21:17:23 user nova-compute[74189]: STATIC:
Oct 25 21:17:23 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e
Oct 25 21:17:23 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:17:23 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:17:23 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b
Oct 25 21:17:23 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:17:23 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:17:23 user nova-compute[74189]: FIRMWARE:
Oct 25 21:17:23 user nova-compute[74189]: No targets found.
Oct 25 21:17:23 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:17:23 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:17:23 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[32dee938-a26d-41ad-9bde-c755c898c720]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[879204b2-8e54-481e-b9be-c8181f8a9174]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:17:23 user nova-compute[74189]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b (non-flash)
Oct 25 21:17:23 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:17:23 user nova-compute[74189]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b (non-flash)
Oct 25 21:17:23 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3042c20e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b'): ({'sdc'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Removing single pathed devices sdc {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9d4bb9-84f7-4425-8334-2d0a152dd788]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9960a8-6a70-49d0-b5b3-8b359ea09ed1]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Flushing IO for device /dev/sdc {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1783b291-0e29-44b7-9caf-6da2304cafad]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e595c440-4fdc-4b7c-ae25-f3a9342505d2]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] SCSI volumes sdc have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08308e9-b298-4929-babf-a2cec8d12a9a]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[133c2164-47b9-4e55-ba27-f0d212e63c3b]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b, portal: 172.16.0.220,3260]
Oct 25 21:17:23 user nova-compute[74189]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b, portal: 172.16.0.220,3260] successful.
Oct 25 21:17:23 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5915584e-8d73-4327-9d13-20acd535b65b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[716792f4-95a7-4995-84f9-ea5e9f342706]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] <== disconnect_volume: return (338ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:17:23 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Deleting instance files /opt/stack/data/nova/instances/59ab3484-9785-48b4-96fb-1563a6fb8434_del
Oct 25 21:17:23 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Deletion of /opt/stack/data/nova/instances/59ab3484-9785-48b4-96fb-1563a6fb8434_del complete
Oct 25 21:17:23 user nova-compute[74189]: DEBUG nova.network.neutron [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Successfully updated port: a96d3bd5-5996-4171-87ef-082bfe44bb78 {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG nova.network.neutron [req-8b4ccf2a-913f-478e-9762-aac55c7524f9 req-28fc4a16-0a33-4131-a99f-8483133c8a1f service nova] [instance: c4c57363-0107-4567-9842-44a0522f8326] Updated VIF entry in instance network info cache for port 032dd7a9-5ab8-4e42-883a-3ce412b9ee1d. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG nova.network.neutron [req-8b4ccf2a-913f-478e-9762-aac55c7524f9 req-28fc4a16-0a33-4131-a99f-8483133c8a1f service nova] [instance: c4c57363-0107-4567-9842-44a0522f8326] Updating instance_info_cache with network_info: [{"id": "032dd7a9-5ab8-4e42-883a-3ce412b9ee1d", "address": "fa:16:3e:06:5b:93", "network": {"id": "fc681f29-44fb-4260-abab-c3cf730ae62f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-404557441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9669b7ed3a8846fb8e90800fe65a271d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap032dd7a9-5a", "ovs_interfaceid": "032dd7a9-5ab8-4e42-883a-3ce412b9ee1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG nova.network.neutron [req-b5e963d1-0608-4433-91e2-816104d68c23 req-c4a683db-82ce-407d-ac5b-d30c66a1e194 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8b4ccf2a-913f-478e-9762-aac55c7524f9 req-28fc4a16-0a33-4131-a99f-8483133c8a1f service nova] Releasing lock "refresh_cache-c4c57363-0107-4567-9842-44a0522f8326" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b5e963d1-0608-4433-91e2-816104d68c23 req-c4a683db-82ce-407d-ac5b-d30c66a1e194 service nova] Releasing lock "refresh_cache-2486ac33-a881-4be1-a24e-2ff263e51818" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:17:23 user nova-compute[74189]: INFO nova.compute.manager [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Took 1.36 seconds to destroy the instance on the hypervisor.
Oct 25 21:17:23 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:17:23 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:17:24 user nova-compute[74189]: DEBUG nova.network.neutron [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Successfully updated port: f10bc396-91ea-4493-8521-69881612dd9f {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:17:24 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:17:24 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Took 0.81 seconds to deallocate network for instance.
Oct 25 21:17:25 user nova-compute[74189]: DEBUG nova.compute.manager [req-1d19495f-827d-4284-b9c1-8c5cbd7618d0 req-be0c832b-4532-4672-ad0a-04eb612d35ca service nova] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Received event network-vif-plugged-9c2c5804-3d81-4e3a-9c17-073b1dc171e3 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:17:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1d19495f-827d-4284-b9c1-8c5cbd7618d0 req-be0c832b-4532-4672-ad0a-04eb612d35ca service nova] Acquiring lock "59ab3484-9785-48b4-96fb-1563a6fb8434-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:17:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1d19495f-827d-4284-b9c1-8c5cbd7618d0 req-be0c832b-4532-4672-ad0a-04eb612d35ca service nova] Lock "59ab3484-9785-48b4-96fb-1563a6fb8434-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:17:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1d19495f-827d-4284-b9c1-8c5cbd7618d0 req-be0c832b-4532-4672-ad0a-04eb612d35ca service nova] Lock "59ab3484-9785-48b4-96fb-1563a6fb8434-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:17:25 user nova-compute[74189]: DEBUG nova.compute.manager [req-1d19495f-827d-4284-b9c1-8c5cbd7618d0 req-be0c832b-4532-4672-ad0a-04eb612d35ca service nova] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] No waiting events found dispatching network-vif-plugged-9c2c5804-3d81-4e3a-9c17-073b1dc171e3 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:17:25 user nova-compute[74189]: WARNING nova.compute.manager [req-1d19495f-827d-4284-b9c1-8c5cbd7618d0 req-be0c832b-4532-4672-ad0a-04eb612d35ca service nova] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Received unexpected event network-vif-plugged-9c2c5804-3d81-4e3a-9c17-073b1dc171e3 for instance with vm_state active and task_state deleting.
Oct 25 21:17:25 user nova-compute[74189]: DEBUG nova.compute.manager [req-1d19495f-827d-4284-b9c1-8c5cbd7618d0 req-be0c832b-4532-4672-ad0a-04eb612d35ca service nova] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Received event network-vif-deleted-9c2c5804-3d81-4e3a-9c17-073b1dc171e3 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:17:25 user nova-compute[74189]: DEBUG nova.network.neutron [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Successfully updated port: 81b93608-6fb4-4753-8328-df418f6d3ffe {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:17:25 user nova-compute[74189]: DEBUG nova.compute.manager [req-05c4f053-0a82-46f1-8b3e-4d59e5ed70a8 req-6d64d620-0182-460d-92a6-c3e82a86a62c service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-changed-a96d3bd5-5996-4171-87ef-082bfe44bb78 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:17:25 user nova-compute[74189]: DEBUG nova.compute.manager [req-05c4f053-0a82-46f1-8b3e-4d59e5ed70a8 req-6d64d620-0182-460d-92a6-c3e82a86a62c service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Refreshing instance network info cache due to event network-changed-a96d3bd5-5996-4171-87ef-082bfe44bb78. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:17:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-05c4f053-0a82-46f1-8b3e-4d59e5ed70a8 req-6d64d620-0182-460d-92a6-c3e82a86a62c service nova] Acquiring lock "refresh_cache-2486ac33-a881-4be1-a24e-2ff263e51818" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:17:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-05c4f053-0a82-46f1-8b3e-4d59e5ed70a8 req-6d64d620-0182-460d-92a6-c3e82a86a62c service nova] Acquired lock "refresh_cache-2486ac33-a881-4be1-a24e-2ff263e51818" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:17:25 user nova-compute[74189]: DEBUG nova.network.neutron [req-05c4f053-0a82-46f1-8b3e-4d59e5ed70a8 req-6d64d620-0182-460d-92a6-c3e82a86a62c service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Refreshing network info cache for port a96d3bd5-5996-4171-87ef-082bfe44bb78 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:17:25 user nova-compute[74189]: DEBUG nova.network.neutron [req-05c4f053-0a82-46f1-8b3e-4d59e5ed70a8 req-6d64d620-0182-460d-92a6-c3e82a86a62c service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:17:25 user nova-compute[74189]: DEBUG nova.network.neutron [req-05c4f053-0a82-46f1-8b3e-4d59e5ed70a8 req-6d64d620-0182-460d-92a6-c3e82a86a62c service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:17:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-05c4f053-0a82-46f1-8b3e-4d59e5ed70a8 req-6d64d620-0182-460d-92a6-c3e82a86a62c service nova] Releasing lock "refresh_cache-2486ac33-a881-4be1-a24e-2ff263e51818" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:17:25 user nova-compute[74189]: DEBUG nova.compute.manager [req-05c4f053-0a82-46f1-8b3e-4d59e5ed70a8 req-6d64d620-0182-460d-92a6-c3e82a86a62c service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-changed-f10bc396-91ea-4493-8521-69881612dd9f {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:17:25 user nova-compute[74189]: DEBUG nova.compute.manager [req-05c4f053-0a82-46f1-8b3e-4d59e5ed70a8 req-6d64d620-0182-460d-92a6-c3e82a86a62c service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Refreshing instance network info cache due to event network-changed-f10bc396-91ea-4493-8521-69881612dd9f. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:17:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-05c4f053-0a82-46f1-8b3e-4d59e5ed70a8 req-6d64d620-0182-460d-92a6-c3e82a86a62c service nova] Acquiring lock "refresh_cache-2486ac33-a881-4be1-a24e-2ff263e51818" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:17:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-05c4f053-0a82-46f1-8b3e-4d59e5ed70a8 req-6d64d620-0182-460d-92a6-c3e82a86a62c service nova] Acquired lock "refresh_cache-2486ac33-a881-4be1-a24e-2ff263e51818" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:17:25 user nova-compute[74189]: DEBUG nova.network.neutron [req-05c4f053-0a82-46f1-8b3e-4d59e5ed70a8 req-6d64d620-0182-460d-92a6-c3e82a86a62c service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Refreshing network info cache for port f10bc396-91ea-4493-8521-69881612dd9f {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:17:25 user nova-compute[74189]: DEBUG nova.network.neutron [req-05c4f053-0a82-46f1-8b3e-4d59e5ed70a8 req-6d64d620-0182-460d-92a6-c3e82a86a62c service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:17:25 user nova-compute[74189]: DEBUG nova.network.neutron [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Successfully updated port: 3fad83a5-d1c9-43d7-9dbd-16970bbb93b3 {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:17:25 user nova-compute[74189]: DEBUG nova.network.neutron [req-05c4f053-0a82-46f1-8b3e-4d59e5ed70a8 req-6d64d620-0182-460d-92a6-c3e82a86a62c service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:17:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-05c4f053-0a82-46f1-8b3e-4d59e5ed70a8 req-6d64d620-0182-460d-92a6-c3e82a86a62c service nova] Releasing lock "refresh_cache-2486ac33-a881-4be1-a24e-2ff263e51818" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:17:25 user nova-compute[74189]: INFO nova.compute.manager [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] [instance: 59ab3484-9785-48b4-96fb-1563a6fb8434] Took 1.11 seconds to detach 1 volumes for instance.
Oct 25 21:17:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:17:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:17:26 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:17:26 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:17:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:17:26 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Deleted allocations for instance 59ab3484-9785-48b4-96fb-1563a6fb8434
Oct 25 21:17:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-86f861af-9790-4879-824c-c62c6759c41b tempest-DeleteServersTestJSON-500805402 tempest-DeleteServersTestJSON-500805402-project-member] Lock "59ab3484-9785-48b4-96fb-1563a6fb8434" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.913s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:17:26 user nova-compute[74189]: DEBUG nova.network.neutron [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Successfully updated port: 532714b6-a025-43e3-bf7b-87f8159ed408 {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-0c42444f-4563-464b-9672-c48f6cb08277 req-853a3ec4-edd7-4bf2-a2f0-e8b73b2d22cc service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Received event network-changed-a151161f-1633-405f-ac74-9f379531d89a {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-0c42444f-4563-464b-9672-c48f6cb08277 req-853a3ec4-edd7-4bf2-a2f0-e8b73b2d22cc service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Refreshing instance network info cache due to event network-changed-a151161f-1633-405f-ac74-9f379531d89a. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0c42444f-4563-464b-9672-c48f6cb08277 req-853a3ec4-edd7-4bf2-a2f0-e8b73b2d22cc service nova] Acquiring lock "refresh_cache-ea8d22c5-3868-43d1-b101-c6cff480dea6" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0c42444f-4563-464b-9672-c48f6cb08277 req-853a3ec4-edd7-4bf2-a2f0-e8b73b2d22cc service nova] Acquired lock "refresh_cache-ea8d22c5-3868-43d1-b101-c6cff480dea6" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG nova.network.neutron [req-0c42444f-4563-464b-9672-c48f6cb08277 req-853a3ec4-edd7-4bf2-a2f0-e8b73b2d22cc service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Refreshing network info cache for port a151161f-1633-405f-ac74-9f379531d89a {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-d6460b0f-82a9-4e5d-a0a5-b12eb658ce38 req-2dc042f3-2d53-4cb4-b305-5a832ad1acc9 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-changed-81b93608-6fb4-4753-8328-df418f6d3ffe {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-d6460b0f-82a9-4e5d-a0a5-b12eb658ce38 req-2dc042f3-2d53-4cb4-b305-5a832ad1acc9 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Refreshing instance network info cache due to event network-changed-81b93608-6fb4-4753-8328-df418f6d3ffe. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d6460b0f-82a9-4e5d-a0a5-b12eb658ce38 req-2dc042f3-2d53-4cb4-b305-5a832ad1acc9 service nova] Acquiring lock "refresh_cache-2486ac33-a881-4be1-a24e-2ff263e51818" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d6460b0f-82a9-4e5d-a0a5-b12eb658ce38 req-2dc042f3-2d53-4cb4-b305-5a832ad1acc9 service nova] Acquired lock "refresh_cache-2486ac33-a881-4be1-a24e-2ff263e51818" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG nova.network.neutron [req-d6460b0f-82a9-4e5d-a0a5-b12eb658ce38 req-2dc042f3-2d53-4cb4-b305-5a832ad1acc9 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Refreshing network info cache for port 81b93608-6fb4-4753-8328-df418f6d3ffe {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG nova.network.neutron [req-d6460b0f-82a9-4e5d-a0a5-b12eb658ce38 req-2dc042f3-2d53-4cb4-b305-5a832ad1acc9 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG nova.network.neutron [req-0c42444f-4563-464b-9672-c48f6cb08277 req-853a3ec4-edd7-4bf2-a2f0-e8b73b2d22cc service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Updated VIF entry in instance network info cache for port a151161f-1633-405f-ac74-9f379531d89a. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG nova.network.neutron [req-0c42444f-4563-464b-9672-c48f6cb08277 req-853a3ec4-edd7-4bf2-a2f0-e8b73b2d22cc service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Updating instance_info_cache with network_info: [{"id": "a151161f-1633-405f-ac74-9f379531d89a", "address": "fa:16:3e:63:71:94", "network": {"id": "62a86fdc-b28d-442a-9d62-0c3286ad0abb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1182690237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6d05f10a0647e9a014e78f2a7dab78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa151161f-16", "ovs_interfaceid": "a151161f-1633-405f-ac74-9f379531d89a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG nova.network.neutron [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Successfully updated port: a918de57-be1e-4ddd-b593-533130578da6 {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0c42444f-4563-464b-9672-c48f6cb08277 req-853a3ec4-edd7-4bf2-a2f0-e8b73b2d22cc service nova] Releasing lock "refresh_cache-ea8d22c5-3868-43d1-b101-c6cff480dea6" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG nova.network.neutron [req-d6460b0f-82a9-4e5d-a0a5-b12eb658ce38 req-2dc042f3-2d53-4cb4-b305-5a832ad1acc9 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Acquiring lock "refresh_cache-2486ac33-a881-4be1-a24e-2ff263e51818" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d6460b0f-82a9-4e5d-a0a5-b12eb658ce38 req-2dc042f3-2d53-4cb4-b305-5a832ad1acc9 service nova] Releasing lock "refresh_cache-2486ac33-a881-4be1-a24e-2ff263e51818" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-d6460b0f-82a9-4e5d-a0a5-b12eb658ce38 req-2dc042f3-2d53-4cb4-b305-5a832ad1acc9 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-changed-3fad83a5-d1c9-43d7-9dbd-16970bbb93b3 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-d6460b0f-82a9-4e5d-a0a5-b12eb658ce38 req-2dc042f3-2d53-4cb4-b305-5a832ad1acc9 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Refreshing instance network info cache due to event network-changed-3fad83a5-d1c9-43d7-9dbd-16970bbb93b3. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d6460b0f-82a9-4e5d-a0a5-b12eb658ce38 req-2dc042f3-2d53-4cb4-b305-5a832ad1acc9 service nova] Acquiring lock "refresh_cache-2486ac33-a881-4be1-a24e-2ff263e51818" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d6460b0f-82a9-4e5d-a0a5-b12eb658ce38 req-2dc042f3-2d53-4cb4-b305-5a832ad1acc9 service nova] Acquired lock "refresh_cache-2486ac33-a881-4be1-a24e-2ff263e51818" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG nova.network.neutron [req-d6460b0f-82a9-4e5d-a0a5-b12eb658ce38 req-2dc042f3-2d53-4cb4-b305-5a832ad1acc9 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Refreshing network info cache for port 3fad83a5-d1c9-43d7-9dbd-16970bbb93b3 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c2aaf42a-bcb8-4ce4-ae60-4762f65030a6 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Acquiring lock "interface-ea8d22c5-3868-43d1-b101-c6cff480dea6-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c2aaf42a-bcb8-4ce4-ae60-4762f65030a6 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lock "interface-ea8d22c5-3868-43d1-b101-c6cff480dea6-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG nova.objects.instance [None req-c2aaf42a-bcb8-4ce4-ae60-4762f65030a6 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lazy-loading 'flavor' on Instance uuid ea8d22c5-3868-43d1-b101-c6cff480dea6 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG nova.network.neutron [req-d6460b0f-82a9-4e5d-a0a5-b12eb658ce38 req-2dc042f3-2d53-4cb4-b305-5a832ad1acc9 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG nova.objects.instance [None req-c2aaf42a-bcb8-4ce4-ae60-4762f65030a6 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lazy-loading 'pci_requests' on Instance uuid ea8d22c5-3868-43d1-b101-c6cff480dea6 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG nova.objects.base [None req-c2aaf42a-bcb8-4ce4-ae60-4762f65030a6 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Object Instance<ea8d22c5-3868-43d1-b101-c6cff480dea6> lazy-loaded attributes: flavor,pci_requests {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG nova.network.neutron [None req-c2aaf42a-bcb8-4ce4-ae60-4762f65030a6 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG nova.network.neutron [req-d6460b0f-82a9-4e5d-a0a5-b12eb658ce38 req-2dc042f3-2d53-4cb4-b305-5a832ad1acc9 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d6460b0f-82a9-4e5d-a0a5-b12eb658ce38 req-2dc042f3-2d53-4cb4-b305-5a832ad1acc9 service nova] Releasing lock "refresh_cache-2486ac33-a881-4be1-a24e-2ff263e51818" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-d6460b0f-82a9-4e5d-a0a5-b12eb658ce38 req-2dc042f3-2d53-4cb4-b305-5a832ad1acc9 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-changed-532714b6-a025-43e3-bf7b-87f8159ed408 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-d6460b0f-82a9-4e5d-a0a5-b12eb658ce38 req-2dc042f3-2d53-4cb4-b305-5a832ad1acc9 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Refreshing instance network info cache due to event network-changed-532714b6-a025-43e3-bf7b-87f8159ed408. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d6460b0f-82a9-4e5d-a0a5-b12eb658ce38 req-2dc042f3-2d53-4cb4-b305-5a832ad1acc9 service nova] Acquiring lock "refresh_cache-2486ac33-a881-4be1-a24e-2ff263e51818" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d6460b0f-82a9-4e5d-a0a5-b12eb658ce38 req-2dc042f3-2d53-4cb4-b305-5a832ad1acc9 service nova] Acquired lock "refresh_cache-2486ac33-a881-4be1-a24e-2ff263e51818" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:17:27 user nova-compute[74189]: DEBUG nova.network.neutron [req-d6460b0f-82a9-4e5d-a0a5-b12eb658ce38 req-2dc042f3-2d53-4cb4-b305-5a832ad1acc9 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Refreshing network info cache for port 532714b6-a025-43e3-bf7b-87f8159ed408 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:17:28 user nova-compute[74189]: DEBUG nova.policy [None req-c2aaf42a-bcb8-4ce4-ae60-4762f65030a6 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a147e32cb7fd45aaa1398a1332e6956a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6d05f10a0647e9a014e78f2a7dab78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:17:28 user nova-compute[74189]: DEBUG nova.network.neutron [req-d6460b0f-82a9-4e5d-a0a5-b12eb658ce38 req-2dc042f3-2d53-4cb4-b305-5a832ad1acc9 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:17:28 user nova-compute[74189]: DEBUG nova.network.neutron [req-d6460b0f-82a9-4e5d-a0a5-b12eb658ce38 req-2dc042f3-2d53-4cb4-b305-5a832ad1acc9 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:17:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d6460b0f-82a9-4e5d-a0a5-b12eb658ce38 req-2dc042f3-2d53-4cb4-b305-5a832ad1acc9 service nova] Releasing lock "refresh_cache-2486ac33-a881-4be1-a24e-2ff263e51818" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:17:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Acquired lock "refresh_cache-2486ac33-a881-4be1-a24e-2ff263e51818" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:17:28 user nova-compute[74189]: DEBUG nova.network.neutron [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:17:28 user nova-compute[74189]: DEBUG nova.network.neutron [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:17:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:28 user nova-compute[74189]: DEBUG nova.network.neutron [None req-c2aaf42a-bcb8-4ce4-ae60-4762f65030a6 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Successfully created port: f25ca758-602f-481b-8de2-4a8040b991cd {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:17:29 user nova-compute[74189]: DEBUG nova.network.neutron [None req-c2aaf42a-bcb8-4ce4-ae60-4762f65030a6 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Successfully updated port: f25ca758-602f-481b-8de2-4a8040b991cd {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:17:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c2aaf42a-bcb8-4ce4-ae60-4762f65030a6 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Acquiring lock "refresh_cache-ea8d22c5-3868-43d1-b101-c6cff480dea6" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:17:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c2aaf42a-bcb8-4ce4-ae60-4762f65030a6 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Acquired lock "refresh_cache-ea8d22c5-3868-43d1-b101-c6cff480dea6" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:17:29 user nova-compute[74189]: DEBUG nova.network.neutron [None req-c2aaf42a-bcb8-4ce4-ae60-4762f65030a6 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:17:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-a1a65d4b-3c8f-4a72-9e49-34686d4399b5 req-bd78d835-8988-49ff-bcec-e657e9f144d5 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-changed-a918de57-be1e-4ddd-b593-533130578da6 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:17:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-a1a65d4b-3c8f-4a72-9e49-34686d4399b5 req-bd78d835-8988-49ff-bcec-e657e9f144d5 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Refreshing instance network info cache due to event network-changed-a918de57-be1e-4ddd-b593-533130578da6. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:17:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a1a65d4b-3c8f-4a72-9e49-34686d4399b5 req-bd78d835-8988-49ff-bcec-e657e9f144d5 service nova] Acquiring lock "refresh_cache-2486ac33-a881-4be1-a24e-2ff263e51818" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:17:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Acquiring lock "c4c57363-0107-4567-9842-44a0522f8326" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:17:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lock "c4c57363-0107-4567-9842-44a0522f8326" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:17:29 user nova-compute[74189]: DEBUG nova.objects.instance [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lazy-loading 'flavor' on Instance uuid c4c57363-0107-4567-9842-44a0522f8326 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:17:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lock "c4c57363-0107-4567-9842-44a0522f8326" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:17:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Acquiring lock "c4c57363-0107-4567-9842-44a0522f8326" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:17:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lock "c4c57363-0107-4567-9842-44a0522f8326" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:17:29 user nova-compute[74189]: INFO nova.compute.manager [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Attaching volume 7e24c152-22c8-457a-a917-60a4a3e86456 to /dev/sdc
Oct 25 21:17:29 user nova-compute[74189]: DEBUG os_brick.utils [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:17:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:29 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e43aa4-8a28-43f9-bd4a-eabe9a1a670c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:29 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c581a08-2d0b-438f-97a7-9ab905afb017]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:29 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdf8c18-c2e5-44a4-942f-1952e769e7c0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:29 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[96073189-5615-4200-9a62-a64b0b1b7177]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:17:29 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:17:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:17:30 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:17:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8737529-84f1-4e49-97aa-dd3a2af0e645]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG os_brick.utils [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] <== get_connector_properties: return (193ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Updating existing volume attachment record: 07503900-76bc-483a-8a14-6c86330b16c1 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG nova.network.neutron [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Updating instance_info_cache with network_info: [{"id": "a334be31-0990-4647-b215-2553698e0050", "address": "fa:16:3e:86:f6:dc", "network": {"id": "6a880bb8-1359-4925-bb7c-f3383d6fd955", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1357582936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa334be31-09", "ovs_interfaceid": "a334be31-0990-4647-b215-2553698e0050", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a96d3bd5-5996-4171-87ef-082bfe44bb78", "address": "fa:16:3e:2e:ed:e9", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa96d3bd5-59", "ovs_interfaceid": "a96d3bd5-5996-4171-87ef-082bfe44bb78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f10bc396-91ea-4493-8521-69881612dd9f", "address": "fa:16:3e:95:bf:3c", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10bc396-91", "ovs_interfaceid": "f10bc396-91ea-4493-8521-69881612dd9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "81b93608-6fb4-4753-8328-df418f6d3ffe", "address": "fa:16:3e:46:4d:a5", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b93608-6f", "ovs_interfaceid": "81b93608-6fb4-4753-8328-df418f6d3ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fad83a5-d1c9-43d7-9dbd-16970bbb93b3", "address": "fa:16:3e:50:46:46", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fad83a5-d1", "ovs_interfaceid": "3fad83a5-d1c9-43d7-9dbd-16970bbb93b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "532714b6-a025-43e3-bf7b-87f8159ed408", "address": "fa:16:3e:f2:73:ca", "network": {"id": "6223be01-32f0-4db7-8b26-8ad195bbe7f3", "bridge": "br-int", "label": "tempest-device-tagging-net2-127651341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532714b6-a0", "ovs_interfaceid": "532714b6-a025-43e3-bf7b-87f8159ed408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a918de57-be1e-4ddd-b593-533130578da6", "address": "fa:16:3e:07:3c:e2", "network": {"id": "6223be01-32f0-4db7-8b26-8ad195bbe7f3", "bridge": "br-int", "label": "tempest-device-tagging-net2-127651341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa918de57-be", "ovs_interfaceid": "a918de57-be1e-4ddd-b593-533130578da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Releasing lock "refresh_cache-2486ac33-a881-4be1-a24e-2ff263e51818" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG nova.compute.manager [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Instance network_info: |[{"id": "a334be31-0990-4647-b215-2553698e0050", "address": "fa:16:3e:86:f6:dc", "network": {"id": "6a880bb8-1359-4925-bb7c-f3383d6fd955", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1357582936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa334be31-09", "ovs_interfaceid": "a334be31-0990-4647-b215-2553698e0050", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a96d3bd5-5996-4171-87ef-082bfe44bb78", "address": "fa:16:3e:2e:ed:e9", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa96d3bd5-59", "ovs_interfaceid": "a96d3bd5-5996-4171-87ef-082bfe44bb78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f10bc396-91ea-4493-8521-69881612dd9f", "address": "fa:16:3e:95:bf:3c", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10bc396-91", "ovs_interfaceid": "f10bc396-91ea-4493-8521-69881612dd9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "81b93608-6fb4-4753-8328-df418f6d3ffe", "address": "fa:16:3e:46:4d:a5", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b93608-6f", "ovs_interfaceid": "81b93608-6fb4-4753-8328-df418f6d3ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fad83a5-d1c9-43d7-9dbd-16970bbb93b3", "address": "fa:16:3e:50:46:46", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fad83a5-d1", "ovs_interfaceid": "3fad83a5-d1c9-43d7-9dbd-16970bbb93b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "532714b6-a025-43e3-bf7b-87f8159ed408", "address": "fa:16:3e:f2:73:ca", "network": {"id": "6223be01-32f0-4db7-8b26-8ad195bbe7f3", "bridge": "br-int", "label": "tempest-device-tagging-net2-127651341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532714b6-a0", "ovs_interfaceid": "532714b6-a025-43e3-bf7b-87f8159ed408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a918de57-be1e-4ddd-b593-533130578da6", "address": "fa:16:3e:07:3c:e2", "network": {"id": "6223be01-32f0-4db7-8b26-8ad195bbe7f3", "bridge": "br-int", "label": "tempest-device-tagging-net2-127651341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa918de57-be", "ovs_interfaceid": "a918de57-be1e-4ddd-b593-533130578da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a1a65d4b-3c8f-4a72-9e49-34686d4399b5 req-bd78d835-8988-49ff-bcec-e657e9f144d5 service nova] Acquired lock "refresh_cache-2486ac33-a881-4be1-a24e-2ff263e51818" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG nova.network.neutron [req-a1a65d4b-3c8f-4a72-9e49-34686d4399b5 req-bd78d835-8988-49ff-bcec-e657e9f144d5 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Refreshing network info cache for port a918de57-be1e-4ddd-b593-533130578da6 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG nova.network.neutron [None req-c2aaf42a-bcb8-4ce4-ae60-4762f65030a6 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Updating instance_info_cache with network_info: [{"id": "a151161f-1633-405f-ac74-9f379531d89a", "address": "fa:16:3e:63:71:94", "network": {"id": "62a86fdc-b28d-442a-9d62-0c3286ad0abb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1182690237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6d05f10a0647e9a014e78f2a7dab78", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa151161f-16", "ovs_interfaceid": "a151161f-1633-405f-ac74-9f379531d89a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f25ca758-602f-481b-8de2-4a8040b991cd", "address": "fa:16:3e:3c:4e:d6", "network": {"id": "2b3af293-fcd7-4868-89bd-0701f2814a8b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-227584648", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7d6d05f10a0647e9a014e78f2a7dab78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25ca758-60", "ovs_interfaceid": "f25ca758-602f-481b-8de2-4a8040b991cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c2aaf42a-bcb8-4ce4-ae60-4762f65030a6 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Releasing lock "refresh_cache-ea8d22c5-3868-43d1-b101-c6cff480dea6" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-c2aaf42a-bcb8-4ce4-ae60-4762f65030a6 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-781387297',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-781387297',id=6,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHJgDbw7K7bwNJyj3WQeM4O7X1T/XxzeuPN+AM4eJ62yayGmYQQS1OGbI1fYrJusZqdcuogdpmdUBe6qoNmEvj36GKw2Ywp/JElU+pyp8QCNHY9uIrm3I9Zf5tuFbEg3Q==',key_name='tempest-keypair-159731972',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:15:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7d6d05f10a0647e9a014e78f2a7dab78',ramdisk_id='',reservation_id='r-oi1337uc',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1187636517',owner_user_name='tempest-TaggedAttachmentsTest-1187636517-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:15:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a147e32cb7fd45aaa1398a1332e6956a',uuid=ea8d22c5-3868-43d1-b101-c6cff480dea6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f25ca758-602f-481b-8de2-4a8040b991cd", "address": "fa:16:3e:3c:4e:d6", "network": {"id": "2b3af293-fcd7-4868-89bd-0701f2814a8b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-227584648", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7d6d05f10a0647e9a014e78f2a7dab78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25ca758-60", "ovs_interfaceid": "f25ca758-602f-481b-8de2-4a8040b991cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-c2aaf42a-bcb8-4ce4-ae60-4762f65030a6 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Converting VIF {"id": "f25ca758-602f-481b-8de2-4a8040b991cd", "address": "fa:16:3e:3c:4e:d6", "network": {"id": "2b3af293-fcd7-4868-89bd-0701f2814a8b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-227584648", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7d6d05f10a0647e9a014e78f2a7dab78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25ca758-60", "ovs_interfaceid": "f25ca758-602f-481b-8de2-4a8040b991cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-c2aaf42a-bcb8-4ce4-ae60-4762f65030a6 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:4e:d6,bridge_name='br-int',has_traffic_filtering=True,id=f25ca758-602f-481b-8de2-4a8040b991cd,network=Network(2b3af293-fcd7-4868-89bd-0701f2814a8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf25ca758-60') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG os_vif [None req-c2aaf42a-bcb8-4ce4-ae60-4762f65030a6 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:4e:d6,bridge_name='br-int',has_traffic_filtering=True,id=f25ca758-602f-481b-8de2-4a8040b991cd,network=Network(2b3af293-fcd7-4868-89bd-0701f2814a8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf25ca758-60') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f11250cc-093c-5142-a06f-6378fc919fa9', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG nova.network.neutron [req-a1a65d4b-3c8f-4a72-9e49-34686d4399b5 req-bd78d835-8988-49ff-bcec-e657e9f144d5 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Updated VIF entry in instance network info cache for port a918de57-be1e-4ddd-b593-533130578da6. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG nova.network.neutron [req-a1a65d4b-3c8f-4a72-9e49-34686d4399b5 req-bd78d835-8988-49ff-bcec-e657e9f144d5 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Updating instance_info_cache with network_info: [{"id": "a334be31-0990-4647-b215-2553698e0050", "address": "fa:16:3e:86:f6:dc", "network": {"id": "6a880bb8-1359-4925-bb7c-f3383d6fd955", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1357582936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa334be31-09", "ovs_interfaceid": "a334be31-0990-4647-b215-2553698e0050", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a96d3bd5-5996-4171-87ef-082bfe44bb78", "address": "fa:16:3e:2e:ed:e9", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa96d3bd5-59", "ovs_interfaceid": "a96d3bd5-5996-4171-87ef-082bfe44bb78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f10bc396-91ea-4493-8521-69881612dd9f", "address": "fa:16:3e:95:bf:3c", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10bc396-91", "ovs_interfaceid": "f10bc396-91ea-4493-8521-69881612dd9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "81b93608-6fb4-4753-8328-df418f6d3ffe", "address": "fa:16:3e:46:4d:a5", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b93608-6f", "ovs_interfaceid": "81b93608-6fb4-4753-8328-df418f6d3ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fad83a5-d1c9-43d7-9dbd-16970bbb93b3", "address": "fa:16:3e:50:46:46", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fad83a5-d1", "ovs_interfaceid": "3fad83a5-d1c9-43d7-9dbd-16970bbb93b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "532714b6-a025-43e3-bf7b-87f8159ed408", "address": "fa:16:3e:f2:73:ca", "network": {"id": "6223be01-32f0-4db7-8b26-8ad195bbe7f3", "bridge": "br-int", "label": "tempest-device-tagging-net2-127651341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532714b6-a0", "ovs_interfaceid": "532714b6-a025-43e3-bf7b-87f8159ed408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a918de57-be1e-4ddd-b593-533130578da6", "address": "fa:16:3e:07:3c:e2", "network": {"id": "6223be01-32f0-4db7-8b26-8ad195bbe7f3", "bridge": "br-int", "label": "tempest-device-tagging-net2-127651341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa918de57-be", "ovs_interfaceid": "a918de57-be1e-4ddd-b593-533130578da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf25ca758-60, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf25ca758-60, col_values=(('qos', UUID('b9cec0b8-b0a5-4ba0-a362-fd779dba1173')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf25ca758-60, col_values=(('external_ids', {'iface-id': 'f25ca758-602f-481b-8de2-4a8040b991cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:4e:d6', 'vm-uuid': 'ea8d22c5-3868-43d1-b101-c6cff480dea6'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a1a65d4b-3c8f-4a72-9e49-34686d4399b5 req-bd78d835-8988-49ff-bcec-e657e9f144d5 service nova] Releasing lock "refresh_cache-2486ac33-a881-4be1-a24e-2ff263e51818" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG nova.compute.manager [req-a1a65d4b-3c8f-4a72-9e49-34686d4399b5 req-bd78d835-8988-49ff-bcec-e657e9f144d5 service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Received event network-changed-f25ca758-602f-481b-8de2-4a8040b991cd {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG nova.compute.manager [req-a1a65d4b-3c8f-4a72-9e49-34686d4399b5 req-bd78d835-8988-49ff-bcec-e657e9f144d5 service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Refreshing instance network info cache due to event network-changed-f25ca758-602f-481b-8de2-4a8040b991cd. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a1a65d4b-3c8f-4a72-9e49-34686d4399b5 req-bd78d835-8988-49ff-bcec-e657e9f144d5 service nova] Acquiring lock "refresh_cache-ea8d22c5-3868-43d1-b101-c6cff480dea6" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a1a65d4b-3c8f-4a72-9e49-34686d4399b5 req-bd78d835-8988-49ff-bcec-e657e9f144d5 service nova] Acquired lock "refresh_cache-ea8d22c5-3868-43d1-b101-c6cff480dea6" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG nova.network.neutron [req-a1a65d4b-3c8f-4a72-9e49-34686d4399b5 req-bd78d835-8988-49ff-bcec-e657e9f144d5 service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Refreshing network info cache for port f25ca758-602f-481b-8de2-4a8040b991cd {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:30 user nova-compute[74189]: INFO os_vif [None req-c2aaf42a-bcb8-4ce4-ae60-4762f65030a6 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:4e:d6,bridge_name='br-int',has_traffic_filtering=True,id=f25ca758-602f-481b-8de2-4a8040b991cd,network=Network(2b3af293-fcd7-4868-89bd-0701f2814a8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf25ca758-60')
Oct 25 21:17:30 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-c2aaf42a-bcb8-4ce4-ae60-4762f65030a6 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-781387297',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-781387297',id=6,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHJgDbw7K7bwNJyj3WQeM4O7X1T/XxzeuPN+AM4eJ62yayGmYQQS1OGbI1fYrJusZqdcuogdpmdUBe6qoNmEvj36GKw2Ywp/JElU+pyp8QCNHY9uIrm3I9Zf5tuFbEg3Q==',key_name='tempest-keypair-159731972',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:15:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7d6d05f10a0647e9a014e78f2a7dab78',ramdisk_id='',reservation_id='r-oi1337uc',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1187636517',owner_user_name='tempest-TaggedAttachmentsTest-1187636517-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:15:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a147e32cb7fd45aaa1398a1332e6956a',uuid=ea8d22c5-3868-43d1-b101-c6cff480dea6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f25ca758-602f-481b-8de2-4a8040b991cd", "address": "fa:16:3e:3c:4e:d6", "network": {"id": "2b3af293-fcd7-4868-89bd-0701f2814a8b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-227584648", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7d6d05f10a0647e9a014e78f2a7dab78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25ca758-60", "ovs_interfaceid": "f25ca758-602f-481b-8de2-4a8040b991cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-c2aaf42a-bcb8-4ce4-ae60-4762f65030a6 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Converting VIF {"id": "f25ca758-602f-481b-8de2-4a8040b991cd", "address": "fa:16:3e:3c:4e:d6", "network": {"id": "2b3af293-fcd7-4868-89bd-0701f2814a8b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-227584648", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7d6d05f10a0647e9a014e78f2a7dab78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25ca758-60", "ovs_interfaceid": "f25ca758-602f-481b-8de2-4a8040b991cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-c2aaf42a-bcb8-4ce4-ae60-4762f65030a6 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:4e:d6,bridge_name='br-int',has_traffic_filtering=True,id=f25ca758-602f-481b-8de2-4a8040b991cd,network=Network(2b3af293-fcd7-4868-89bd-0701f2814a8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf25ca758-60') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-c2aaf42a-bcb8-4ce4-ae60-4762f65030a6 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] attach device xml: <interface type="ethernet">
Oct 25 21:17:30 user nova-compute[74189]:   <mac address="fa:16:3e:3c:4e:d6"/>
Oct 25 21:17:30 user nova-compute[74189]:   <model type="virtio"/>
Oct 25 21:17:30 user nova-compute[74189]:   <mtu size="1442"/>
Oct 25 21:17:30 user nova-compute[74189]:   <target dev="tapf25ca758-60"/>
Oct 25 21:17:30 user nova-compute[74189]: </interface>
Oct 25 21:17:30 user nova-compute[74189]:  {{(pid=74189) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c2aaf42a-bcb8-4ce4-ae60-4762f65030a6 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:17:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c2aaf42a-bcb8-4ce4-ae60-4762f65030a6 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] No BDM found with device name hda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:17:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c2aaf42a-bcb8-4ce4-ae60-4762f65030a6 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] No VIF found with MAC fa:16:3e:63:71:94, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:17:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-c2aaf42a-bcb8-4ce4-ae60-4762f65030a6 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:17:31 user nova-compute[74189]:   <nova:package version="0.0.0"/>
Oct 25 21:17:31 user nova-compute[74189]:   <nova:name>tempest-device-tagging-server-781387297</nova:name>
Oct 25 21:17:31 user nova-compute[74189]:   <nova:creationTime>2023-10-25 21:17:31</nova:creationTime>
Oct 25 21:17:31 user nova-compute[74189]:   <nova:flavor name="m1.tiny">
Oct 25 21:17:31 user nova-compute[74189]:     <nova:memory>512</nova:memory>
Oct 25 21:17:31 user nova-compute[74189]:     <nova:disk>1</nova:disk>
Oct 25 21:17:31 user nova-compute[74189]:     <nova:swap>0</nova:swap>
Oct 25 21:17:31 user nova-compute[74189]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:17:31 user nova-compute[74189]:     <nova:vcpus>1</nova:vcpus>
Oct 25 21:17:31 user nova-compute[74189]:   </nova:flavor>
Oct 25 21:17:31 user nova-compute[74189]:   <nova:owner>
Oct 25 21:17:31 user nova-compute[74189]:     <nova:user uuid="a147e32cb7fd45aaa1398a1332e6956a">tempest-TaggedAttachmentsTest-1187636517-project-member</nova:user>
Oct 25 21:17:31 user nova-compute[74189]:     <nova:project uuid="7d6d05f10a0647e9a014e78f2a7dab78">tempest-TaggedAttachmentsTest-1187636517</nova:project>
Oct 25 21:17:31 user nova-compute[74189]:   </nova:owner>
Oct 25 21:17:31 user nova-compute[74189]:   <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:17:31 user nova-compute[74189]:   <nova:ports>
Oct 25 21:17:31 user nova-compute[74189]:     <nova:port uuid="a151161f-1633-405f-ac74-9f379531d89a">
Oct 25 21:17:31 user nova-compute[74189]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 25 21:17:31 user nova-compute[74189]:     </nova:port>
Oct 25 21:17:31 user nova-compute[74189]:     <nova:port uuid="f25ca758-602f-481b-8de2-4a8040b991cd">
Oct 25 21:17:31 user nova-compute[74189]:       <nova:ip type="fixed" address="10.10.10.55" ipVersion="4"/>
Oct 25 21:17:31 user nova-compute[74189]:     </nova:port>
Oct 25 21:17:31 user nova-compute[74189]:   </nova:ports>
Oct 25 21:17:31 user nova-compute[74189]: </nova:instance>
Oct 25 21:17:31 user nova-compute[74189]:  {{(pid=74189) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 25 21:17:31 user nova-compute[74189]: DEBUG nova.compute.manager [req-982da95d-43be-4495-a4a8-16766ec1fdcf req-6ee9a6b2-4aef-40a3-aa4b-89c14b25fb51 service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Received event network-vif-plugged-f25ca758-602f-481b-8de2-4a8040b991cd {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:17:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-982da95d-43be-4495-a4a8-16766ec1fdcf req-6ee9a6b2-4aef-40a3-aa4b-89c14b25fb51 service nova] Acquiring lock "ea8d22c5-3868-43d1-b101-c6cff480dea6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:17:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-982da95d-43be-4495-a4a8-16766ec1fdcf req-6ee9a6b2-4aef-40a3-aa4b-89c14b25fb51 service nova] Lock "ea8d22c5-3868-43d1-b101-c6cff480dea6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:17:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-982da95d-43be-4495-a4a8-16766ec1fdcf req-6ee9a6b2-4aef-40a3-aa4b-89c14b25fb51 service nova] Lock "ea8d22c5-3868-43d1-b101-c6cff480dea6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:17:31 user nova-compute[74189]: DEBUG nova.compute.manager [req-982da95d-43be-4495-a4a8-16766ec1fdcf req-6ee9a6b2-4aef-40a3-aa4b-89c14b25fb51 service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] No waiting events found dispatching network-vif-plugged-f25ca758-602f-481b-8de2-4a8040b991cd {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:17:31 user nova-compute[74189]: WARNING nova.compute.manager [req-982da95d-43be-4495-a4a8-16766ec1fdcf req-6ee9a6b2-4aef-40a3-aa4b-89c14b25fb51 service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Received unexpected event network-vif-plugged-f25ca758-602f-481b-8de2-4a8040b991cd for instance with vm_state active and task_state None.
Oct 25 21:17:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c2aaf42a-bcb8-4ce4-ae60-4762f65030a6 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lock "interface-ea8d22c5-3868-43d1-b101-c6cff480dea6-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.627s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:17:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:31 user nova-compute[74189]: DEBUG nova.network.neutron [req-a1a65d4b-3c8f-4a72-9e49-34686d4399b5 req-bd78d835-8988-49ff-bcec-e657e9f144d5 service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Updated VIF entry in instance network info cache for port f25ca758-602f-481b-8de2-4a8040b991cd. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:17:31 user nova-compute[74189]: DEBUG nova.network.neutron [req-a1a65d4b-3c8f-4a72-9e49-34686d4399b5 req-bd78d835-8988-49ff-bcec-e657e9f144d5 service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Updating instance_info_cache with network_info: [{"id": "a151161f-1633-405f-ac74-9f379531d89a", "address": "fa:16:3e:63:71:94", "network": {"id": "62a86fdc-b28d-442a-9d62-0c3286ad0abb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1182690237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6d05f10a0647e9a014e78f2a7dab78", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa151161f-16", "ovs_interfaceid": "a151161f-1633-405f-ac74-9f379531d89a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f25ca758-602f-481b-8de2-4a8040b991cd", "address": "fa:16:3e:3c:4e:d6", "network": {"id": "2b3af293-fcd7-4868-89bd-0701f2814a8b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-227584648", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7d6d05f10a0647e9a014e78f2a7dab78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25ca758-60", "ovs_interfaceid": "f25ca758-602f-481b-8de2-4a8040b991cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:17:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a1a65d4b-3c8f-4a72-9e49-34686d4399b5 req-bd78d835-8988-49ff-bcec-e657e9f144d5 service nova] Releasing lock "refresh_cache-ea8d22c5-3868-43d1-b101-c6cff480dea6" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:17:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mEFBQrzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:17:36 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:17:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:17:36 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:17:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:17:36 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[53187f95-0d4f-48c4-95dc-a6919fb6ab56]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:17:36 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7457f603-3cd8-4688-8713-30e0b3acdbb6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0] added
Oct 25 21:17:36 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[72eb926d-fc55-4fd9-87db-af175d7d4742]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[795c5451-c098-45d6-a8c4-4be1a6f791d4]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mEFBQrzx {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mEFBQrzx" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7067c25-f72f-4f71-b590-bf65eb19c5a5]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mEFBQrzx'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a72c88-0086-4f4b-b539-a87f9e828ce5]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1f6d95-d9ca-4474-945a-f27bf1979404]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:17:36 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:17:36 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Acquiring lock "f52fc510-3640-468a-8a9c-b716b9d17a01" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Lock "f52fc510-3640-468a-8a9c-b716b9d17a01" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[930d14fb-8514-4388-b767-11ff184a49ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0, portal: 172.16.0.220,3260]
Oct 25 21:17:36 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0, portal: 172.16.0.220,3260] successful.
Oct 25 21:17:36 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG nova.objects.instance [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Lazy-loading 'flavor' on Instance uuid f52fc510-3640-468a-8a9c-b716b9d17a01 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Acquiring lock "ea8d22c5-3868-43d1-b101-c6cff480dea6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lock "ea8d22c5-3868-43d1-b101-c6cff480dea6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6400693f-0e2b-4006-bf34-ddfcf7fb9108]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG nova.objects.instance [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lazy-loading 'flavor' on Instance uuid ea8d22c5-3868-43d1-b101-c6cff480dea6 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Lock "f52fc510-3640-468a-8a9c-b716b9d17a01" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa007ee8-b5fb-4fbe-b7aa-3d6e85abf7f3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:17:36 user nova-compute[74189]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 (non-flash)
Oct 25 21:17:36 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:17:36 user nova-compute[74189]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 (non-flash)
Oct 25 21:17:36 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[da80efcf-aa33-401d-8a3e-c03ec7ee473a]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mEFBQrzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lock "ea8d22c5-3868-43d1-b101-c6cff480dea6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Acquiring lock "e1272f33-ef5e-48e6-912f-e0beae6dde11" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Lock "e1272f33-ef5e-48e6-912f-e0beae6dde11" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG nova.objects.instance [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Lazy-loading 'flavor' on Instance uuid e1272f33-ef5e-48e6-912f-e0beae6dde11 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Lock "e1272f33-ef5e-48e6-912f-e0beae6dde11" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Acquiring lock "f52fc510-3640-468a-8a9c-b716b9d17a01" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Lock "f52fc510-3640-468a-8a9c-b716b9d17a01" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:17:36 user nova-compute[74189]: INFO nova.compute.manager [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Attaching volume e07f2603-8906-4cb9-975e-5ac25a051963 to /dev/vdb
Oct 25 21:17:36 user nova-compute[74189]: DEBUG nova.compute.manager [req-a783228d-ac00-4311-925d-557657326c9b req-2a296db7-0ba6-4857-8be7-3f8a11a35b5a service nova] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Received event network-changed-dd205313-c8a4-433d-8271-6abe9cf77ede {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG nova.compute.manager [req-a783228d-ac00-4311-925d-557657326c9b req-2a296db7-0ba6-4857-8be7-3f8a11a35b5a service nova] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Refreshing instance network info cache due to event network-changed-dd205313-c8a4-433d-8271-6abe9cf77ede. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a783228d-ac00-4311-925d-557657326c9b req-2a296db7-0ba6-4857-8be7-3f8a11a35b5a service nova] Acquiring lock "refresh_cache-f52fc510-3640-468a-8a9c-b716b9d17a01" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a783228d-ac00-4311-925d-557657326c9b req-2a296db7-0ba6-4857-8be7-3f8a11a35b5a service nova] Acquired lock "refresh_cache-f52fc510-3640-468a-8a9c-b716b9d17a01" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:17:36 user nova-compute[74189]: DEBUG nova.network.neutron [req-a783228d-ac00-4311-925d-557657326c9b req-2a296db7-0ba6-4857-8be7-3f8a11a35b5a service nova] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Refreshing network info cache for port dd205313-c8a4-433d-8271-6abe9cf77ede {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Acquiring lock "ea8d22c5-3868-43d1-b101-c6cff480dea6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lock "ea8d22c5-3868-43d1-b101-c6cff480dea6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:17:37 user nova-compute[74189]: INFO nova.compute.manager [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Attaching volume 7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b to /dev/vdb
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Acquiring lock "e1272f33-ef5e-48e6-912f-e0beae6dde11" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Lock "e1272f33-ef5e-48e6-912f-e0beae6dde11" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:17:37 user nova-compute[74189]: INFO nova.compute.manager [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Attaching volume 257a6a89-a1a5-45bc-baad-5765b0f3355d to /dev/vdb
Oct 25 21:17:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG nova.network.neutron [req-a783228d-ac00-4311-925d-557657326c9b req-2a296db7-0ba6-4857-8be7-3f8a11a35b5a service nova] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Updated VIF entry in instance network info cache for port dd205313-c8a4-433d-8271-6abe9cf77ede. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG nova.network.neutron [req-a783228d-ac00-4311-925d-557657326c9b req-2a296db7-0ba6-4857-8be7-3f8a11a35b5a service nova] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Updating instance_info_cache with network_info: [{"id": "dd205313-c8a4-433d-8271-6abe9cf77ede", "address": "fa:16:3e:50:6e:57", "network": {"id": "10a55176-55d4-4629-890b-4de824ceda02", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1760980393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea3ea66cfd844c37bcc97a430f2eee69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd205313-c8", "ovs_interfaceid": "dd205313-c8a4-433d-8271-6abe9cf77ede", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG os_brick.utils [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a783228d-ac00-4311-925d-557657326c9b req-2a296db7-0ba6-4857-8be7-3f8a11a35b5a service nova] Releasing lock "refresh_cache-f52fc510-3640-468a-8a9c-b716b9d17a01" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG nova.compute.manager [req-a783228d-ac00-4311-925d-557657326c9b req-2a296db7-0ba6-4857-8be7-3f8a11a35b5a service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Received event network-vif-plugged-f25ca758-602f-481b-8de2-4a8040b991cd {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a783228d-ac00-4311-925d-557657326c9b req-2a296db7-0ba6-4857-8be7-3f8a11a35b5a service nova] Acquiring lock "ea8d22c5-3868-43d1-b101-c6cff480dea6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a783228d-ac00-4311-925d-557657326c9b req-2a296db7-0ba6-4857-8be7-3f8a11a35b5a service nova] Lock "ea8d22c5-3868-43d1-b101-c6cff480dea6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a783228d-ac00-4311-925d-557657326c9b req-2a296db7-0ba6-4857-8be7-3f8a11a35b5a service nova] Lock "ea8d22c5-3868-43d1-b101-c6cff480dea6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG nova.compute.manager [req-a783228d-ac00-4311-925d-557657326c9b req-2a296db7-0ba6-4857-8be7-3f8a11a35b5a service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] No waiting events found dispatching network-vif-plugged-f25ca758-602f-481b-8de2-4a8040b991cd {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:17:37 user nova-compute[74189]: WARNING nova.compute.manager [req-a783228d-ac00-4311-925d-557657326c9b req-2a296db7-0ba6-4857-8be7-3f8a11a35b5a service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Received unexpected event network-vif-plugged-f25ca758-602f-481b-8de2-4a8040b991cd for instance with vm_state active and task_state None.
Oct 25 21:17:37 user nova-compute[74189]: DEBUG nova.compute.manager [req-a783228d-ac00-4311-925d-557657326c9b req-2a296db7-0ba6-4857-8be7-3f8a11a35b5a service nova] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Received event network-changed-ad8e4120-613d-45c1-b25e-63ee1ed052d9 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG nova.compute.manager [req-a783228d-ac00-4311-925d-557657326c9b req-2a296db7-0ba6-4857-8be7-3f8a11a35b5a service nova] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Refreshing instance network info cache due to event network-changed-ad8e4120-613d-45c1-b25e-63ee1ed052d9. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a783228d-ac00-4311-925d-557657326c9b req-2a296db7-0ba6-4857-8be7-3f8a11a35b5a service nova] Acquiring lock "refresh_cache-e1272f33-ef5e-48e6-912f-e0beae6dde11" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a783228d-ac00-4311-925d-557657326c9b req-2a296db7-0ba6-4857-8be7-3f8a11a35b5a service nova] Acquired lock "refresh_cache-e1272f33-ef5e-48e6-912f-e0beae6dde11" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG nova.network.neutron [req-a783228d-ac00-4311-925d-557657326c9b req-2a296db7-0ba6-4857-8be7-3f8a11a35b5a service nova] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Refreshing network info cache for port ad8e4120-613d-45c1-b25e-63ee1ed052d9 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86bf853-172a-4dd4-a994-0a2d6e0e4b23]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5558755-421d-4f4f-825c-180f6fe362b1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8010fb47-5181-4c23-ae16-d2c7327c7621]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c30dfe-be4f-4f71-8a15-7e74f1e2dd6f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG os_brick.utils [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '26665363031623333', 'path': '/dev/sdc'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665363031623333', 'path': '/dev/sdc'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[daea1da1-b2df-41cf-af36-e9d4b00e2945]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG nova.objects.instance [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lazy-loading 'flavor' on Instance uuid c69c0800-7a6c-4155-9f90-bbcd323276d3 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:17:37 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[063c122a-90a3-400e-baef-a302dc960543]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG os_brick.utils [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] <== get_connector_properties: return (181ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Updating existing volume attachment record: bb8474e4-bc08-4c70-9daf-b04be181d8a2 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d8e071-cbbf-41fd-9102-63c357edf458]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG os_brick.utils [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbef18e-8af5-45eb-8100-69e299675b3f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[16eb2ae5-b8f0-4a54-81eb-597a31bdcd46]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[155c24e9-98ab-4c4f-a482-458630dc7f87]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed92395-5ef4-4d5b-8ef8-f97811c977a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 21:17:37 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:17:37 user nova-compute[74189]:   <source dev="/dev/sdc"/>
Oct 25 21:17:37 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:17:37 user nova-compute[74189]:   <serial>9682943b-f798-4b94-8f02-2ccc165c64e0</serial>
Oct 25 21:17:37 user nova-compute[74189]: </disk>
Oct 25 21:17:37 user nova-compute[74189]:  {{(pid=74189) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:17:37 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca22fb50-81b2-406b-90d8-dede34518503]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG os_brick.utils [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Updating existing volume attachment record: fa566dfd-ed98-43e0-b2ed-ee25dc684bec {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4ec4b1-4e87-4565-bbb6-76fe76aa2d9d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[516df9e2-7297-4729-bbed-5a16d3a9abc6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:17:37 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:17:37 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd98c488-b87b-4d55-8f85-36d412e1c3d7]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG os_brick.utils [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] <== get_connector_properties: return (198ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:17:37 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Updating existing volume attachment record: bf834cb8-4fca-4540-a361-932eede2ec78 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:17:38 user nova-compute[74189]: DEBUG nova.network.neutron [req-a783228d-ac00-4311-925d-557657326c9b req-2a296db7-0ba6-4857-8be7-3f8a11a35b5a service nova] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Updated VIF entry in instance network info cache for port ad8e4120-613d-45c1-b25e-63ee1ed052d9. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:17:38 user nova-compute[74189]: DEBUG nova.network.neutron [req-a783228d-ac00-4311-925d-557657326c9b req-2a296db7-0ba6-4857-8be7-3f8a11a35b5a service nova] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Updating instance_info_cache with network_info: [{"id": "ad8e4120-613d-45c1-b25e-63ee1ed052d9", "address": "fa:16:3e:33:77:40", "network": {"id": "a4d0bc71-5f07-4a91-8ea3-627594c5f0d2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1082591514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b22e5790c544d08ba63bf8f2eeb425b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8e4120-61", "ovs_interfaceid": "ad8e4120-613d-45c1-b25e-63ee1ed052d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:17:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a783228d-ac00-4311-925d-557657326c9b req-2a296db7-0ba6-4857-8be7-3f8a11a35b5a service nova] Releasing lock "refresh_cache-e1272f33-ef5e-48e6-912f-e0beae6dde11" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:17:38 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:17:38 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:17:38 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] No VIF found with MAC fa:16:3e:50:70:e6, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:17:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:49 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:17:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'atXnERlC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:17:49 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:17:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:17:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:17:49 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:17:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:17:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:17:49 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:17:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:49 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[330142fd-34bc-48ef-b213-70d54eace1eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:17:49 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:49 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c837152-0679-40dc-b7c8-2829c323122d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456] added
Oct 25 21:17:49 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:49 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[06298a74-d5da-489b-8cbb-30e8b1ac441b]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:49 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54060e0-5ce2-4814-8e54-d8c72bd66164]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v atXnERlC {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v atXnERlC" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:49 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c792b5-4bff-4dc1-8e48-2b99bfe93ae7]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'atXnERlC'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:49 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1190499c-9864-4b31-8462-0f172a2ee69e]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:49 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7b0c8b-f413-450f-89ad-6b1ded6615c4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:17:49 user nova-compute[74189]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 (non-flash)
Oct 25 21:17:49 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:17:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:17:49 user nova-compute[74189]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 (non-flash)
Oct 25 21:17:49 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:17:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[957dc8bb-b4fa-48db-b3b1-8e48548bf001]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456, portal: 172.16.0.220,3260]
Oct 25 21:17:50 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456, portal: 172.16.0.220,3260] successful.
Oct 25 21:17:50 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce266ed5-ba18-4532-b376-115a7f5f5c34]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[932500cf-afc4-4c27-b420-6ebe438afb8b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:17:50 user nova-compute[74189]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 (non-flash)
Oct 25 21:17:50 user nova-compute[74189]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 (non-flash)
Oct 25 21:17:50 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:17:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:17:50 user nova-compute[74189]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 (non-flash)
Oct 25 21:17:50 user nova-compute[74189]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 (non-flash)
Oct 25 21:17:50 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:17:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:17:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:17:50 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:17:50 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:17:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ba9d7a-5024-485f-a9b5-783981924a2b]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:50 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: None {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:17:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:51 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:17:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'atXnERlC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:17:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:17:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '26632333035663332', 'path': '/dev/sdd'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:17:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632333035663332', 'path': '/dev/sdd'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:17:51 user nova-compute[74189]: DEBUG nova.objects.instance [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lazy-loading 'flavor' on Instance uuid c4c57363-0107-4567-9842-44a0522f8326 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:17:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 21:17:51 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:17:51 user nova-compute[74189]:   <source dev="/dev/sdd"/>
Oct 25 21:17:51 user nova-compute[74189]:   <target dev="sdc" bus="scsi"/>
Oct 25 21:17:51 user nova-compute[74189]:   <serial>7e24c152-22c8-457a-a917-60a4a3e86456</serial>
Oct 25 21:17:51 user nova-compute[74189]:   <address type="drive" controller="0" unit="2"/>
Oct 25 21:17:51 user nova-compute[74189]: </disk>
Oct 25 21:17:51 user nova-compute[74189]:  {{(pid=74189) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 21:17:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] No BDM found with device name sda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:17:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:17:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:17:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] No VIF found with MAC fa:16:3e:06:5b:93, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:17:52 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ykUomIYH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:17:57 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:17:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:17:57 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:17:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:17:57 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6580d1-cdfb-4219-838e-a58afabbcbca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:17:57 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d56d75-b2b7-4c26-8dda-01e75005f873]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963] added
Oct 25 21:17:57 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb16115b-c40e-4f60-a66f-f28e9cf9ef2a]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a549a23e-8c46-4c0c-8296-696be32a87a9]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ykUomIYH {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ykUomIYH" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6590fdc-00fe-46e6-95c4-36d5aa6c90ad]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ykUomIYH'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d22d909-f888-4e89-9e40-5ef5e4b91927]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc613ec-43d8-45eb-82f8-1579154bc641]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:17:57 user nova-compute[74189]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 (non-flash)
Oct 25 21:17:57 user nova-compute[74189]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 (non-flash)
Oct 25 21:17:57 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:17:57 user nova-compute[74189]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 (non-flash)
Oct 25 21:17:57 user nova-compute[74189]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 (non-flash)
Oct 25 21:17:57 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[12747040-81c6-430b-8c1c-ddd1ce3266be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963, portal: 172.16.0.220,3260]
Oct 25 21:17:57 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963, portal: 172.16.0.220,3260] successful.
Oct 25 21:17:57 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f36798-a3de-4907-9f83-3dab96f70c19]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fd9d82-a291-4329-9386-c60f59e8acc1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:17:57 user nova-compute[74189]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 (non-flash)
Oct 25 21:17:57 user nova-compute[74189]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 (non-flash)
Oct 25 21:17:57 user nova-compute[74189]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:17:57 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:17:57 user nova-compute[74189]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 (non-flash)
Oct 25 21:17:57 user nova-compute[74189]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 (non-flash)
Oct 25 21:17:57 user nova-compute[74189]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:17:57 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe0d29d-fcf7-4899-b673-e8ea0cccecaa]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: None {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:17:57 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:17:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4c57363-0107-4567-9842-44a0522f8326/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4c57363-0107-4567-9842-44a0522f8326/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4c57363-0107-4567-9842-44a0522f8326/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4c57363-0107-4567-9842-44a0522f8326/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdd (sdc) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:17:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7bd374a1-5b58-4291-a039-b3520e20a553 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "c69c0800-7a6c-4155-9f90-bbcd323276d3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 43.643s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:17:58 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:17:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ykUomIYH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:17:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:17:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23031663734613036', 'path': '/dev/sde'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:17:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031663734613036', 'path': '/dev/sde'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:17:58 user nova-compute[74189]: DEBUG nova.objects.instance [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Lazy-loading 'flavor' on Instance uuid f52fc510-3640-468a-8a9c-b716b9d17a01 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:17:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 21:17:58 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:17:58 user nova-compute[74189]:   <source dev="/dev/sde"/>
Oct 25 21:17:58 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:17:58 user nova-compute[74189]:   <serial>e07f2603-8906-4cb9-975e-5ac25a051963</serial>
Oct 25 21:17:58 user nova-compute[74189]: </disk>
Oct 25 21:17:58 user nova-compute[74189]:  {{(pid=74189) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 21:17:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-0041be40-9f98-4aa6-8463-7aa62b4b8464 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lock "c4c57363-0107-4567-9842-44a0522f8326" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.268s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:59 user nova-compute[74189]: INFO nova.virt.block_device [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Booting with volume d138f037-f397-45e5-a79a-c3acfa6f679c at /dev/vdb
Oct 25 21:17:59 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] No VIF found with MAC fa:16:3e:50:6e:57, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG os_brick.utils [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[528961e0-9556-4d11-87f1-bc2598611bc8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c50acc-6616-4399-bf00-9818093fe57d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca4ea12-dda0-4f1c-8a44-db9f4e863df8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[76301197-6134-454f-bf2d-9e6ec17de3d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:17:59 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:17:59 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0a45e6-3bb3-4b13-b311-db03bf93c1e1]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7d9df5a7-40e0-404a-93a8-8813a9299fe0 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Lock "f52fc510-3640-468a-8a9c-b716b9d17a01" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.675s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG os_brick.utils [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] <== get_connector_properties: return (188ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Updating existing volume attachment record: d8e58bdf-bcaa-4d0d-9f15-7bc6adee6a13 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52fc510-3640-468a-8a9c-b716b9d17a01/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52fc510-3640-468a-8a9c-b716b9d17a01/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:17:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52fc510-3640-468a-8a9c-b716b9d17a01/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52fc510-3640-468a-8a9c-b716b9d17a01/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:18:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:18:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1272f33-ef5e-48e6-912f-e0beae6dde11/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1272f33-ef5e-48e6-912f-e0beae6dde11/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1272f33-ef5e-48e6-912f-e0beae6dde11/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1272f33-ef5e-48e6-912f-e0beae6dde11/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:01 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:18:01 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:18:01 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=7802MB free_disk=25.478023529052734GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:18:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:18:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:18:01 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance d7c3a99a-ab38-4e88-896d-94ae51a09a48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:18:01 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:18:01 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance c69c0800-7a6c-4155-9f90-bbcd323276d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:18:01 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance c4c57363-0107-4567-9842-44a0522f8326 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:18:01 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance ea8d22c5-3868-43d1-b101-c6cff480dea6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:18:01 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance f52fc510-3640-468a-8a9c-b716b9d17a01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:18:01 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance e1272f33-ef5e-48e6-912f-e0beae6dde11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:18:01 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance a05b75c0-c064-42c5-aca7-c4b07cfabcfb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:18:01 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 2486ac33-a881-4be1-a24e-2ff263e51818 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:18:01 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:18:01 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:18:01 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:18:01 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:18:01 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:18:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.633s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:18:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:18:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:18:02 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:18:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:18:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:18:02 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:18:02 user nova-compute[74189]: INFO nova.compute.claims [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Claim successful on node user
Oct 25 21:18:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:02 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:18:02 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:18:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:18:02 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:18:02 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:18:02 user nova-compute[74189]: DEBUG nova.network.neutron [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:18:02 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:18:02 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:18:02 user nova-compute[74189]: INFO nova.virt.block_device [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Booting with blank volume at /dev/vda
Oct 25 21:18:02 user nova-compute[74189]: DEBUG nova.policy [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc377c1beaab443683a6d776f2f734ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acbb4f93936848a8949477ad124bf98e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:18:02 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:18:02 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:18:02 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:18:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:18:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:18:03 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:18:03 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Updating instance_info_cache with network_info: [{"id": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "address": "fa:16:3e:92:dc:7e", "network": {"id": "197dd483-54ad-4b81-a0d0-26c633b3a101", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1141346509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e426fbc4bb374115a46d927092d62423", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a0280f-de", "ovs_interfaceid": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:18:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:18:03 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:18:03 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:18:03 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:18:03 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:18:03 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:18:03 user nova-compute[74189]: DEBUG nova.network.neutron [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Successfully created port: 8f4cdb73-9d83-4bde-82a4-7198b06b904b {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:18:03 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:18:04 user nova-compute[74189]: DEBUG nova.network.neutron [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Successfully updated port: 8f4cdb73-9d83-4bde-82a4-7198b06b904b {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:18:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "refresh_cache-af1d7b3c-9950-4b74-8f15-b31011ccfa24" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:18:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquired lock "refresh_cache-af1d7b3c-9950-4b74-8f15-b31011ccfa24" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:18:04 user nova-compute[74189]: DEBUG nova.network.neutron [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:18:04 user nova-compute[74189]: DEBUG nova.compute.manager [req-87ae3d5c-389f-4df6-a099-6555046effed req-ebbe9912-3401-4926-931f-a68923886142 service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Received event network-changed-8f4cdb73-9d83-4bde-82a4-7198b06b904b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:18:04 user nova-compute[74189]: DEBUG nova.compute.manager [req-87ae3d5c-389f-4df6-a099-6555046effed req-ebbe9912-3401-4926-931f-a68923886142 service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Refreshing instance network info cache due to event network-changed-8f4cdb73-9d83-4bde-82a4-7198b06b904b. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:18:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-87ae3d5c-389f-4df6-a099-6555046effed req-ebbe9912-3401-4926-931f-a68923886142 service nova] Acquiring lock "refresh_cache-af1d7b3c-9950-4b74-8f15-b31011ccfa24" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:18:04 user nova-compute[74189]: DEBUG nova.network.neutron [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:18:04 user nova-compute[74189]: DEBUG nova.network.neutron [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Updating instance_info_cache with network_info: [{"id": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "address": "fa:16:3e:03:8e:2f", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4cdb73-9d", "ovs_interfaceid": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:18:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Releasing lock "refresh_cache-af1d7b3c-9950-4b74-8f15-b31011ccfa24" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:18:04 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Instance network_info: |[{"id": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "address": "fa:16:3e:03:8e:2f", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4cdb73-9d", "ovs_interfaceid": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:18:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-87ae3d5c-389f-4df6-a099-6555046effed req-ebbe9912-3401-4926-931f-a68923886142 service nova] Acquired lock "refresh_cache-af1d7b3c-9950-4b74-8f15-b31011ccfa24" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:18:04 user nova-compute[74189]: DEBUG nova.network.neutron [req-87ae3d5c-389f-4df6-a099-6555046effed req-ebbe9912-3401-4926-931f-a68923886142 service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Refreshing network info cache for port 8f4cdb73-9d83-4bde-82a4-7198b06b904b {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:18:04 user nova-compute[74189]: DEBUG nova.network.neutron [req-87ae3d5c-389f-4df6-a099-6555046effed req-ebbe9912-3401-4926-931f-a68923886142 service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Updated VIF entry in instance network info cache for port 8f4cdb73-9d83-4bde-82a4-7198b06b904b. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:18:04 user nova-compute[74189]: DEBUG nova.network.neutron [req-87ae3d5c-389f-4df6-a099-6555046effed req-ebbe9912-3401-4926-931f-a68923886142 service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Updating instance_info_cache with network_info: [{"id": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "address": "fa:16:3e:03:8e:2f", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4cdb73-9d", "ovs_interfaceid": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:18:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-87ae3d5c-389f-4df6-a099-6555046effed req-ebbe9912-3401-4926-931f-a68923886142 service nova] Releasing lock "refresh_cache-af1d7b3c-9950-4b74-8f15-b31011ccfa24" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:18:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AqtCIeYL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:18:09 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:18:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:18:09 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:18:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:18:09 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:18:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a1779c-deb3-429f-9d73-dc146b879fc3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:18:09 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[301d9f2b-d3e3-4b1e-9482-2d211b2ec18b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b] added
Oct 25 21:18:09 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6d7573-2177-4c25-a4dc-4d9bd5f5f1a2]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f3e137-e608-4fa1-b2fd-33c4bcabbf40]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AqtCIeYL {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AqtCIeYL" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e65d69-30a9-4d39-bebe-ea9dc2d7a00b]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AqtCIeYL'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e35e4b-9325-4659-9540-81c2e7ab7b6f]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[83670bef-1e74-4ddf-8c0a-2cd6cccaa2fc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:18:09 user nova-compute[74189]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 (non-flash)
Oct 25 21:18:09 user nova-compute[74189]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 (non-flash)
Oct 25 21:18:09 user nova-compute[74189]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:18:09 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:18:09 user nova-compute[74189]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 (non-flash)
Oct 25 21:18:09 user nova-compute[74189]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 (non-flash)
Oct 25 21:18:09 user nova-compute[74189]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:18:09 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[039b9b07-d00d-4af0-aa5f-c188b739f935]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b, portal: 172.16.0.220,3260]
Oct 25 21:18:09 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b, portal: 172.16.0.220,3260] successful.
Oct 25 21:18:09 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[91df36a6-85ff-4360-895e-21fd8c863c87]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee9a28e-ffe2-4d2a-94d2-5dfb0d88c774]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:18:09 user nova-compute[74189]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 (non-flash)
Oct 25 21:18:09 user nova-compute[74189]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 (non-flash)
Oct 25 21:18:09 user nova-compute[74189]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:18:09 user nova-compute[74189]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b (non-flash)
Oct 25 21:18:09 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:18:09 user nova-compute[74189]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 (non-flash)
Oct 25 21:18:09 user nova-compute[74189]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 (non-flash)
Oct 25 21:18:09 user nova-compute[74189]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:18:09 user nova-compute[74189]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b (non-flash)
Oct 25 21:18:09 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a74fb8-3141-46f2-9c4e-cfd4218b8f3f]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:18:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AqtCIeYL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:18:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Acquiring lock "c69c0800-7a6c-4155-9f90-bbcd323276d3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:18:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "c69c0800-7a6c-4155-9f90-bbcd323276d3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:18:10 user nova-compute[74189]: INFO nova.compute.manager [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Detaching volume 9682943b-f798-4b94-8f02-2ccc165c64e0
Oct 25 21:18:11 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.735s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] <== connect_volume: return (1736ms) {'type': 'block', 'scsi_wwn': '23333626433663435', 'path': '/dev/sdf'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333626433663435', 'path': '/dev/sdf'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG nova.objects.instance [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lazy-loading 'flavor' on Instance uuid ea8d22c5-3868-43d1-b101-c6cff480dea6 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Acquiring lock "f52fc510-3640-468a-8a9c-b716b9d17a01" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Lock "f52fc510-3640-468a-8a9c-b716b9d17a01" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Acquiring lock "c4c57363-0107-4567-9842-44a0522f8326" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lock "c4c57363-0107-4567-9842-44a0522f8326" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 21:18:11 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:18:11 user nova-compute[74189]:   <source dev="/dev/sdf"/>
Oct 25 21:18:11 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:18:11 user nova-compute[74189]:   <serial>7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b</serial>
Oct 25 21:18:11 user nova-compute[74189]: </disk>
Oct 25 21:18:11 user nova-compute[74189]:  {{(pid=74189) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 21:18:11 user nova-compute[74189]: INFO nova.compute.manager [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Detaching volume 7e24c152-22c8-457a-a917-60a4a3e86456
Oct 25 21:18:11 user nova-compute[74189]: DEBUG os_brick.utils [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4c1db6-8cbc-43af-9fb3-395920cc190f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1fc3fe-74d8-444a-91e5-c0d4b6844195]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:11 user nova-compute[74189]: INFO nova.virt.block_device [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Attempting to driver detach volume 9682943b-f798-4b94-8f02-2ccc165c64e0 from mountpoint /dev/vdb
Oct 25 21:18:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5a0a89-5ca8-44aa-87d0-bbd49aff3446]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff39a2ac-e437-455e-a2e4-fa418677de66]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Attempting to detach device vdb from instance c69c0800-7a6c-4155-9f90-bbcd323276d3 from the persistent domain config. {{(pid=74189) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:18:11 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:18:11 user nova-compute[74189]:   <source dev="/dev/sdc"/>
Oct 25 21:18:11 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:18:11 user nova-compute[74189]:   <serial>9682943b-f798-4b94-8f02-2ccc165c64e0</serial>
Oct 25 21:18:11 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:18:11 user nova-compute[74189]: </disk>
Oct 25 21:18:11 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:18:11 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Successfully detached device vdb from instance c69c0800-7a6c-4155-9f90-bbcd323276d3 from the persistent domain config.
Oct 25 21:18:11 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c69c0800-7a6c-4155-9f90-bbcd323276d3 from the live domain config. {{(pid=74189) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:18:11 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:18:11 user nova-compute[74189]:   <source dev="/dev/sdc"/>
Oct 25 21:18:11 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:18:11 user nova-compute[74189]:   <serial>9682943b-f798-4b94-8f02-2ccc165c64e0</serial>
Oct 25 21:18:11 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:18:11 user nova-compute[74189]: </disk>
Oct 25 21:18:11 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:18:11 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:18:11 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae15efa-28f1-41db-b696-3e72016a8a2a]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG os_brick.utils [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:18:11 user nova-compute[74189]: INFO nova.virt.block_device [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Attempting to driver detach volume 7e24c152-22c8-457a-a917-60a4a3e86456 from mountpoint /dev/sdc
Oct 25 21:18:11 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Attempting to detach device sdc from instance c4c57363-0107-4567-9842-44a0522f8326 from the persistent domain config. {{(pid=74189) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:18:11 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:18:11 user nova-compute[74189]:   <source dev="/dev/sdd"/>
Oct 25 21:18:11 user nova-compute[74189]:   <target dev="sdc" bus="scsi"/>
Oct 25 21:18:11 user nova-compute[74189]:   <serial>7e24c152-22c8-457a-a917-60a4a3e86456</serial>
Oct 25 21:18:11 user nova-compute[74189]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 25 21:18:11 user nova-compute[74189]: </disk>
Oct 25 21:18:11 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:18:11 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Successfully detached device sdc from instance c4c57363-0107-4567-9842-44a0522f8326 from the persistent domain config.
Oct 25 21:18:11 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance c4c57363-0107-4567-9842-44a0522f8326 from the live domain config. {{(pid=74189) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:18:11 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:18:11 user nova-compute[74189]:   <source dev="/dev/sdd"/>
Oct 25 21:18:11 user nova-compute[74189]:   <target dev="sdc" bus="scsi"/>
Oct 25 21:18:11 user nova-compute[74189]:   <serial>7e24c152-22c8-457a-a917-60a4a3e86456</serial>
Oct 25 21:18:11 user nova-compute[74189]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 25 21:18:11 user nova-compute[74189]: </disk>
Oct 25 21:18:11 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:18:11 user nova-compute[74189]: INFO nova.compute.manager [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Swapping volume e07f2603-8906-4cb9-975e-5ac25a051963 for 5f947800-cc9c-4224-86f6-d1e72d1c2d9e
Oct 25 21:18:11 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] No BDM found with device name hda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] No VIF found with MAC fa:16:3e:63:71:94, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:18:11 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c69c0800-7a6c-4155-9f90-bbcd323276d3 {{(pid=74189) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 21:18:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance c4c57363-0107-4567-9842-44a0522f8326 {{(pid=74189) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 21:18:15 user nova-compute[74189]: DEBUG nova.compute.manager [req-f2dd9809-12db-4075-be86-7f06018658c3 req-b180c0e6-df15-4c13-a0ed-5a4b86999ea6 service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Received event network-changed-d28e4203-5fff-4a0b-b360-fe29bfa131b8 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:18:15 user nova-compute[74189]: DEBUG nova.compute.manager [req-f2dd9809-12db-4075-be86-7f06018658c3 req-b180c0e6-df15-4c13-a0ed-5a4b86999ea6 service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Refreshing instance network info cache due to event network-changed-d28e4203-5fff-4a0b-b360-fe29bfa131b8. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:18:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f2dd9809-12db-4075-be86-7f06018658c3 req-b180c0e6-df15-4c13-a0ed-5a4b86999ea6 service nova] Acquiring lock "refresh_cache-a05b75c0-c064-42c5-aca7-c4b07cfabcfb" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:18:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f2dd9809-12db-4075-be86-7f06018658c3 req-b180c0e6-df15-4c13-a0ed-5a4b86999ea6 service nova] Acquired lock "refresh_cache-a05b75c0-c064-42c5-aca7-c4b07cfabcfb" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:18:15 user nova-compute[74189]: DEBUG nova.network.neutron [req-f2dd9809-12db-4075-be86-7f06018658c3 req-b180c0e6-df15-4c13-a0ed-5a4b86999ea6 service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Refreshing network info cache for port d28e4203-5fff-4a0b-b360-fe29bfa131b8 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:18:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:18:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 21:18:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:18:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:18:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:18:16 user nova-compute[74189]: DEBUG nova.network.neutron [req-f2dd9809-12db-4075-be86-7f06018658c3 req-b180c0e6-df15-4c13-a0ed-5a4b86999ea6 service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Updated VIF entry in instance network info cache for port d28e4203-5fff-4a0b-b360-fe29bfa131b8. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:18:16 user nova-compute[74189]: DEBUG nova.network.neutron [req-f2dd9809-12db-4075-be86-7f06018658c3 req-b180c0e6-df15-4c13-a0ed-5a4b86999ea6 service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Updating instance_info_cache with network_info: [{"id": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "address": "fa:16:3e:88:75:56", "network": {"id": "75c09903-d1c6-4197-bc70-cfe7f3e7a772", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1909568880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa384e522324f0fa297ca277820909f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd28e4203-5f", "ovs_interfaceid": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:18:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f2dd9809-12db-4075-be86-7f06018658c3 req-b180c0e6-df15-4c13-a0ed-5a4b86999ea6 service nova] Releasing lock "refresh_cache-a05b75c0-c064-42c5-aca7-c4b07cfabcfb" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:18:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NgrQvkhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:18:18 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:18:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:18:18 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:18:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:18:18 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:18:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b7f1b4-2ae0-4348-a4ad-582852255a19]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:18:18 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[56475ebb-528d-43f2-abb5-f0245c3a06be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d] added
Oct 25 21:18:18 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad6a14b-0de6-4892-bf07-60b12b2f16f0]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2505ac0d-0116-46fa-800e-c2acee06e698]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NgrQvkhW {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NgrQvkhW" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6dc0eb4-6c7e-4f63-93b0-3d06c5f65bcd]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NgrQvkhW'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ff72f4-27b9-4c97-9e19-19710fa787b7]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4724c2db-16a9-4842-94d4-ec6cf51cb6e4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:18:18 user nova-compute[74189]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 (non-flash)
Oct 25 21:18:18 user nova-compute[74189]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 (non-flash)
Oct 25 21:18:18 user nova-compute[74189]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:18:18 user nova-compute[74189]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b (non-flash)
Oct 25 21:18:18 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:18:18 user nova-compute[74189]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 (non-flash)
Oct 25 21:18:18 user nova-compute[74189]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 (non-flash)
Oct 25 21:18:18 user nova-compute[74189]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:18:18 user nova-compute[74189]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b (non-flash)
Oct 25 21:18:18 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b43970e9-3298-40f9-8b41-cacd0e22a605 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lock "ea8d22c5-3868-43d1-b101-c6cff480dea6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 41.502s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6a7058-fba8-4550-9ad2-f090534f5652]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d, portal: 172.16.0.220,3260]
Oct 25 21:18:18 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d, portal: 172.16.0.220,3260] successful.
Oct 25 21:18:18 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e265100e-af4c-4d7f-aa65-788f858fed0a]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2cd0324-6fb0-4c44-91c2-9535884f3263]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:18:18 user nova-compute[74189]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 (non-flash)
Oct 25 21:18:18 user nova-compute[74189]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 (non-flash)
Oct 25 21:18:18 user nova-compute[74189]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:18:18 user nova-compute[74189]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b (non-flash)
Oct 25 21:18:18 user nova-compute[74189]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)
Oct 25 21:18:18 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:18:18 user nova-compute[74189]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 (non-flash)
Oct 25 21:18:18 user nova-compute[74189]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 (non-flash)
Oct 25 21:18:18 user nova-compute[74189]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:18:18 user nova-compute[74189]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b (non-flash)
Oct 25 21:18:18 user nova-compute[74189]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)
Oct 25 21:18:18 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a725805-e83c-4602-b85b-acbc7472ab04]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:18:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NgrQvkhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:18:19 user nova-compute[74189]: DEBUG os_brick.utils [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:18:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[698e0aba-7f1b-4f40-a006-25e8905e1fb7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[617b8d53-2051-41ac-9f87-393c2c619ec5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fbb763-c043-440a-b788-678e8d23cc9b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23c8505-8507-49d6-a8aa-bd5bb0378b52]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:18:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:18:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:18:19 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:18:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1553312e-bfad-439d-9148-9f59ab656d40]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:18:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:18:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:18:19 user nova-compute[74189]: DEBUG os_brick.utils [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:18:19 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Updating existing volume attachment record: 12781d70-7865-4eca-a41a-d93c04235083 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:18:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:18:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23463336262626534', 'path': '/dev/sdg'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:18:19 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463336262626534', 'path': '/dev/sdg'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:18:19 user nova-compute[74189]: DEBUG nova.objects.instance [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Lazy-loading 'flavor' on Instance uuid e1272f33-ef5e-48e6-912f-e0beae6dde11 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:18:19 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] attach device xml: <disk type="block" device="disk">
Oct 25 21:18:19 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:18:19 user nova-compute[74189]:   <source dev="/dev/sdg"/>
Oct 25 21:18:19 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:18:19 user nova-compute[74189]:   <serial>257a6a89-a1a5-45bc-baad-5765b0f3355d</serial>
Oct 25 21:18:19 user nova-compute[74189]: </disk>
Oct 25 21:18:19 user nova-compute[74189]:  {{(pid=74189) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 21:18:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Acquiring lock "c05f317d-c6ea-4755-a9c7-42b90974ef1d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:18:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Lock "c05f317d-c6ea-4755-a9c7-42b90974ef1d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:18:20 user nova-compute[74189]: DEBUG nova.compute.manager [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:18:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:18:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:18:20 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:18:20 user nova-compute[74189]: INFO nova.compute.claims [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Claim successful on node user
Oct 25 21:18:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:18:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:18:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] No VIF found with MAC fa:16:3e:33:77:40, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:18:20 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:18:20 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:18:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:18:20 user nova-compute[74189]: DEBUG nova.compute.manager [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:18:20 user nova-compute[74189]: DEBUG nova.compute.manager [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:18:20 user nova-compute[74189]: DEBUG nova.network.neutron [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:18:20 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:18:20 user nova-compute[74189]: DEBUG nova.compute.manager [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:18:20 user nova-compute[74189]: DEBUG nova.policy [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9225bf1b5edd4f5bb0eb377f845f6a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3914bbc7448199c13a60b8752df35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:18:20 user nova-compute[74189]: DEBUG nova.compute.manager [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:18:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:18:20 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Creating image(s)
Oct 25 21:18:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Acquiring lock "/opt/stack/data/nova/instances/c05f317d-c6ea-4755-a9c7-42b90974ef1d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:18:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Lock "/opt/stack/data/nova/instances/c05f317d-c6ea-4755-a9c7-42b90974ef1d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:18:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Lock "/opt/stack/data/nova/instances/c05f317d-c6ea-4755-a9c7-42b90974ef1d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:18:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.199s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:18:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:18:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.172s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/c05f317d-c6ea-4755-a9c7-42b90974ef1d/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/c05f317d-c6ea-4755-a9c7-42b90974ef1d/disk 1073741824" returned: 0 in 0.059s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:18:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:21 user nova-compute[74189]: DEBUG nova.network.neutron [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Successfully created port: ec91d2a1-8aac-414c-8a69-9d6013830336 {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:18:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.228s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:21 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c05f317d-c6ea-4755-a9c7-42b90974ef1d/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:18:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c05f317d-c6ea-4755-a9c7-42b90974ef1d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c05f317d-c6ea-4755-a9c7-42b90974ef1d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:21 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Cannot resize image /opt/stack/data/nova/instances/c05f317d-c6ea-4755-a9c7-42b90974ef1d/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:18:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:18:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Ensure instance console log exists: /opt/stack/data/nova/instances/c05f317d-c6ea-4755-a9c7-42b90974ef1d/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:18:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:18:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:18:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:18:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:22 user nova-compute[74189]: DEBUG nova.network.neutron [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Successfully updated port: ec91d2a1-8aac-414c-8a69-9d6013830336 {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:18:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Acquiring lock "refresh_cache-c05f317d-c6ea-4755-a9c7-42b90974ef1d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:18:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Acquired lock "refresh_cache-c05f317d-c6ea-4755-a9c7-42b90974ef1d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:18:22 user nova-compute[74189]: DEBUG nova.network.neutron [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:18:22 user nova-compute[74189]: DEBUG nova.compute.manager [req-169a1f69-2677-47b7-8ede-33d83f51001f req-2d051e33-1eac-402e-80ff-c2b5de0ccfcc service nova] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Received event network-changed-ec91d2a1-8aac-414c-8a69-9d6013830336 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:18:22 user nova-compute[74189]: DEBUG nova.compute.manager [req-169a1f69-2677-47b7-8ede-33d83f51001f req-2d051e33-1eac-402e-80ff-c2b5de0ccfcc service nova] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Refreshing instance network info cache due to event network-changed-ec91d2a1-8aac-414c-8a69-9d6013830336. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:18:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-169a1f69-2677-47b7-8ede-33d83f51001f req-2d051e33-1eac-402e-80ff-c2b5de0ccfcc service nova] Acquiring lock "refresh_cache-c05f317d-c6ea-4755-a9c7-42b90974ef1d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:18:22 user nova-compute[74189]: DEBUG nova.network.neutron [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:18:22 user nova-compute[74189]: DEBUG nova.network.neutron [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Updating instance_info_cache with network_info: [{"id": "ec91d2a1-8aac-414c-8a69-9d6013830336", "address": "fa:16:3e:db:f1:61", "network": {"id": "ecc9706f-95eb-4da4-8fda-55d21e03627d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1714f2820764423b9f4461ac8cbd9965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec91d2a1-8a", "ovs_interfaceid": "ec91d2a1-8aac-414c-8a69-9d6013830336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Releasing lock "refresh_cache-c05f317d-c6ea-4755-a9c7-42b90974ef1d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG nova.compute.manager [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Instance network_info: |[{"id": "ec91d2a1-8aac-414c-8a69-9d6013830336", "address": "fa:16:3e:db:f1:61", "network": {"id": "ecc9706f-95eb-4da4-8fda-55d21e03627d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1714f2820764423b9f4461ac8cbd9965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec91d2a1-8a", "ovs_interfaceid": "ec91d2a1-8aac-414c-8a69-9d6013830336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-169a1f69-2677-47b7-8ede-33d83f51001f req-2d051e33-1eac-402e-80ff-c2b5de0ccfcc service nova] Acquired lock "refresh_cache-c05f317d-c6ea-4755-a9c7-42b90974ef1d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG nova.network.neutron [req-169a1f69-2677-47b7-8ede-33d83f51001f req-2d051e33-1eac-402e-80ff-c2b5de0ccfcc service nova] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Refreshing network info cache for port ec91d2a1-8aac-414c-8a69-9d6013830336 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Start _get_guest_xml network_info=[{"id": "ec91d2a1-8aac-414c-8a69-9d6013830336", "address": "fa:16:3e:db:f1:61", "network": {"id": "ecc9706f-95eb-4da4-8fda-55d21e03627d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1714f2820764423b9f4461ac8cbd9965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec91d2a1-8a", "ovs_interfaceid": "ec91d2a1-8aac-414c-8a69-9d6013830336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:18:23 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:18:23 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:18:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:18:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-695191242',display_name='tempest-VolumesNegativeTest-instance-695191242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-695191242',id=12,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aba3914bbc7448199c13a60b8752df35',ramdisk_id='',reservation_id='r-e6ukz923',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-219077880',owner_user_name='tempest-VolumesNegativeTest-219077880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:18:21Z,user_data=None,user_id='9225bf1b5edd4f5bb0eb377f845f6a75',uuid=c05f317d-c6ea-4755-a9c7-42b90974ef1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec91d2a1-8aac-414c-8a69-9d6013830336", "address": "fa:16:3e:db:f1:61", "network": {"id": "ecc9706f-95eb-4da4-8fda-55d21e03627d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1714f2820764423b9f4461ac8cbd9965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec91d2a1-8a", "ovs_interfaceid": "ec91d2a1-8aac-414c-8a69-9d6013830336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Converting VIF {"id": "ec91d2a1-8aac-414c-8a69-9d6013830336", "address": "fa:16:3e:db:f1:61", "network": {"id": "ecc9706f-95eb-4da4-8fda-55d21e03627d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1714f2820764423b9f4461ac8cbd9965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec91d2a1-8a", "ovs_interfaceid": "ec91d2a1-8aac-414c-8a69-9d6013830336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:f1:61,bridge_name='br-int',has_traffic_filtering=True,id=ec91d2a1-8aac-414c-8a69-9d6013830336,network=Network(ecc9706f-95eb-4da4-8fda-55d21e03627d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec91d2a1-8a') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG nova.objects.instance [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Lazy-loading 'pci_devices' on Instance uuid c05f317d-c6ea-4755-a9c7-42b90974ef1d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:18:23 user nova-compute[74189]:   <uuid>c05f317d-c6ea-4755-a9c7-42b90974ef1d</uuid>
Oct 25 21:18:23 user nova-compute[74189]:   <name>instance-0000000c</name>
Oct 25 21:18:23 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:18:23 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:18:23 user nova-compute[74189]:   <metadata>
Oct 25 21:18:23 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:18:23 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:18:23 user nova-compute[74189]:       <nova:name>tempest-VolumesNegativeTest-instance-695191242</nova:name>
Oct 25 21:18:23 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:18:23</nova:creationTime>
Oct 25 21:18:23 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:18:23 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:18:23 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:18:23 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:18:23 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:18:23 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:18:23 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:18:23 user nova-compute[74189]:       <nova:owner>
Oct 25 21:18:23 user nova-compute[74189]:         <nova:user uuid="9225bf1b5edd4f5bb0eb377f845f6a75">tempest-VolumesNegativeTest-219077880-project-member</nova:user>
Oct 25 21:18:23 user nova-compute[74189]:         <nova:project uuid="aba3914bbc7448199c13a60b8752df35">tempest-VolumesNegativeTest-219077880</nova:project>
Oct 25 21:18:23 user nova-compute[74189]:       </nova:owner>
Oct 25 21:18:23 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:18:23 user nova-compute[74189]:       <nova:ports>
Oct 25 21:18:23 user nova-compute[74189]:         <nova:port uuid="ec91d2a1-8aac-414c-8a69-9d6013830336">
Oct 25 21:18:23 user nova-compute[74189]:           <nova:ip type="fixed" address="192.168.233.88" ipVersion="4"/>
Oct 25 21:18:23 user nova-compute[74189]:         </nova:port>
Oct 25 21:18:23 user nova-compute[74189]:       </nova:ports>
Oct 25 21:18:23 user nova-compute[74189]:     </nova:instance>
Oct 25 21:18:23 user nova-compute[74189]:   </metadata>
Oct 25 21:18:23 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:18:23 user nova-compute[74189]:     <system>
Oct 25 21:18:23 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:18:23 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:18:23 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:18:23 user nova-compute[74189]:       <entry name="serial">c05f317d-c6ea-4755-a9c7-42b90974ef1d</entry>
Oct 25 21:18:23 user nova-compute[74189]:       <entry name="uuid">c05f317d-c6ea-4755-a9c7-42b90974ef1d</entry>
Oct 25 21:18:23 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:18:23 user nova-compute[74189]:     </system>
Oct 25 21:18:23 user nova-compute[74189]:   </sysinfo>
Oct 25 21:18:23 user nova-compute[74189]:   <os>
Oct 25 21:18:23 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:18:23 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:18:23 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:18:23 user nova-compute[74189]:   </os>
Oct 25 21:18:23 user nova-compute[74189]:   <features>
Oct 25 21:18:23 user nova-compute[74189]:     <acpi/>
Oct 25 21:18:23 user nova-compute[74189]:     <apic/>
Oct 25 21:18:23 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:18:23 user nova-compute[74189]:   </features>
Oct 25 21:18:23 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:18:23 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:18:23 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:18:23 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:18:23 user nova-compute[74189]:   </clock>
Oct 25 21:18:23 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:18:23 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:18:23 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:18:23 user nova-compute[74189]:   </cpu>
Oct 25 21:18:23 user nova-compute[74189]:   <devices>
Oct 25 21:18:23 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:18:23 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:18:23 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/c05f317d-c6ea-4755-a9c7-42b90974ef1d/disk"/>
Oct 25 21:18:23 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:18:23 user nova-compute[74189]:     </disk>
Oct 25 21:18:23 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:18:23 user nova-compute[74189]:       <mac address="fa:16:3e:db:f1:61"/>
Oct 25 21:18:23 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:18:23 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:18:23 user nova-compute[74189]:       <target dev="tapec91d2a1-8a"/>
Oct 25 21:18:23 user nova-compute[74189]:     </interface>
Oct 25 21:18:23 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:18:23 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/c05f317d-c6ea-4755-a9c7-42b90974ef1d/console.log" append="off"/>
Oct 25 21:18:23 user nova-compute[74189]:     </serial>
Oct 25 21:18:23 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:18:23 user nova-compute[74189]:     <video>
Oct 25 21:18:23 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:18:23 user nova-compute[74189]:     </video>
Oct 25 21:18:23 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:18:23 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:18:23 user nova-compute[74189]:     </rng>
Oct 25 21:18:23 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:18:23 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:18:23 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:18:23 user nova-compute[74189]:     </memballoon>
Oct 25 21:18:23 user nova-compute[74189]:   </devices>
Oct 25 21:18:23 user nova-compute[74189]: </domain>
Oct 25 21:18:23 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:18:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-695191242',display_name='tempest-VolumesNegativeTest-instance-695191242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-695191242',id=12,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aba3914bbc7448199c13a60b8752df35',ramdisk_id='',reservation_id='r-e6ukz923',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-219077880',owner_user_name='tempest-VolumesNegativeTest-219077880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:18:21Z,user_data=None,user_id='9225bf1b5edd4f5bb0eb377f845f6a75',uuid=c05f317d-c6ea-4755-a9c7-42b90974ef1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec91d2a1-8aac-414c-8a69-9d6013830336", "address": "fa:16:3e:db:f1:61", "network": {"id": "ecc9706f-95eb-4da4-8fda-55d21e03627d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1714f2820764423b9f4461ac8cbd9965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec91d2a1-8a", "ovs_interfaceid": "ec91d2a1-8aac-414c-8a69-9d6013830336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Converting VIF {"id": "ec91d2a1-8aac-414c-8a69-9d6013830336", "address": "fa:16:3e:db:f1:61", "network": {"id": "ecc9706f-95eb-4da4-8fda-55d21e03627d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1714f2820764423b9f4461ac8cbd9965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec91d2a1-8a", "ovs_interfaceid": "ec91d2a1-8aac-414c-8a69-9d6013830336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:f1:61,bridge_name='br-int',has_traffic_filtering=True,id=ec91d2a1-8aac-414c-8a69-9d6013830336,network=Network(ecc9706f-95eb-4da4-8fda-55d21e03627d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec91d2a1-8a') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG os_vif [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:f1:61,bridge_name='br-int',has_traffic_filtering=True,id=ec91d2a1-8aac-414c-8a69-9d6013830336,network=Network(ecc9706f-95eb-4da4-8fda-55d21e03627d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec91d2a1-8a') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '09825900-6cd1-578e-b3a0-de8f9cda2e7a', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec91d2a1-8a, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec91d2a1-8a, col_values=(('qos', UUID('161fc9f8-6243-4c40-94f3-654535eb4268')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec91d2a1-8a, col_values=(('external_ids', {'iface-id': 'ec91d2a1-8aac-414c-8a69-9d6013830336', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:f1:61', 'vm-uuid': 'c05f317d-c6ea-4755-a9c7-42b90974ef1d'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:23 user nova-compute[74189]: INFO os_vif [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:f1:61,bridge_name='br-int',has_traffic_filtering=True,id=ec91d2a1-8aac-414c-8a69-9d6013830336,network=Network(ecc9706f-95eb-4da4-8fda-55d21e03627d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec91d2a1-8a')
Oct 25 21:18:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] No VIF found with MAC fa:16:3e:db:f1:61, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG nova.network.neutron [req-169a1f69-2677-47b7-8ede-33d83f51001f req-2d051e33-1eac-402e-80ff-c2b5de0ccfcc service nova] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Updated VIF entry in instance network info cache for port ec91d2a1-8aac-414c-8a69-9d6013830336. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG nova.network.neutron [req-169a1f69-2677-47b7-8ede-33d83f51001f req-2d051e33-1eac-402e-80ff-c2b5de0ccfcc service nova] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Updating instance_info_cache with network_info: [{"id": "ec91d2a1-8aac-414c-8a69-9d6013830336", "address": "fa:16:3e:db:f1:61", "network": {"id": "ecc9706f-95eb-4da4-8fda-55d21e03627d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1714f2820764423b9f4461ac8cbd9965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec91d2a1-8a", "ovs_interfaceid": "ec91d2a1-8aac-414c-8a69-9d6013830336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:18:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-169a1f69-2677-47b7-8ede-33d83f51001f req-2d051e33-1eac-402e-80ff-c2b5de0ccfcc service nova] Releasing lock "refresh_cache-c05f317d-c6ea-4755-a9c7-42b90974ef1d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:18:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:24 user nova-compute[74189]: DEBUG nova.compute.manager [req-e6fe5c62-4b29-4cb9-9d62-5d314b7f27e1 req-b7dd1882-801d-446f-843e-adb7a7468972 service nova] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Received event network-vif-plugged-ec91d2a1-8aac-414c-8a69-9d6013830336 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:18:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e6fe5c62-4b29-4cb9-9d62-5d314b7f27e1 req-b7dd1882-801d-446f-843e-adb7a7468972 service nova] Acquiring lock "c05f317d-c6ea-4755-a9c7-42b90974ef1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:18:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e6fe5c62-4b29-4cb9-9d62-5d314b7f27e1 req-b7dd1882-801d-446f-843e-adb7a7468972 service nova] Lock "c05f317d-c6ea-4755-a9c7-42b90974ef1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:18:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e6fe5c62-4b29-4cb9-9d62-5d314b7f27e1 req-b7dd1882-801d-446f-843e-adb7a7468972 service nova] Lock "c05f317d-c6ea-4755-a9c7-42b90974ef1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:18:24 user nova-compute[74189]: DEBUG nova.compute.manager [req-e6fe5c62-4b29-4cb9-9d62-5d314b7f27e1 req-b7dd1882-801d-446f-843e-adb7a7468972 service nova] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] No waiting events found dispatching network-vif-plugged-ec91d2a1-8aac-414c-8a69-9d6013830336 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:18:24 user nova-compute[74189]: WARNING nova.compute.manager [req-e6fe5c62-4b29-4cb9-9d62-5d314b7f27e1 req-b7dd1882-801d-446f-843e-adb7a7468972 service nova] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Received unexpected event network-vif-plugged-ec91d2a1-8aac-414c-8a69-9d6013830336 for instance with vm_state building and task_state spawning.
Oct 25 21:18:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:26 user nova-compute[74189]: DEBUG nova.compute.manager [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:18:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:18:26 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Instance spawned successfully.
Oct 25 21:18:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:18:26 user nova-compute[74189]: DEBUG nova.compute.manager [req-4032ea2c-6822-48b5-9d06-0c7c68267ef7 req-e3da4278-877c-4f43-bc6a-c467dc64872b service nova] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Received event network-vif-plugged-ec91d2a1-8aac-414c-8a69-9d6013830336 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:18:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4032ea2c-6822-48b5-9d06-0c7c68267ef7 req-e3da4278-877c-4f43-bc6a-c467dc64872b service nova] Acquiring lock "c05f317d-c6ea-4755-a9c7-42b90974ef1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:18:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4032ea2c-6822-48b5-9d06-0c7c68267ef7 req-e3da4278-877c-4f43-bc6a-c467dc64872b service nova] Lock "c05f317d-c6ea-4755-a9c7-42b90974ef1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:18:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4032ea2c-6822-48b5-9d06-0c7c68267ef7 req-e3da4278-877c-4f43-bc6a-c467dc64872b service nova] Lock "c05f317d-c6ea-4755-a9c7-42b90974ef1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:18:26 user nova-compute[74189]: DEBUG nova.compute.manager [req-4032ea2c-6822-48b5-9d06-0c7c68267ef7 req-e3da4278-877c-4f43-bc6a-c467dc64872b service nova] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] No waiting events found dispatching network-vif-plugged-ec91d2a1-8aac-414c-8a69-9d6013830336 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:18:26 user nova-compute[74189]: WARNING nova.compute.manager [req-4032ea2c-6822-48b5-9d06-0c7c68267ef7 req-e3da4278-877c-4f43-bc6a-c467dc64872b service nova] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Received unexpected event network-vif-plugged-ec91d2a1-8aac-414c-8a69-9d6013830336 for instance with vm_state building and task_state spawning.
Oct 25 21:18:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:18:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:18:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:18:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:18:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:18:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:18:26 user nova-compute[74189]: INFO nova.compute.manager [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Took 6.06 seconds to spawn the instance on the hypervisor.
Oct 25 21:18:26 user nova-compute[74189]: DEBUG nova.compute.manager [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:18:27 user nova-compute[74189]: INFO nova.compute.manager [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Took 6.90 seconds to build instance.
Oct 25 21:18:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e37d301e-80e9-48f7-9cc5-ed5351cd1330 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Lock "c05f317d-c6ea-4755-a9c7-42b90974ef1d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.126s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:18:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:31 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c69c0800-7a6c-4155-9f90-bbcd323276d3 is timed out.
Oct 25 21:18:31 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Successfully detached device vdb from instance c69c0800-7a6c-4155-9f90-bbcd323276d3 from the live domain config.
Oct 25 21:18:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mEFBQrzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:18:31 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:18:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9723a2-20e9-4361-9ffe-beec75e333ed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:18:31 user nova-compute[74189]: No targets found.
Oct 25 21:18:31 user nova-compute[74189]: iSNS:
Oct 25 21:18:31 user nova-compute[74189]: No targets found.
Oct 25 21:18:31 user nova-compute[74189]: STATIC:
Oct 25 21:18:31 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963
Oct 25 21:18:31 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:18:31 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:18:31 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e
Oct 25 21:18:31 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:18:31 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:18:31 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b
Oct 25 21:18:31 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:18:31 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:18:31 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0
Oct 25 21:18:31 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:18:31 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:18:31 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456
Oct 25 21:18:31 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:18:31 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:18:31 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d
Oct 25 21:18:31 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:18:31 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:18:31 user nova-compute[74189]: FIRMWARE:
Oct 25 21:18:31 user nova-compute[74189]: No targets found.
Oct 25 21:18:31 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:18:31 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:18:31 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1b92d3-4e29-4112-b9e5-dd2163a4af12]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[09380df5-f073-4b94-a004-8fef1fc018db]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:18:31 user nova-compute[74189]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 (non-flash)
Oct 25 21:18:31 user nova-compute[74189]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 (non-flash)
Oct 25 21:18:31 user nova-compute[74189]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:18:31 user nova-compute[74189]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b (non-flash)
Oct 25 21:18:31 user nova-compute[74189]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)
Oct 25 21:18:31 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:18:31 user nova-compute[74189]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 (non-flash)
Oct 25 21:18:31 user nova-compute[74189]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 (non-flash)
Oct 25 21:18:31 user nova-compute[74189]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:18:31 user nova-compute[74189]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b (non-flash)
Oct 25 21:18:31 user nova-compute[74189]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)
Oct 25 21:18:31 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3042681f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0'): ({'sdc'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Removing single pathed devices sdc {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2781de-70f2-49ac-ad3a-6421da0aedb7]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[995f5d23-1c7f-4975-aec2-87b42a4e9a67]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Flushing IO for device /dev/sdc {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[891140b2-5639-4ec3-a712-c53081092aeb]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bdea98-5b60-4ef2-8ce3-b7a30afca72d]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] SCSI volumes sdc have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:18:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6abc57-aa53-4a07-9921-bf2981663181]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb485df4-9b1d-432d-a22d-18d15cbde7c7]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0, portal: 172.16.0.220,3260]
Oct 25 21:18:32 user nova-compute[74189]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0, portal: 172.16.0.220,3260] successful.
Oct 25 21:18:32 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:32 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance c4c57363-0107-4567-9842-44a0522f8326 is timed out.
Oct 25 21:18:32 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Successfully detached device sdc from instance c4c57363-0107-4567-9842-44a0522f8326 from the live domain config.
Oct 25 21:18:32 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'atXnERlC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:18:32 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9682943b-f798-4b94-8f02-2ccc165c64e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd97a2e-4101-4909-84bd-3612aac4cbc2]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] <== disconnect_volume: return (363ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.025s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[068a1676-9800-4566-8f40-596c94b62b2f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:18:32 user nova-compute[74189]: No targets found.
Oct 25 21:18:32 user nova-compute[74189]: iSNS:
Oct 25 21:18:32 user nova-compute[74189]: No targets found.
Oct 25 21:18:32 user nova-compute[74189]: STATIC:
Oct 25 21:18:32 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963
Oct 25 21:18:32 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:18:32 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:18:32 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e
Oct 25 21:18:32 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:18:32 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:18:32 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b
Oct 25 21:18:32 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:18:32 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:18:32 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456
Oct 25 21:18:32 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:18:32 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:18:32 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d
Oct 25 21:18:32 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:18:32 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:18:32 user nova-compute[74189]: FIRMWARE:
Oct 25 21:18:32 user nova-compute[74189]: No targets found.
Oct 25 21:18:32 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:18:32 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:18:32 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e81f61-47a1-49df-9ba3-2179068b93bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd19510-6585-47ea-9453-b644f52cfca4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:18:32 user nova-compute[74189]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 (non-flash)
Oct 25 21:18:32 user nova-compute[74189]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:18:32 user nova-compute[74189]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b (non-flash)
Oct 25 21:18:32 user nova-compute[74189]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)
Oct 25 21:18:32 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:18:32 user nova-compute[74189]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 (non-flash)
Oct 25 21:18:32 user nova-compute[74189]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:18:32 user nova-compute[74189]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b (non-flash)
Oct 25 21:18:32 user nova-compute[74189]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)
Oct 25 21:18:32 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3042c2950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456'): ({'sdd'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Removing single pathed devices sdd {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a93e4b-28a0-4a2f-9bcf-999ccf6c70b7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[22635940-2b4d-47bb-a27b-a44b32292467]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Flushing IO for device /dev/sdd {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0199111-7893-4a1f-9f38-faccaf87f947]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG nova.compute.manager [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aWFZMYPT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f52fc510-3640-468a-8a9c-b716b9d17a01', 'attached_at': '', 'detached_at': '', 'volume_id': '5f947800-cc9c-4224-86f6-d1e72d1c2d9e', 'serial': '5f947800-cc9c-4224-86f6-d1e72d1c2d9e'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ykUomIYH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'f52fc510-3640-468a-8a9c-b716b9d17a01', 'attached_at': '', 'detached_at': '', 'volume_id': 'e07f2603-8906-4cb9-975e-5ac25a051963', 'serial'} {{(pid=74189) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aWFZMYPT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:18:32 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c8f204-2661-49db-9beb-944ffa6bf24a]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] SCSI volumes sdd have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8196726-4bfa-4ce7-8947-700fd27285e9]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9df056-8ae6-4d71-9ea6-f462aabe5e96]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456, portal: 172.16.0.220,3260]
Oct 25 21:18:32 user nova-compute[74189]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456, portal: 172.16.0.220,3260] successful.
Oct 25 21:18:32 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e24c152-22c8-457a-a917-60a4a3e86456 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a992dae5-a53b-4f16-8d9c-945b5d4d5f79]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] <== disconnect_volume: return (404ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.185s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:18:32 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:18:32 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7922fb60-da2d-4069-af85-66ed51cfd11d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:18:32 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[58510173-1efc-410b-b89e-6aea343526f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e] added
Oct 25 21:18:32 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba1c820-5d64-4fb8-bcc8-99ad45007df8]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ebb99c-b667-4c1f-bec3-e22f7532d70f]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aWFZMYPT {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:32 user nova-compute[74189]: INFO nova.compute.manager [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Rebuilding instance
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aWFZMYPT" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ddbbea-0c80-4048-800b-4a0b5e9b07c0]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aWFZMYPT'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5725a984-2a5e-497e-8b57-553d1cdc8a6d]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-13e19ec0-8f44-4df8-a4da-7a685a1c4316 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Lock "e1272f33-ef5e-48e6-912f-e0beae6dde11" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 55.522s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG nova.compute.manager [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bca576-b710-4ace-8ddb-89f04e2d2c45]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:18:32 user nova-compute[74189]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:18:32 user nova-compute[74189]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b (non-flash)
Oct 25 21:18:32 user nova-compute[74189]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)
Oct 25 21:18:32 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:18:32 user nova-compute[74189]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:18:32 user nova-compute[74189]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b (non-flash)
Oct 25 21:18:32 user nova-compute[74189]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)
Oct 25 21:18:32 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ace5cb0-ac06-41a9-a731-cfce7316d6e3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e, portal: 172.16.0.220,3260]
Oct 25 21:18:32 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e, portal: 172.16.0.220,3260] successful.
Oct 25 21:18:32 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4452b2c2-278a-4b4b-a677-1667e59d7088]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c34d241-f766-43ea-9828-f37321d29ec5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:18:32 user nova-compute[74189]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:18:32 user nova-compute[74189]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b (non-flash)
Oct 25 21:18:32 user nova-compute[74189]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)
Oct 25 21:18:32 user nova-compute[74189]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e (non-flash)
Oct 25 21:18:32 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:18:32 user nova-compute[74189]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:18:32 user nova-compute[74189]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b (non-flash)
Oct 25 21:18:32 user nova-compute[74189]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)
Oct 25 21:18:32 user nova-compute[74189]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e (non-flash)
Oct 25 21:18:32 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] HCTL ('34', '-', '-', 0) found on session 9 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.050s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5e3994-9c6a-4d05-b2bb-c715eea9d6c8]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Searching for a device in session 9 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aWFZMYPT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-9bdd7d1d-5fbe-4a25-a58b-bd6fdc0b2297 req-28c00d15-7801-4db6-b2af-29c46b19f103 service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Received event network-vif-unplugged-d28e4203-5fff-4a0b-b360-fe29bfa131b8 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:18:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9bdd7d1d-5fbe-4a25-a58b-bd6fdc0b2297 req-28c00d15-7801-4db6-b2af-29c46b19f103 service nova] Acquiring lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:18:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9bdd7d1d-5fbe-4a25-a58b-bd6fdc0b2297 req-28c00d15-7801-4db6-b2af-29c46b19f103 service nova] Lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:18:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9bdd7d1d-5fbe-4a25-a58b-bd6fdc0b2297 req-28c00d15-7801-4db6-b2af-29c46b19f103 service nova] Lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:18:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-9bdd7d1d-5fbe-4a25-a58b-bd6fdc0b2297 req-28c00d15-7801-4db6-b2af-29c46b19f103 service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] No waiting events found dispatching network-vif-unplugged-d28e4203-5fff-4a0b-b360-fe29bfa131b8 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:18:33 user nova-compute[74189]: WARNING nova.compute.manager [req-9bdd7d1d-5fbe-4a25-a58b-bd6fdc0b2297 req-28c00d15-7801-4db6-b2af-29c46b19f103 service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Received unexpected event network-vif-unplugged-d28e4203-5fff-4a0b-b360-fe29bfa131b8 for instance with vm_state active and task_state rebuilding.
Oct 25 21:18:33 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Instance destroyed successfully.
Oct 25 21:18:33 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Instance destroyed successfully.
Oct 25 21:18:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:16:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1713435964',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1904014555',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVLWL/l3Vh79OaGgsN5D2te6r87t4qcVR5zA3W/Bg4mTE1zl7sJSoyjbQnhD3AeWV9gsQAwGKkMtvg9ZV6+YMk7vzNB4DgcV0PFaLz2rgjVpHTuxF9n1BWLqiTcunhiVw==',key_name='tempest-keypair-1447510267',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:17:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4aa384e522324f0fa297ca277820909f',ramdisk_id='',reservation_id='r-z4gtu1al',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1192138157',owner_user_name='tempest-ServerActionsV293TestJSON-1192138157-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:18:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df67ddee61b04820b0968636a2eddbed',uuid=a05b75c0-c064-42c5-aca7-c4b07cfabcfb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "address": "fa:16:3e:88:75:56", "network": {"id": "75c09903-d1c6-4197-bc70-cfe7f3e7a772", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1909568880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa384e522324f0fa297ca277820909f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd28e4203-5f", "ovs_interfaceid": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:18:33 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Converting VIF {"id": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "address": "fa:16:3e:88:75:56", "network": {"id": "75c09903-d1c6-4197-bc70-cfe7f3e7a772", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1909568880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa384e522324f0fa297ca277820909f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd28e4203-5f", "ovs_interfaceid": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:18:33 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:75:56,bridge_name='br-int',has_traffic_filtering=True,id=d28e4203-5fff-4a0b-b360-fe29bfa131b8,network=Network(75c09903-d1c6-4197-bc70-cfe7f3e7a772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd28e4203-5f') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:18:33 user nova-compute[74189]: DEBUG os_vif [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:75:56,bridge_name='br-int',has_traffic_filtering=True,id=d28e4203-5fff-4a0b-b360-fe29bfa131b8,network=Network(75c09903-d1c6-4197-bc70-cfe7f3e7a772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd28e4203-5f') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:18:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd28e4203-5f, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:18:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:18:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9145ac1d-b125-4d92-9f1c-f7483b2a609f) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:18:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:18:33 user nova-compute[74189]: INFO os_vif [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:75:56,bridge_name='br-int',has_traffic_filtering=True,id=d28e4203-5fff-4a0b-b360-fe29bfa131b8,network=Network(75c09903-d1c6-4197-bc70-cfe7f3e7a772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd28e4203-5f')
Oct 25 21:18:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:18:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fKgarFiL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:18:33 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 21:18:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:18:33 user nova-compute[74189]: DEBUG nova.objects.instance [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lazy-loading 'flavor' on Instance uuid c69c0800-7a6c-4155-9f90-bbcd323276d3 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:18:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fa0bef6c-f752-42a5-977f-9d34a42b4483 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "c69c0800-7a6c-4155-9f90-bbcd323276d3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.254s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:18:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.450s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:18:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] <== connect_volume: return (1635ms) {'type': 'block', 'scsi_wwn': '23262656362333335', 'path': '/dev/sdc'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:18:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262656362333335', 'path': '/dev/sdc'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:18:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.272s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:18:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:33 user nova-compute[74189]: DEBUG nova.objects.instance [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Lazy-loading 'flavor' on Instance uuid f52fc510-3640-468a-8a9c-b716b9d17a01 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:18:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:33 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0baa72-2c8a-4301-a1da-e96ea77fa6fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:18:33 user nova-compute[74189]: No targets found.
Oct 25 21:18:33 user nova-compute[74189]: iSNS:
Oct 25 21:18:33 user nova-compute[74189]: No targets found.
Oct 25 21:18:33 user nova-compute[74189]: STATIC:
Oct 25 21:18:33 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963
Oct 25 21:18:33 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:18:33 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:18:33 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e
Oct 25 21:18:33 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:18:33 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:18:33 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e
Oct 25 21:18:33 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:18:33 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:18:33 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b
Oct 25 21:18:33 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:18:33 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:18:33 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d
Oct 25 21:18:33 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:18:33 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:18:33 user nova-compute[74189]: FIRMWARE:
Oct 25 21:18:33 user nova-compute[74189]: No targets found.
Oct 25 21:18:33 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:18:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:18:33 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:18:33 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:18:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:18:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d1d4fe-6f1a-44f5-acc6-24e72faf87ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[52722a59-5b04-4f8f-9cf8-a4ca342b5e52]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:18:34 user nova-compute[74189]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:18:34 user nova-compute[74189]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b (non-flash)
Oct 25 21:18:34 user nova-compute[74189]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)
Oct 25 21:18:34 user nova-compute[74189]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e (non-flash)
Oct 25 21:18:34 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:18:34 user nova-compute[74189]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:18:34 user nova-compute[74189]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b (non-flash)
Oct 25 21:18:34 user nova-compute[74189]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)
Oct 25 21:18:34 user nova-compute[74189]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e (non-flash)
Oct 25 21:18:34 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe304154e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e'): ({'sdb'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Removing single pathed devices sdb {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb31b76-c036-4e62-85cf-330ed69b0354]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4ffb75-64f0-4ac5-a612-26893bfe802d]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Flushing IO for device /dev/sdb {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[947e35e5-dfb0-4664-a530-9863309e02c0]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc505b4-9337-4a15-a488-d7a613e25919]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] SCSI volumes sdb have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b071c9-cb78-450c-a5b4-362bd3e486eb]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fdfea6-91c5-4ab7-ab62-a11f80867a39]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e, portal: 172.16.0.220,3260]
Oct 25 21:18:34 user nova-compute[74189]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e, portal: 172.16.0.220,3260] successful.
Oct 25 21:18:34 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84d47b0-e21f-48d7-bb4d-19563d75254e]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] <== disconnect_volume: return (681ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:18:34 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Deleting instance files /opt/stack/data/nova/instances/a05b75c0-c064-42c5-aca7-c4b07cfabcfb_del
Oct 25 21:18:34 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Deletion of /opt/stack/data/nova/instances/a05b75c0-c064-42c5-aca7-c4b07cfabcfb_del complete
Oct 25 21:18:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74189) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 21:18:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] COPY block job progress, current cursor: 121634816 final cursor: 1073741824 {{(pid=74189) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 21:18:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-94da8055-5155-475c-bd7f-56bc570f9a23 req-89a8c027-7a1a-4a47-a3fa-d105de575a79 service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Received event network-vif-plugged-d28e4203-5fff-4a0b-b360-fe29bfa131b8 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:18:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-94da8055-5155-475c-bd7f-56bc570f9a23 req-89a8c027-7a1a-4a47-a3fa-d105de575a79 service nova] Acquiring lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:18:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-94da8055-5155-475c-bd7f-56bc570f9a23 req-89a8c027-7a1a-4a47-a3fa-d105de575a79 service nova] Lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:18:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-94da8055-5155-475c-bd7f-56bc570f9a23 req-89a8c027-7a1a-4a47-a3fa-d105de575a79 service nova] Lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:18:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-94da8055-5155-475c-bd7f-56bc570f9a23 req-89a8c027-7a1a-4a47-a3fa-d105de575a79 service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] No waiting events found dispatching network-vif-plugged-d28e4203-5fff-4a0b-b360-fe29bfa131b8 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:18:35 user nova-compute[74189]: WARNING nova.compute.manager [req-94da8055-5155-475c-bd7f-56bc570f9a23 req-89a8c027-7a1a-4a47-a3fa-d105de575a79 service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Received unexpected event network-vif-plugged-d28e4203-5fff-4a0b-b360-fe29bfa131b8 for instance with vm_state active and task_state rebuilding.
Oct 25 21:18:35 user nova-compute[74189]: DEBUG nova.objects.instance [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lazy-loading 'flavor' on Instance uuid c4c57363-0107-4567-9842-44a0522f8326 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:18:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-219cd1fa-29d6-4823-978e-9251164e1d63 tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lock "c4c57363-0107-4567-9842-44a0522f8326" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.271s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:18:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] COPY block job progress, current cursor: 249561088 final cursor: 1073741824 {{(pid=74189) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 21:18:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] COPY block job progress, current cursor: 409993216 final cursor: 1073741824 {{(pid=74189) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 21:18:36 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance a05b75c0-c064-42c5-aca7-c4b07cfabcfb could not be found.
Oct 25 21:18:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fKgarFiL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:18:36 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 21:18:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.050s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[189dad95-3bfe-44d2-b280-85340d316dcf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:18:36 user nova-compute[74189]: No targets found.
Oct 25 21:18:36 user nova-compute[74189]: iSNS:
Oct 25 21:18:36 user nova-compute[74189]: No targets found.
Oct 25 21:18:36 user nova-compute[74189]: STATIC:
Oct 25 21:18:36 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963
Oct 25 21:18:36 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:18:36 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:18:36 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e
Oct 25 21:18:36 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:18:36 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:18:36 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b
Oct 25 21:18:36 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:18:36 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:18:36 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d
Oct 25 21:18:36 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:18:36 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:18:36 user nova-compute[74189]: FIRMWARE:
Oct 25 21:18:36 user nova-compute[74189]: No targets found.
Oct 25 21:18:36 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:18:36 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:18:36 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9ce5d9dc-1b4d-4f0f-8b90-9992f27d5bff tempest-VolumesAssistedSnapshotsTest-1024931334 tempest-VolumesAssistedSnapshotsTest-1024931334-project] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] volume_snapshot_create: create_info: {'snapshot_id': '414d0b42-7f79-4c55-b4da-65f3d1d4f126', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74189) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Acquiring lock "ea8d22c5-3868-43d1-b101-c6cff480dea6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lock "ea8d22c5-3868-43d1-b101-c6cff480dea6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.040s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ea5534-6baf-491e-ac74-70267706551e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9ce5d9dc-1b4d-4f0f-8b90-9992f27d5bff tempest-VolumesAssistedSnapshotsTest-1024931334 tempest-VolumesAssistedSnapshotsTest-1024931334-project] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] snap xml: <domainsnapshot>
Oct 25 21:18:36 user nova-compute[74189]:   <disks>
Oct 25 21:18:36 user nova-compute[74189]:     <disk name="/dev/sdg" snapshot="external" type="file">
Oct 25 21:18:36 user nova-compute[74189]:       <source file="/dev/new_file"/>
Oct 25 21:18:36 user nova-compute[74189]:     </disk>
Oct 25 21:18:36 user nova-compute[74189]:     <disk name="vda" snapshot="no"/>
Oct 25 21:18:36 user nova-compute[74189]:   </disks>
Oct 25 21:18:36 user nova-compute[74189]: </domainsnapshot>
Oct 25 21:18:36 user nova-compute[74189]:  {{(pid=74189) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG nova.objects.instance [None req-9ce5d9dc-1b4d-4f0f-8b90-9992f27d5bff tempest-VolumesAssistedSnapshotsTest-1024931334 tempest-VolumesAssistedSnapshotsTest-1024931334-project] Lazy-loading 'system_metadata' on Instance uuid e1272f33-ef5e-48e6-912f-e0beae6dde11 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:18:36 user nova-compute[74189]: INFO nova.compute.manager [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Detaching volume 7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b
Oct 25 21:18:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[997d7d97-ae69-420a-8eec-8b5e55455853]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:18:36 user nova-compute[74189]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b (non-flash)
Oct 25 21:18:36 user nova-compute[74189]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)
Oct 25 21:18:36 user nova-compute[74189]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e (non-flash)
Oct 25 21:18:36 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:18:36 user nova-compute[74189]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b (non-flash)
Oct 25 21:18:36 user nova-compute[74189]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)
Oct 25 21:18:36 user nova-compute[74189]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e (non-flash)
Oct 25 21:18:36 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3043824d0>, {}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Disconnecting from: [] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.164s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] <== disconnect_volume: return (166ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-0645176f-f184-4fac-80d1-87b056d07244 tempest-VolumesAssistedSnapshotsTest-1024931334 tempest-VolumesAssistedSnapshotsTest-1024931334-project] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] volume_snapshot_delete: delete_info: {'volume_id': '257a6a89-a1a5-45bc-baad-5765b0f3355d'} {{(pid=74189) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [None req-0645176f-f184-4fac-80d1-87b056d07244 tempest-VolumesAssistedSnapshotsTest-1024931334 tempest-VolumesAssistedSnapshotsTest-1024931334-project] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Traceback (most recent call last):
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]     if delete_info['type'] != 'qcow2':
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] KeyError: 'type'
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] 
Oct 25 21:18:36 user nova-compute[74189]: INFO nova.virt.block_device [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Attempting to driver detach volume 7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b from mountpoint /dev/vdb
Oct 25 21:18:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Attempting to detach device vdb from instance ea8d22c5-3868-43d1-b101-c6cff480dea6 from the persistent domain config. {{(pid=74189) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:18:36 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:18:36 user nova-compute[74189]:   <source dev="/dev/sdf"/>
Oct 25 21:18:36 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:18:36 user nova-compute[74189]:   <serial>7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b</serial>
Oct 25 21:18:36 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 25 21:18:36 user nova-compute[74189]: </disk>
Oct 25 21:18:36 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:18:36 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Successfully detached device vdb from instance ea8d22c5-3868-43d1-b101-c6cff480dea6 from the persistent domain config.
Oct 25 21:18:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ea8d22c5-3868-43d1-b101-c6cff480dea6 from the live domain config. {{(pid=74189) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:18:36 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:18:36 user nova-compute[74189]:   <source dev="/dev/sdf"/>
Oct 25 21:18:36 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:18:36 user nova-compute[74189]:   <serial>7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b</serial>
Oct 25 21:18:36 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 25 21:18:36 user nova-compute[74189]: </disk>
Oct 25 21:18:36 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6fc7fb21-76f6-4280-952b-5bc477af216c tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Acquiring lock "c4c57363-0107-4567-9842-44a0522f8326" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6fc7fb21-76f6-4280-952b-5bc477af216c tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lock "c4c57363-0107-4567-9842-44a0522f8326" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6fc7fb21-76f6-4280-952b-5bc477af216c tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Acquiring lock "c4c57363-0107-4567-9842-44a0522f8326-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6fc7fb21-76f6-4280-952b-5bc477af216c tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lock "c4c57363-0107-4567-9842-44a0522f8326-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6fc7fb21-76f6-4280-952b-5bc477af216c tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lock "c4c57363-0107-4567-9842-44a0522f8326-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:18:36 user nova-compute[74189]: INFO nova.compute.manager [None req-6fc7fb21-76f6-4280-952b-5bc477af216c tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Terminating instance
Oct 25 21:18:36 user nova-compute[74189]: DEBUG nova.compute.manager [None req-6fc7fb21-76f6-4280-952b-5bc477af216c tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] COPY block job progress, current cursor: 549453824 final cursor: 1073741824 {{(pid=74189) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 21:18:36 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-9ce5d9dc-1b4d-4f0f-8b90-9992f27d5bff tempest-VolumesAssistedSnapshotsTest-1024931334 tempest-VolumesAssistedSnapshotsTest-1024931334-project] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [None req-9ce5d9dc-1b4d-4f0f-8b90-9992f27d5bff tempest-VolumesAssistedSnapshotsTest-1024931334 tempest-VolumesAssistedSnapshotsTest-1024931334-project] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Traceback (most recent call last):
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]     rv = execute(f, *args, **kwargs)
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]     six.reraise(c, e, tb)
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]     raise value
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]     rv = meth(*args, **kwargs)
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] 
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [None req-9ce5d9dc-1b4d-4f0f-8b90-9992f27d5bff tempest-VolumesAssistedSnapshotsTest-1024931334 tempest-VolumesAssistedSnapshotsTest-1024931334-project] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Traceback (most recent call last):
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]     self._volume_snapshot_create(context, instance, guest,
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]     rv = execute(f, *args, **kwargs)
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]     six.reraise(c, e, tb)
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]     raise value
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]     rv = meth(*args, **kwargs)
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 21:18:36 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] 
Oct 25 21:18:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] COPY block job progress, current cursor: 634388480 final cursor: 1073741824 {{(pid=74189) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 21:18:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ea8d22c5-3868-43d1-b101-c6cff480dea6 {{(pid=74189) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 21:18:37 user nova-compute[74189]: DEBUG nova.compute.manager [req-fe02bf76-d8ae-4a54-884e-020a783ed4f1 req-ff5e708d-6b0c-4797-99e1-40a145596824 service nova] [instance: c4c57363-0107-4567-9842-44a0522f8326] Received event network-vif-unplugged-032dd7a9-5ab8-4e42-883a-3ce412b9ee1d {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:18:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-fe02bf76-d8ae-4a54-884e-020a783ed4f1 req-ff5e708d-6b0c-4797-99e1-40a145596824 service nova] Acquiring lock "c4c57363-0107-4567-9842-44a0522f8326-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:18:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-fe02bf76-d8ae-4a54-884e-020a783ed4f1 req-ff5e708d-6b0c-4797-99e1-40a145596824 service nova] Lock "c4c57363-0107-4567-9842-44a0522f8326-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:18:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-fe02bf76-d8ae-4a54-884e-020a783ed4f1 req-ff5e708d-6b0c-4797-99e1-40a145596824 service nova] Lock "c4c57363-0107-4567-9842-44a0522f8326-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:18:37 user nova-compute[74189]: DEBUG nova.compute.manager [req-fe02bf76-d8ae-4a54-884e-020a783ed4f1 req-ff5e708d-6b0c-4797-99e1-40a145596824 service nova] [instance: c4c57363-0107-4567-9842-44a0522f8326] No waiting events found dispatching network-vif-unplugged-032dd7a9-5ab8-4e42-883a-3ce412b9ee1d {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:18:37 user nova-compute[74189]: DEBUG nova.compute.manager [req-fe02bf76-d8ae-4a54-884e-020a783ed4f1 req-ff5e708d-6b0c-4797-99e1-40a145596824 service nova] [instance: c4c57363-0107-4567-9842-44a0522f8326] Received event network-vif-unplugged-032dd7a9-5ab8-4e42-883a-3ce412b9ee1d for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:18:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] COPY block job progress, current cursor: 668991488 final cursor: 1073741824 {{(pid=74189) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 21:18:37 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: c4c57363-0107-4567-9842-44a0522f8326] Instance destroyed successfully.
Oct 25 21:18:37 user nova-compute[74189]: DEBUG nova.objects.instance [None req-6fc7fb21-76f6-4280-952b-5bc477af216c tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lazy-loading 'resources' on Instance uuid c4c57363-0107-4567-9842-44a0522f8326 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:18:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-6fc7fb21-76f6-4280-952b-5bc477af216c tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:15:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-744723852',display_name='tempest-AttachSCSIVolumeTestJSON-server-744723852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-744723852',id=5,image_ref='e871b7fb-9cf2-4a9a-b6a0-c207d71e6165',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeaMxDdhks0ED/wk48raKzDK/GDMU91AjruHiPN6NzfVkrqeyudIJHeoVHnBu3lKbVmS3zDsfNC+rKhkPr/Cly3df4/PJPioaygqlr4LjcOUo/Ugz6PyY0OVB8PJ/4/pw==',key_name='tempest-keypair-109554160',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:15:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9669b7ed3a8846fb8e90800fe65a271d',ramdisk_id='',reservation_id='r-fmr8zu4v',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e871b7fb-9cf2-4a9a-b6a0-c207d71e6165',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-706086211',owner_user_name='tempest-AttachSCSIVolumeTestJSON-706086211-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:15:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7da73c191b3342b9b5f3834e0d111fb2',uuid=c4c57363-0107-4567-9842-44a0522f8326,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "032dd7a9-5ab8-4e42-883a-3ce412b9ee1d", "address": "fa:16:3e:06:5b:93", "network": {"id": "fc681f29-44fb-4260-abab-c3cf730ae62f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-404557441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9669b7ed3a8846fb8e90800fe65a271d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap032dd7a9-5a", "ovs_interfaceid": "032dd7a9-5ab8-4e42-883a-3ce412b9ee1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:18:37 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-6fc7fb21-76f6-4280-952b-5bc477af216c tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Converting VIF {"id": "032dd7a9-5ab8-4e42-883a-3ce412b9ee1d", "address": "fa:16:3e:06:5b:93", "network": {"id": "fc681f29-44fb-4260-abab-c3cf730ae62f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-404557441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9669b7ed3a8846fb8e90800fe65a271d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap032dd7a9-5a", "ovs_interfaceid": "032dd7a9-5ab8-4e42-883a-3ce412b9ee1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:18:37 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-6fc7fb21-76f6-4280-952b-5bc477af216c tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:5b:93,bridge_name='br-int',has_traffic_filtering=True,id=032dd7a9-5ab8-4e42-883a-3ce412b9ee1d,network=Network(fc681f29-44fb-4260-abab-c3cf730ae62f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap032dd7a9-5a') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:18:37 user nova-compute[74189]: DEBUG os_vif [None req-6fc7fb21-76f6-4280-952b-5bc477af216c tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:5b:93,bridge_name='br-int',has_traffic_filtering=True,id=032dd7a9-5ab8-4e42-883a-3ce412b9ee1d,network=Network(fc681f29-44fb-4260-abab-c3cf730ae62f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap032dd7a9-5a') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:18:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap032dd7a9-5a, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:18:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:18:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9abe90e0-e7cc-46a1-a5ef-9525e249aa31) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:18:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:18:37 user nova-compute[74189]: INFO os_vif [None req-6fc7fb21-76f6-4280-952b-5bc477af216c tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:5b:93,bridge_name='br-int',has_traffic_filtering=True,id=032dd7a9-5ab8-4e42-883a-3ce412b9ee1d,network=Network(fc681f29-44fb-4260-abab-c3cf730ae62f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap032dd7a9-5a')
Oct 25 21:18:37 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-6fc7fb21-76f6-4280-952b-5bc477af216c tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Deleting instance files /opt/stack/data/nova/instances/c4c57363-0107-4567-9842-44a0522f8326_del
Oct 25 21:18:37 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-6fc7fb21-76f6-4280-952b-5bc477af216c tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Deletion of /opt/stack/data/nova/instances/c4c57363-0107-4567-9842-44a0522f8326_del complete
Oct 25 21:18:37 user nova-compute[74189]: INFO nova.compute.manager [None req-6fc7fb21-76f6-4280-952b-5bc477af216c tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] [instance: c4c57363-0107-4567-9842-44a0522f8326] Took 1.24 seconds to destroy the instance on the hypervisor.
Oct 25 21:18:37 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-6fc7fb21-76f6-4280-952b-5bc477af216c tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:18:37 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: c4c57363-0107-4567-9842-44a0522f8326] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:18:37 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: c4c57363-0107-4567-9842-44a0522f8326] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:18:38 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] COPY block job progress, current cursor: 745537536 final cursor: 1073741824 {{(pid=74189) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 21:18:38 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] COPY block job progress, current cursor: 865075200 final cursor: 1073741824 {{(pid=74189) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 21:18:38 user nova-compute[74189]: DEBUG nova.compute.manager [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Preparing to wait for external event volume-reimaged-e6efe932-902f-41f8-82f4-1773bc305e0e {{(pid=74189) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 25 21:18:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Acquiring lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:18:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.004s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:18:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [None req-0645176f-f184-4fac-80d1-87b056d07244 tempest-VolumesAssistedSnapshotsTest-1024931334 tempest-VolumesAssistedSnapshotsTest-1024931334-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver 
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver 
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-1d9f97f6-cb5e-4c49-89ff-15766c12fd4f)
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver 
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver 
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver 
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver [None req-9ce5d9dc-1b4d-4f0f-8b90-9992f27d5bff tempest-VolumesAssistedSnapshotsTest-1024931334 tempest-VolumesAssistedSnapshotsTest-1024931334-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 414d0b42-7f79-4c55-b4da-65f3d1d4f126 could not be found.
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     raise value
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver 
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver 
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 414d0b42-7f79-4c55-b4da-65f3d1d4f126 could not be found. (HTTP 404) (Request-ID: req-4022717a-4c03-414d-b5be-5d0ec4478ec6)
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver 
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver 
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 414d0b42-7f79-4c55-b4da-65f3d1d4f126 could not be found.
Oct 25 21:18:38 user nova-compute[74189]: ERROR nova.virt.libvirt.driver 
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server [None req-0645176f-f184-4fac-80d1-87b056d07244 tempest-VolumesAssistedSnapshotsTest-1024931334 tempest-VolumesAssistedSnapshotsTest-1024931334-project] Exception during message handling: KeyError: 'type'
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server 
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server [None req-9ce5d9dc-1b4d-4f0f-8b90-9992f27d5bff tempest-VolumesAssistedSnapshotsTest-1024931334 tempest-VolumesAssistedSnapshotsTest-1024931334-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     raise value
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 21:18:38 user nova-compute[74189]: ERROR oslo_messaging.rpc.server 
Oct 25 21:18:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] COPY block job progress, current cursor: 987758592 final cursor: 1073741824 {{(pid=74189) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG nova.compute.manager [req-c6792f06-9aba-4c41-9b2d-35281f05c4b4 req-183786ce-0dad-4c42-8efc-ebf0db90eb2c service nova] [instance: c4c57363-0107-4567-9842-44a0522f8326] Received event network-vif-plugged-032dd7a9-5ab8-4e42-883a-3ce412b9ee1d {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c6792f06-9aba-4c41-9b2d-35281f05c4b4 req-183786ce-0dad-4c42-8efc-ebf0db90eb2c service nova] Acquiring lock "c4c57363-0107-4567-9842-44a0522f8326-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c6792f06-9aba-4c41-9b2d-35281f05c4b4 req-183786ce-0dad-4c42-8efc-ebf0db90eb2c service nova] Lock "c4c57363-0107-4567-9842-44a0522f8326-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c6792f06-9aba-4c41-9b2d-35281f05c4b4 req-183786ce-0dad-4c42-8efc-ebf0db90eb2c service nova] Lock "c4c57363-0107-4567-9842-44a0522f8326-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG nova.compute.manager [req-c6792f06-9aba-4c41-9b2d-35281f05c4b4 req-183786ce-0dad-4c42-8efc-ebf0db90eb2c service nova] [instance: c4c57363-0107-4567-9842-44a0522f8326] No waiting events found dispatching network-vif-plugged-032dd7a9-5ab8-4e42-883a-3ce412b9ee1d {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:18:39 user nova-compute[74189]: WARNING nova.compute.manager [req-c6792f06-9aba-4c41-9b2d-35281f05c4b4 req-183786ce-0dad-4c42-8efc-ebf0db90eb2c service nova] [instance: c4c57363-0107-4567-9842-44a0522f8326] Received unexpected event network-vif-plugged-032dd7a9-5ab8-4e42-883a-3ce412b9ee1d for instance with vm_state active and task_state deleting.
Oct 25 21:18:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Acquiring lock "e1272f33-ef5e-48e6-912f-e0beae6dde11" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Lock "e1272f33-ef5e-48e6-912f-e0beae6dde11" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: c4c57363-0107-4567-9842-44a0522f8326] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:18:39 user nova-compute[74189]: INFO nova.compute.manager [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Detaching volume 257a6a89-a1a5-45bc-baad-5765b0f3355d
Oct 25 21:18:39 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: c4c57363-0107-4567-9842-44a0522f8326] Took 1.81 seconds to deallocate network for instance.
Oct 25 21:18:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74189) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6fc7fb21-76f6-4280-952b-5bc477af216c tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6fc7fb21-76f6-4280-952b-5bc477af216c tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:18:39 user nova-compute[74189]: INFO nova.virt.block_device [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Attempting to driver detach volume 257a6a89-a1a5-45bc-baad-5765b0f3355d from mountpoint /dev/vdb
Oct 25 21:18:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Attempting to detach device vdb from instance e1272f33-ef5e-48e6-912f-e0beae6dde11 from the persistent domain config. {{(pid=74189) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] detach device xml: <disk type="block" device="disk">
Oct 25 21:18:39 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:18:39 user nova-compute[74189]:   <source dev="/dev/sdg"/>
Oct 25 21:18:39 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:18:39 user nova-compute[74189]:   <serial>257a6a89-a1a5-45bc-baad-5765b0f3355d</serial>
Oct 25 21:18:39 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:18:39 user nova-compute[74189]: </disk>
Oct 25 21:18:39 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:18:39 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Successfully detached device vdb from instance e1272f33-ef5e-48e6-912f-e0beae6dde11 from the persistent domain config.
Oct 25 21:18:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e1272f33-ef5e-48e6-912f-e0beae6dde11 from the live domain config. {{(pid=74189) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] detach device xml: <disk type="block" device="disk">
Oct 25 21:18:39 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:18:39 user nova-compute[74189]:   <source dev="/dev/sdg"/>
Oct 25 21:18:39 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:18:39 user nova-compute[74189]:   <serial>257a6a89-a1a5-45bc-baad-5765b0f3355d</serial>
Oct 25 21:18:39 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:18:39 user nova-compute[74189]: </disk>
Oct 25 21:18:39 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ykUomIYH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:18:39 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:18:39 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdd5a90-9ed7-4123-a389-95bf80011d18]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:18:39 user nova-compute[74189]: No targets found.
Oct 25 21:18:39 user nova-compute[74189]: iSNS:
Oct 25 21:18:39 user nova-compute[74189]: No targets found.
Oct 25 21:18:39 user nova-compute[74189]: STATIC:
Oct 25 21:18:39 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963
Oct 25 21:18:39 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:18:39 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:18:39 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e
Oct 25 21:18:39 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:18:39 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:18:39 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b
Oct 25 21:18:39 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:18:39 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:18:39 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d
Oct 25 21:18:39 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:18:39 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:18:39 user nova-compute[74189]: FIRMWARE:
Oct 25 21:18:39 user nova-compute[74189]: No targets found.
Oct 25 21:18:39 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:18:39 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:18:39 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7e8ea8-0882-4925-acb8-d1af30ecb386]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b438870a-6c91-4d00-be44-c986acb82278]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:18:39 user nova-compute[74189]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b (non-flash)
Oct 25 21:18:39 user nova-compute[74189]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)
Oct 25 21:18:39 user nova-compute[74189]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e (non-flash)
Oct 25 21:18:39 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:18:39 user nova-compute[74189]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b (non-flash)
Oct 25 21:18:39 user nova-compute[74189]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)
Oct 25 21:18:39 user nova-compute[74189]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e (non-flash)
Oct 25 21:18:39 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3041daf80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963'): ({'sde'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Removing single pathed devices sde {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e16e269-2150-4e67-9699-884d0054b333]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.030s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7c3290-4577-4f93-8eb6-e65db0931f9e]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Flushing IO for device /dev/sde {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0ab41a-1a4a-4668-8007-e3b375fd46e0]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09f6788-5f01-4432-99df-a8ebbbba9cbf]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] SCSI volumes sde have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:18:39 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:40 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4872af80-a485-472b-a3eb-b6ef6ebda0e8]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:40 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-6fc7fb21-76f6-4280-952b-5bc477af216c tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:18:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:40 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddef4ee-77af-4655-ba7c-974d510498ac]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963, portal: 172.16.0.220,3260]
Oct 25 21:18:40 user nova-compute[74189]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963, portal: 172.16.0.220,3260] successful.
Oct 25 21:18:40 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:40 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-6fc7fb21-76f6-4280-952b-5bc477af216c tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:18:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:40 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1432329e-40ee-4d54-80e0-b977a72e0e02]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:18:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] <== disconnect_volume: return (378ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:18:40 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:18:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6fc7fb21-76f6-4280-952b-5bc477af216c tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.512s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:18:40 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-6fc7fb21-76f6-4280-952b-5bc477af216c tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Deleted allocations for instance c4c57363-0107-4567-9842-44a0522f8326
Oct 25 21:18:40 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e1272f33-ef5e-48e6-912f-e0beae6dde11 {{(pid=74189) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 21:18:40 user nova-compute[74189]: DEBUG nova.compute.manager [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aWFZMYPT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'f52fc510-3640-468a-8a9c-b716b9d17a01', 'attached_at': '', 'detached_at': '', 'volume_id': '5f947800-cc9c-4224-86f6-d1e72d1c2d9e', 'serial'} {{(pid=74189) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 25 21:18:40 user nova-compute[74189]: DEBUG nova.compute.manager [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] swap_volume: removing Cinder connection for volume e07f2603-8906-4cb9-975e-5ac25a051963 {{(pid=74189) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 25 21:18:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6fc7fb21-76f6-4280-952b-5bc477af216c tempest-AttachSCSIVolumeTestJSON-706086211 tempest-AttachSCSIVolumeTestJSON-706086211-project-member] Lock "c4c57363-0107-4567-9842-44a0522f8326" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.803s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:18:41 user nova-compute[74189]: DEBUG nova.compute.manager [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] swap_volume: Updating volume e07f2603-8906-4cb9-975e-5ac25a051963 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "aWFZMYPT", "auth_password": "fSaKgcZx12zvCB", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "5f947800-cc9c-4224-86f6-d1e72d1c2d9e"}, "status": "reserved", "instance": "f52fc510-3640-468a-8a9c-b716b9d17a01", "attached_at": "", "detached_at": "", "volume_id": "5f947800-cc9c-4224-86f6-d1e72d1c2d9e", "serial": "5f947800-cc9c-4224-86f6-d1e72d1c2d9e"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '5f947800-cc9c-4224-86f6-d1e72d1c2d9e', 'no_device': None, 'attachment_id': '842d6117-b426-4d12-8d68-5ad6b07c77e4'} {{(pid=74189) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 25 21:18:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ebbfaf81-2c6e-428c-89fd-a2e9359325ae tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Lock "f52fc510-3640-468a-8a9c-b716b9d17a01" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 30.280s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:18:41 user nova-compute[74189]: DEBUG nova.compute.manager [req-881e5151-b4fb-4b56-a610-4fd774e7f7f7 req-d2ac07df-89b2-4491-921a-fc70c9f85126 service nova] [instance: c4c57363-0107-4567-9842-44a0522f8326] Received event network-vif-deleted-032dd7a9-5ab8-4e42-883a-3ce412b9ee1d {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:18:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Acquiring lock "f52fc510-3640-468a-8a9c-b716b9d17a01" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:18:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Lock "f52fc510-3640-468a-8a9c-b716b9d17a01" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:18:42 user nova-compute[74189]: DEBUG os_brick.utils [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:18:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:42 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ddf82a-a9df-4115-8c50-36d01523b9a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:42 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5e1940-c23b-4f38-b041-46b790e1107d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:42 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d842d593-f368-4386-8e94-3f93919f17d2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:42 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab90c387-f0cd-47b9-9a22-08c5be3829ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:18:42 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:18:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:18:42 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:18:42 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e13ff6-7eed-42d3-86f8-1d4db68de2ba]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:42 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:18:42 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:18:42 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:18:42 user nova-compute[74189]: DEBUG os_brick.utils [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:18:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:42 user nova-compute[74189]: INFO nova.compute.manager [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Swapping volume 5f947800-cc9c-4224-86f6-d1e72d1c2d9e for e07f2603-8906-4cb9-975e-5ac25a051963
Oct 25 21:18:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:52 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:52 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:57 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ea8d22c5-3868-43d1-b101-c6cff480dea6 is timed out.
Oct 25 21:18:57 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Successfully detached device vdb from instance ea8d22c5-3868-43d1-b101-c6cff480dea6 from the live domain config.
Oct 25 21:18:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AqtCIeYL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:18:57 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d7040d-1e52-484a-8610-5cdda58abbe2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:18:57 user nova-compute[74189]: No targets found.
Oct 25 21:18:57 user nova-compute[74189]: iSNS:
Oct 25 21:18:57 user nova-compute[74189]: No targets found.
Oct 25 21:18:57 user nova-compute[74189]: STATIC:
Oct 25 21:18:57 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e
Oct 25 21:18:57 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:18:57 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:18:57 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b
Oct 25 21:18:57 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:18:57 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:18:57 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d
Oct 25 21:18:57 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:18:57 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:18:57 user nova-compute[74189]: FIRMWARE:
Oct 25 21:18:57 user nova-compute[74189]: No targets found.
Oct 25 21:18:57 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:18:57 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:18:57 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[285215d9-78a1-4ca7-80f3-49957c725221]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[71992a97-1677-43fb-8cdf-cc0d51d9e6bd]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b (non-flash)
Oct 25 21:18:57 user nova-compute[74189]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)
Oct 25 21:18:57 user nova-compute[74189]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e (non-flash)
Oct 25 21:18:57 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b (non-flash)
Oct 25 21:18:57 user nova-compute[74189]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)
Oct 25 21:18:57 user nova-compute[74189]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e (non-flash)
Oct 25 21:18:57 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3044b23b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b'): ({'sdf'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Removing single pathed devices sdf {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[465f745f-4474-40a0-bfc5-807e029a9510]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[540eb9ef-9831-4a97-b958-a9a7a8dcc5e7]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Flushing IO for device /dev/sdf {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f749347d-47b5-4380-826c-dd0fe3695a0d]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[26968d38-84b4-477c-8b59-ebf2a71b23cc]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] SCSI volumes sdf have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[db04a110-1fea-432e-88aa-31d5586178ec]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a03de25-116b-47d1-b36f-e7db220e2920]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b, portal: 172.16.0.220,3260]
Oct 25 21:18:57 user nova-compute[74189]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b, portal: 172.16.0.220,3260] successful.
Oct 25 21:18:57 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b05f15e-6f1b-4e11-ac50-4e8bc7441e6b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[352119a5-b9c1-4b59-8cd9-2f816cb11a18]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] <== disconnect_volume: return (315ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:18:57 user nova-compute[74189]: INFO nova.virt.block_device [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Booting with volume 0a290ce3-7c8b-460b-919d-a5e149720eff at /dev/vdc
Oct 25 21:18:57 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:18:57 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Creating image(s)
Oct 25 21:18:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Did not create local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Ensure instance console log exists: /opt/stack/data/nova/instances/af1d7b3c-9950-4b74-8f15-b31011ccfa24/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Start _get_guest_xml network_info=[{"id": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "address": "fa:16:3e:03:8e:2f", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4cdb73-9d", "ovs_interfaceid": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tUkwnqOm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'af1d7b3c-9950-4b74-8f15-b31011ccfa24', 'attached_at': '', 'detached_at': '', 'volume_id': '2f820341-4749-4ef8-8947-7512bc272c90', 'serial': '2f820341-4749-4ef8-8947-7512bc272c90'}, 'attachment_id': '12781d70-7865-4eca-a41a-d93c04235083', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:57 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:18:57 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:18:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tUkwnqOm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:18:57 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:18:57 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:18:57 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.utils [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a56b2e-aa2a-4ef2-8602-0d814b4e395f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:18:57 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[97379822-2a11-42ed-81bd-a718e9ad68b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafc9c50-b714-47e9-b334-0ceeb14530ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90] added
Oct 25 21:18:57 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[66776788-ffe9-44dd-87e8-863fe9037480]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa11ad9f-e84b-40b7-8bb8-45b0d2f5fdf0]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c274a9-2baa-419d-88b3-2385fc28d902]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bb025e-3aba-432c-994f-c219526a7a4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[021466bb-e332-4a25-8dbe-d146d20b60d0]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tUkwnqOm {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:18:57 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0875eb6f-9baf-4f65-9511-ce42cda8551f]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.utils [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Updating existing volume attachment record: 5a66d003-5495-4071-b291-f7a7b5edf021 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tUkwnqOm" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5362126c-3094-4967-85ea-81e857456e77]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tUkwnqOm'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b48d78-749a-40eb-a00d-e7b43603f24d]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfa6430-8b26-486f-a918-44723423af80]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)
Oct 25 21:18:57 user nova-compute[74189]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e (non-flash)
Oct 25 21:18:57 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)
Oct 25 21:18:57 user nova-compute[74189]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e (non-flash)
Oct 25 21:18:57 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7412534a-5c3a-4f45-863f-694b37d3e19c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90, portal: 172.16.0.220,3260]
Oct 25 21:18:57 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90, portal: 172.16.0.220,3260] successful.
Oct 25 21:18:57 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f56093d-533e-40a7-9ad6-575745b4303d]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5c03f6-3983-4792-985c-1f1d42dc537c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:18:57 user nova-compute[74189]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)
Oct 25 21:18:57 user nova-compute[74189]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e (non-flash)
Oct 25 21:18:57 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:18:57 user nova-compute[74189]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)
Oct 25 21:18:57 user nova-compute[74189]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e (non-flash)
Oct 25 21:18:57 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:18:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[662f541a-631e-4079-bf9c-65029dcb461c]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:18:58 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:18:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tUkwnqOm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:18:58 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:18:58 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:18:58 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:18:58 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:18:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:18:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:18:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:18:58 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '23835663435313262', 'path': '/dev/sdb'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835663435313262', 'path': '/dev/sdb'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:18:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1510065369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1510065369',id=11,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='acbb4f93936848a8949477ad124bf98e',ramdisk_id='',reservation_id='r-prbdlvvi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-571481303',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:18:03Z,user_data=None,user_id='fc377c1beaab443683a6d776f2f734ff',uuid=af1d7b3c-9950-4b74-8f15-b31011ccfa24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "address": "fa:16:3e:03:8e:2f", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4cdb73-9d", "ovs_interfaceid": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Converting VIF {"id": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "address": "fa:16:3e:03:8e:2f", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4cdb73-9d", "ovs_interfaceid": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:8e:2f,bridge_name='br-int',has_traffic_filtering=True,id=8f4cdb73-9d83-4bde-82a4-7198b06b904b,network=Network(f202171f-dfd8-4a19-9321-788318413ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f4cdb73-9d') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG nova.objects.instance [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lazy-loading 'pci_devices' on Instance uuid af1d7b3c-9950-4b74-8f15-b31011ccfa24 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:18:59 user nova-compute[74189]:   <uuid>af1d7b3c-9950-4b74-8f15-b31011ccfa24</uuid>
Oct 25 21:18:59 user nova-compute[74189]:   <name>instance-0000000b</name>
Oct 25 21:18:59 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:18:59 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:18:59 user nova-compute[74189]:   <metadata>
Oct 25 21:18:59 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:18:59 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:18:59 user nova-compute[74189]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1510065369</nova:name>
Oct 25 21:18:59 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:18:57</nova:creationTime>
Oct 25 21:18:59 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:18:59 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:18:59 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:18:59 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:18:59 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:18:59 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:18:59 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:18:59 user nova-compute[74189]:       <nova:owner>
Oct 25 21:18:59 user nova-compute[74189]:         <nova:user uuid="fc377c1beaab443683a6d776f2f734ff">tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member</nova:user>
Oct 25 21:18:59 user nova-compute[74189]:         <nova:project uuid="acbb4f93936848a8949477ad124bf98e">tempest-ServerBootFromVolumeStableRescueTest-571481303</nova:project>
Oct 25 21:18:59 user nova-compute[74189]:       </nova:owner>
Oct 25 21:18:59 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:18:59 user nova-compute[74189]:       <nova:ports>
Oct 25 21:18:59 user nova-compute[74189]:         <nova:port uuid="8f4cdb73-9d83-4bde-82a4-7198b06b904b">
Oct 25 21:18:59 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 25 21:18:59 user nova-compute[74189]:         </nova:port>
Oct 25 21:18:59 user nova-compute[74189]:       </nova:ports>
Oct 25 21:18:59 user nova-compute[74189]:     </nova:instance>
Oct 25 21:18:59 user nova-compute[74189]:   </metadata>
Oct 25 21:18:59 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:18:59 user nova-compute[74189]:     <system>
Oct 25 21:18:59 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:18:59 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:18:59 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:18:59 user nova-compute[74189]:       <entry name="serial">af1d7b3c-9950-4b74-8f15-b31011ccfa24</entry>
Oct 25 21:18:59 user nova-compute[74189]:       <entry name="uuid">af1d7b3c-9950-4b74-8f15-b31011ccfa24</entry>
Oct 25 21:18:59 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:18:59 user nova-compute[74189]:     </system>
Oct 25 21:18:59 user nova-compute[74189]:   </sysinfo>
Oct 25 21:18:59 user nova-compute[74189]:   <os>
Oct 25 21:18:59 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:18:59 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:18:59 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:18:59 user nova-compute[74189]:   </os>
Oct 25 21:18:59 user nova-compute[74189]:   <features>
Oct 25 21:18:59 user nova-compute[74189]:     <acpi/>
Oct 25 21:18:59 user nova-compute[74189]:     <apic/>
Oct 25 21:18:59 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:18:59 user nova-compute[74189]:   </features>
Oct 25 21:18:59 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:18:59 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:18:59 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:18:59 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:18:59 user nova-compute[74189]:   </clock>
Oct 25 21:18:59 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:18:59 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:18:59 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:18:59 user nova-compute[74189]:   </cpu>
Oct 25 21:18:59 user nova-compute[74189]:   <devices>
Oct 25 21:18:59 user nova-compute[74189]:     <disk type="block" device="disk">
Oct 25 21:18:59 user nova-compute[74189]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:18:59 user nova-compute[74189]:       <source dev="/dev/sdb"/>
Oct 25 21:18:59 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:18:59 user nova-compute[74189]:       <serial>2f820341-4749-4ef8-8947-7512bc272c90</serial>
Oct 25 21:18:59 user nova-compute[74189]:     </disk>
Oct 25 21:18:59 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:18:59 user nova-compute[74189]:       <mac address="fa:16:3e:03:8e:2f"/>
Oct 25 21:18:59 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:18:59 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:18:59 user nova-compute[74189]:       <target dev="tap8f4cdb73-9d"/>
Oct 25 21:18:59 user nova-compute[74189]:     </interface>
Oct 25 21:18:59 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:18:59 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/af1d7b3c-9950-4b74-8f15-b31011ccfa24/console.log" append="off"/>
Oct 25 21:18:59 user nova-compute[74189]:     </serial>
Oct 25 21:18:59 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:18:59 user nova-compute[74189]:     <video>
Oct 25 21:18:59 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:18:59 user nova-compute[74189]:     </video>
Oct 25 21:18:59 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:18:59 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:18:59 user nova-compute[74189]:     </rng>
Oct 25 21:18:59 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:18:59 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:18:59 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:18:59 user nova-compute[74189]:     </memballoon>
Oct 25 21:18:59 user nova-compute[74189]:   </devices>
Oct 25 21:18:59 user nova-compute[74189]: </domain>
Oct 25 21:18:59 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:18:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1510065369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1510065369',id=11,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='acbb4f93936848a8949477ad124bf98e',ramdisk_id='',reservation_id='r-prbdlvvi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-571481303',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:18:03Z,user_data=None,user_id='fc377c1beaab443683a6d776f2f734ff',uuid=af1d7b3c-9950-4b74-8f15-b31011ccfa24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "address": "fa:16:3e:03:8e:2f", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4cdb73-9d", "ovs_interfaceid": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Converting VIF {"id": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "address": "fa:16:3e:03:8e:2f", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4cdb73-9d", "ovs_interfaceid": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:8e:2f,bridge_name='br-int',has_traffic_filtering=True,id=8f4cdb73-9d83-4bde-82a4-7198b06b904b,network=Network(f202171f-dfd8-4a19-9321-788318413ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f4cdb73-9d') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG os_vif [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:8e:2f,bridge_name='br-int',has_traffic_filtering=True,id=8f4cdb73-9d83-4bde-82a4-7198b06b904b,network=Network(f202171f-dfd8-4a19-9321-788318413ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f4cdb73-9d') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f4af6f77-bc4f-5bbf-a884-5f8972629ffc', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f4cdb73-9d, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f4cdb73-9d, col_values=(('qos', UUID('e6d22c6c-bcdc-4668-873e-553125274143')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f4cdb73-9d, col_values=(('external_ids', {'iface-id': '8f4cdb73-9d83-4bde-82a4-7198b06b904b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:8e:2f', 'vm-uuid': 'af1d7b3c-9950-4b74-8f15-b31011ccfa24'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:18:59 user nova-compute[74189]: INFO os_vif [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:8e:2f,bridge_name='br-int',has_traffic_filtering=True,id=8f4cdb73-9d83-4bde-82a4-7198b06b904b,network=Network(f202171f-dfd8-4a19-9321-788318413ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f4cdb73-9d')
Oct 25 21:18:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] No VIF found with MAC fa:16:3e:03:8e:2f, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:18:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:00 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e1272f33-ef5e-48e6-912f-e0beae6dde11 is timed out.
Oct 25 21:19:00 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Successfully detached device vdb from instance e1272f33-ef5e-48e6-912f-e0beae6dde11 from the live domain config.
Oct 25 21:19:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NgrQvkhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:19:00 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:19:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[807185d9-5b18-42d2-bc65-16322b72d73a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:19:00 user nova-compute[74189]: No targets found.
Oct 25 21:19:00 user nova-compute[74189]: iSNS:
Oct 25 21:19:00 user nova-compute[74189]: No targets found.
Oct 25 21:19:00 user nova-compute[74189]: STATIC:
Oct 25 21:19:00 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e
Oct 25 21:19:00 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:19:00 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:19:00 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e
Oct 25 21:19:00 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:19:00 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:19:00 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:19:00 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:19:00 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:19:00 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d
Oct 25 21:19:00 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:19:00 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:19:00 user nova-compute[74189]: FIRMWARE:
Oct 25 21:19:00 user nova-compute[74189]: No targets found.
Oct 25 21:19:00 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:19:00 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:19:00 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52fc510-3640-468a-8a9c-b716b9d17a01/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[018a7522-8ee0-4089-a26b-24c66eaef90b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebc0717-42c9-4059-96f0-a9208a460555]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:19:00 user nova-compute[74189]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:19:00 user nova-compute[74189]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)
Oct 25 21:19:00 user nova-compute[74189]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e (non-flash)
Oct 25 21:19:00 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:19:00 user nova-compute[74189]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:19:00 user nova-compute[74189]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d (non-flash)
Oct 25 21:19:00 user nova-compute[74189]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e (non-flash)
Oct 25 21:19:00 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3041db0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d'): ({'sdg'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Removing single pathed devices sdg {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[02aebcca-2477-4233-9f29-b0b3043fa4f7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89c2402-91ba-4fe1-88ab-4a70cadda347]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Flushing IO for device /dev/sdg {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f621b3a-d4f4-4dde-b86b-71ccc20087b2]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.038s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[49df0905-2ac2-4659-8c0c-753bc4e8fbfd]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] SCSI volumes sdg have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52fc510-3640-468a-8a9c-b716b9d17a01/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52fc510-3640-468a-8a9c-b716b9d17a01/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2ab5a3-08c2-4f58-8516-613b0bb50358]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c68e23-2aa1-4361-a7c0-ba143e812912]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d, portal: 172.16.0.220,3260]
Oct 25 21:19:00 user nova-compute[74189]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d, portal: 172.16.0.220,3260] successful.
Oct 25 21:19:00 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257a6a89-a1a5-45bc-baad-5765b0f3355d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1e4e7d-ef02-4735-a705-a897ce92d28c]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] <== disconnect_volume: return (369ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52fc510-3640-468a-8a9c-b716b9d17a01/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG nova.compute.manager [req-c4f6e25a-4e11-4c32-8815-9d1c2b863514 req-05ebf64f-cb2f-4f72-9bd8-ab780ddcea92 service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Received event network-vif-plugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c4f6e25a-4e11-4c32-8815-9d1c2b863514 req-05ebf64f-cb2f-4f72-9bd8-ab780ddcea92 service nova] Acquiring lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c4f6e25a-4e11-4c32-8815-9d1c2b863514 req-05ebf64f-cb2f-4f72-9bd8-ab780ddcea92 service nova] Lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c4f6e25a-4e11-4c32-8815-9d1c2b863514 req-05ebf64f-cb2f-4f72-9bd8-ab780ddcea92 service nova] Lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG nova.compute.manager [req-c4f6e25a-4e11-4c32-8815-9d1c2b863514 req-05ebf64f-cb2f-4f72-9bd8-ab780ddcea92 service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] No waiting events found dispatching network-vif-plugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:19:00 user nova-compute[74189]: WARNING nova.compute.manager [req-c4f6e25a-4e11-4c32-8815-9d1c2b863514 req-05ebf64f-cb2f-4f72-9bd8-ab780ddcea92 service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Received unexpected event network-vif-plugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b for instance with vm_state building and task_state spawning.
Oct 25 21:19:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1272f33-ef5e-48e6-912f-e0beae6dde11/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1272f33-ef5e-48e6-912f-e0beae6dde11/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1272f33-ef5e-48e6-912f-e0beae6dde11/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1272f33-ef5e-48e6-912f-e0beae6dde11/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c05f317d-c6ea-4755-a9c7-42b90974ef1d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c05f317d-c6ea-4755-a9c7-42b90974ef1d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c05f317d-c6ea-4755-a9c7-42b90974ef1d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c05f317d-c6ea-4755-a9c7-42b90974ef1d/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:02 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:19:02 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:19:02 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=8020MB free_disk=25.457672119140625GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:19:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:02 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance d7c3a99a-ab38-4e88-896d-94ae51a09a48 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:19:02 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:19:02 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance c69c0800-7a6c-4155-9f90-bbcd323276d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:19:02 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance ea8d22c5-3868-43d1-b101-c6cff480dea6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:19:02 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance f52fc510-3640-468a-8a9c-b716b9d17a01 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:19:02 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance e1272f33-ef5e-48e6-912f-e0beae6dde11 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:19:02 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance a05b75c0-c064-42c5-aca7-c4b07cfabcfb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:19:02 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 2486ac33-a881-4be1-a24e-2ff263e51818 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:19:02 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance af1d7b3c-9950-4b74-8f15-b31011ccfa24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:19:02 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance c05f317d-c6ea-4755-a9c7-42b90974ef1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:19:02 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:19:02 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:19:02 user nova-compute[74189]: DEBUG nova.compute.manager [req-450b356e-c1bc-473d-975e-bf9aae557d27 req-7d972298-bf87-464c-a7d7-3be24e19f470 service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Received event network-vif-plugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-450b356e-c1bc-473d-975e-bf9aae557d27 req-7d972298-bf87-464c-a7d7-3be24e19f470 service nova] Acquiring lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-450b356e-c1bc-473d-975e-bf9aae557d27 req-7d972298-bf87-464c-a7d7-3be24e19f470 service nova] Lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-450b356e-c1bc-473d-975e-bf9aae557d27 req-7d972298-bf87-464c-a7d7-3be24e19f470 service nova] Lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:02 user nova-compute[74189]: DEBUG nova.compute.manager [req-450b356e-c1bc-473d-975e-bf9aae557d27 req-7d972298-bf87-464c-a7d7-3be24e19f470 service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] No waiting events found dispatching network-vif-plugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:19:02 user nova-compute[74189]: WARNING nova.compute.manager [req-450b356e-c1bc-473d-975e-bf9aae557d27 req-7d972298-bf87-464c-a7d7-3be24e19f470 service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Received unexpected event network-vif-plugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b for instance with vm_state building and task_state spawning.
Oct 25 21:19:02 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:19:02 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:19:03 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Instance spawned successfully.
Oct 25 21:19:03 user nova-compute[74189]: DEBUG nova.compute.manager [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ykUomIYH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f52fc510-3640-468a-8a9c-b716b9d17a01', 'attached_at': '', 'detached_at': '', 'volume_id': 'e07f2603-8906-4cb9-975e-5ac25a051963', 'serial': 'e07f2603-8906-4cb9-975e-5ac25a051963'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aWFZMYPT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '5f947800-cc9c-4224-86f6-d1e72d1c2d9e'}, 'status': 'reserved', 'instance': 'f52fc510-3640-468a-8a9c-b716b9d17a01', 'attached_at': '', 'detached_at': '', 'volume_id': '5f947800-cc9c-4224-86f6-d1e72d1c2d9e', 'serial'} {{(pid=74189) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ykUomIYH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:19:03 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:19:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:19:03 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:19:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:19:03 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1605c524-ea6a-4b02-bab7-d49265d40178]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:19:03 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8054987-b16b-4e91-9019-0e1d1d29b704]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963] added
Oct 25 21:19:03 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5733dda2-5b12-47c5-bb17-b185a441e713]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6afa19-38b2-4427-b5d0-3d4fbc872faf]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ykUomIYH {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG nova.objects.instance [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lazy-loading 'flavor' on Instance uuid ea8d22c5-3868-43d1-b101-c6cff480dea6 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:19:03 user nova-compute[74189]: INFO nova.compute.manager [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Took 5.61 seconds to spawn the instance on the hypervisor.
Oct 25 21:19:03 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ykUomIYH" returned: 0 in 0.031s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[117e9f0a-f091-4bf8-9037-350028f54b56]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ykUomIYH'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b73fb6-c074-4d2d-996a-8dd4b43542f3]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c5b15f-8b3b-410d-b4f2-95c844147ea0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:19:03 user nova-compute[74189]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:19:03 user nova-compute[74189]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e (non-flash)
Oct 25 21:19:03 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:19:03 user nova-compute[74189]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:19:03 user nova-compute[74189]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e (non-flash)
Oct 25 21:19:03 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.604s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6d97ff1f-019c-4712-928e-220f35b9e0ce tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lock "ea8d22c5-3868-43d1-b101-c6cff480dea6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 27.060s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:03 user nova-compute[74189]: INFO nova.compute.manager [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Took 61.05 seconds to build instance.
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca05387f-a9d8-4281-a552-2279bada18c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963, portal: 172.16.0.220,3260]
Oct 25 21:19:03 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963, portal: 172.16.0.220,3260] successful.
Oct 25 21:19:03 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5b5b9a89-c570-4c41-b17e-26e1d21818d6 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 61.148s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d748f9bf-e663-4a12-a06b-cee2df35f633]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e00b63-7ead-4667-8f5e-20a32e06c0da]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:19:03 user nova-compute[74189]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:19:03 user nova-compute[74189]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:19:03 user nova-compute[74189]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e (non-flash)
Oct 25 21:19:03 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:19:03 user nova-compute[74189]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:19:03 user nova-compute[74189]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:19:03 user nova-compute[74189]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e (non-flash)
Oct 25 21:19:03 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] HCTL ('36', '-', '-', 0) found on session 12 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1b1754-ef68-4424-8316-7ba2513e3381]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Searching for a device in session 12 and hctl ['36', '*', '*', 0] yield: None {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquiring lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.004s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG nova.objects.instance [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lazy-loading 'flavor' on Instance uuid 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquiring lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:03 user nova-compute[74189]: INFO nova.compute.manager [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Attaching volume baed35ad-5534-47eb-93f6-2393d45d9e78 to /dev/vdb
Oct 25 21:19:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG nova.objects.instance [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Lazy-loading 'flavor' on Instance uuid e1272f33-ef5e-48e6-912f-e0beae6dde11 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG os_brick.utils [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[924488c0-f050-4919-bc75-56ced866e56c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f9084781-768d-4413-b4f8-c90a69f3d147 tempest-VolumesAssistedSnapshotsTest-205426016 tempest-VolumesAssistedSnapshotsTest-205426016-project-admin] Lock "e1272f33-ef5e-48e6-912f-e0beae6dde11" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.751s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c13453-9c07-4c95-9a95-e1397faafae3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56681f6-3fbb-43bb-8c81-c44e9a32cb63]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d893dc92-382d-4a8c-9706-786fa8c57b5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:19:04 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:19:04 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd050a5-7a07-4b18-a9e0-ff3e34d95e0f]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG os_brick.utils [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Updating existing volume attachment record: 9062b58f-f711-4729-a3e9-cce260830475 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-c69c0800-7a6c-4155-9f90-bbcd323276d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-c69c0800-7a6c-4155-9f90-bbcd323276d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Searching for a device in session 12 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ykUomIYH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '23031663734613036', 'path': '/dev/sde'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031663734613036', 'path': '/dev/sde'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-03d97097-77b5-4d01-92d4-42ec3bfa0bb7 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Acquiring lock "interface-ea8d22c5-3868-43d1-b101-c6cff480dea6-f25ca758-602f-481b-8de2-4a8040b991cd" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-03d97097-77b5-4d01-92d4-42ec3bfa0bb7 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lock "interface-ea8d22c5-3868-43d1-b101-c6cff480dea6-f25ca758-602f-481b-8de2-4a8040b991cd" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG nova.objects.instance [None req-03d97097-77b5-4d01-92d4-42ec3bfa0bb7 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lazy-loading 'flavor' on Instance uuid ea8d22c5-3868-43d1-b101-c6cff480dea6 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG nova.objects.instance [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Lazy-loading 'flavor' on Instance uuid f52fc510-3640-468a-8a9c-b716b9d17a01 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Acquiring lock "4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-03d97097-77b5-4d01-92d4-42ec3bfa0bb7 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-781387297',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-781387297',id=6,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHJgDbw7K7bwNJyj3WQeM4O7X1T/XxzeuPN+AM4eJ62yayGmYQQS1OGbI1fYrJusZqdcuogdpmdUBe6qoNmEvj36GKw2Ywp/JElU+pyp8QCNHY9uIrm3I9Zf5tuFbEg3Q==',key_name='tempest-keypair-159731972',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:15:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d6d05f10a0647e9a014e78f2a7dab78',ramdisk_id='',reservation_id='r-oi1337uc',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1187636517',owner_user_name='tempest-TaggedAttachmentsTest-1187636517-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:15:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a147e32cb7fd45aaa1398a1332e6956a',uuid=ea8d22c5-3868-43d1-b101-c6cff480dea6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f25ca758-602f-481b-8de2-4a8040b991cd", "address": "fa:16:3e:3c:4e:d6", "network": {"id": "2b3af293-fcd7-4868-89bd-0701f2814a8b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-227584648", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7d6d05f10a0647e9a014e78f2a7dab78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25ca758-60", "ovs_interfaceid": "f25ca758-602f-481b-8de2-4a8040b991cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-03d97097-77b5-4d01-92d4-42ec3bfa0bb7 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Converting VIF {"id": "f25ca758-602f-481b-8de2-4a8040b991cd", "address": "fa:16:3e:3c:4e:d6", "network": {"id": "2b3af293-fcd7-4868-89bd-0701f2814a8b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-227584648", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7d6d05f10a0647e9a014e78f2a7dab78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25ca758-60", "ovs_interfaceid": "f25ca758-602f-481b-8de2-4a8040b991cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-03d97097-77b5-4d01-92d4-42ec3bfa0bb7 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:4e:d6,bridge_name='br-int',has_traffic_filtering=True,id=f25ca758-602f-481b-8de2-4a8040b991cd,network=Network(2b3af293-fcd7-4868-89bd-0701f2814a8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf25ca758-60') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG nova.compute.manager [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-03d97097-77b5-4d01-92d4-42ec3bfa0bb7 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3c:4e:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tapf25ca758-60"/></interface> {{(pid=74189) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-03d97097-77b5-4d01-92d4-42ec3bfa0bb7 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3c:4e:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tapf25ca758-60"/></interface> {{(pid=74189) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-03d97097-77b5-4d01-92d4-42ec3bfa0bb7 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Attempting to detach device tapf25ca758-60 from instance ea8d22c5-3868-43d1-b101-c6cff480dea6 from the persistent domain config. {{(pid=74189) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-03d97097-77b5-4d01-92d4-42ec3bfa0bb7 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] detach device xml: <interface type="ethernet">
Oct 25 21:19:04 user nova-compute[74189]:   <mac address="fa:16:3e:3c:4e:d6"/>
Oct 25 21:19:04 user nova-compute[74189]:   <model type="virtio"/>
Oct 25 21:19:04 user nova-compute[74189]:   <mtu size="1442"/>
Oct 25 21:19:04 user nova-compute[74189]:   <target dev="tapf25ca758-60"/>
Oct 25 21:19:04 user nova-compute[74189]: </interface>
Oct 25 21:19:04 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-03d97097-77b5-4d01-92d4-42ec3bfa0bb7 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3c:4e:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tapf25ca758-60"/></interface> {{(pid=74189) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-03d97097-77b5-4d01-92d4-42ec3bfa0bb7 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:3c:4e:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tapf25ca758-60"/></interface>not found in domain: <domain type='kvm' id='6'>
Oct 25 21:19:04 user nova-compute[74189]:   <name>instance-00000006</name>
Oct 25 21:19:04 user nova-compute[74189]:   <uuid>ea8d22c5-3868-43d1-b101-c6cff480dea6</uuid>
Oct 25 21:19:04 user nova-compute[74189]:   <metadata>
Oct 25 21:19:04 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:19:04 user nova-compute[74189]:   <nova:package version="0.0.0"/>
Oct 25 21:19:04 user nova-compute[74189]:   <nova:name>tempest-device-tagging-server-781387297</nova:name>
Oct 25 21:19:04 user nova-compute[74189]:   <nova:creationTime>2023-10-25 21:17:31</nova:creationTime>
Oct 25 21:19:04 user nova-compute[74189]:   <nova:flavor name="m1.tiny">
Oct 25 21:19:04 user nova-compute[74189]:     <nova:memory>512</nova:memory>
Oct 25 21:19:04 user nova-compute[74189]:     <nova:disk>1</nova:disk>
Oct 25 21:19:04 user nova-compute[74189]:     <nova:swap>0</nova:swap>
Oct 25 21:19:04 user nova-compute[74189]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:19:04 user nova-compute[74189]:     <nova:vcpus>1</nova:vcpus>
Oct 25 21:19:04 user nova-compute[74189]:   </nova:flavor>
Oct 25 21:19:04 user nova-compute[74189]:   <nova:owner>
Oct 25 21:19:04 user nova-compute[74189]:     <nova:user uuid="a147e32cb7fd45aaa1398a1332e6956a">tempest-TaggedAttachmentsTest-1187636517-project-member</nova:user>
Oct 25 21:19:04 user nova-compute[74189]:     <nova:project uuid="7d6d05f10a0647e9a014e78f2a7dab78">tempest-TaggedAttachmentsTest-1187636517</nova:project>
Oct 25 21:19:04 user nova-compute[74189]:   </nova:owner>
Oct 25 21:19:04 user nova-compute[74189]:   <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:19:04 user nova-compute[74189]:   <nova:ports>
Oct 25 21:19:04 user nova-compute[74189]:     <nova:port uuid="a151161f-1633-405f-ac74-9f379531d89a">
Oct 25 21:19:04 user nova-compute[74189]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 25 21:19:04 user nova-compute[74189]:     </nova:port>
Oct 25 21:19:04 user nova-compute[74189]:     <nova:port uuid="f25ca758-602f-481b-8de2-4a8040b991cd">
Oct 25 21:19:04 user nova-compute[74189]:       <nova:ip type="fixed" address="10.10.10.55" ipVersion="4"/>
Oct 25 21:19:04 user nova-compute[74189]:     </nova:port>
Oct 25 21:19:04 user nova-compute[74189]:   </nova:ports>
Oct 25 21:19:04 user nova-compute[74189]: </nova:instance>
Oct 25 21:19:04 user nova-compute[74189]:   </metadata>
Oct 25 21:19:04 user nova-compute[74189]:   <memory unit='KiB'>524288</memory>
Oct 25 21:19:04 user nova-compute[74189]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 25 21:19:04 user nova-compute[74189]:   <vcpu placement='static'>1</vcpu>
Oct 25 21:19:04 user nova-compute[74189]:   <resource>
Oct 25 21:19:04 user nova-compute[74189]:     <partition>/machine</partition>
Oct 25 21:19:04 user nova-compute[74189]:   </resource>
Oct 25 21:19:04 user nova-compute[74189]:   <sysinfo type='smbios'>
Oct 25 21:19:04 user nova-compute[74189]:     <system>
Oct 25 21:19:04 user nova-compute[74189]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 25 21:19:04 user nova-compute[74189]:       <entry name='product'>OpenStack Nova</entry>
Oct 25 21:19:04 user nova-compute[74189]:       <entry name='version'>0.0.0</entry>
Oct 25 21:19:04 user nova-compute[74189]:       <entry name='serial'>ea8d22c5-3868-43d1-b101-c6cff480dea6</entry>
Oct 25 21:19:04 user nova-compute[74189]:       <entry name='uuid'>ea8d22c5-3868-43d1-b101-c6cff480dea6</entry>
Oct 25 21:19:04 user nova-compute[74189]:       <entry name='family'>Virtual Machine</entry>
Oct 25 21:19:04 user nova-compute[74189]:     </system>
Oct 25 21:19:04 user nova-compute[74189]:   </sysinfo>
Oct 25 21:19:04 user nova-compute[74189]:   <os>
Oct 25 21:19:04 user nova-compute[74189]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 25 21:19:04 user nova-compute[74189]:     <boot dev='hd'/>
Oct 25 21:19:04 user nova-compute[74189]:     <smbios mode='sysinfo'/>
Oct 25 21:19:04 user nova-compute[74189]:   </os>
Oct 25 21:19:04 user nova-compute[74189]:   <features>
Oct 25 21:19:04 user nova-compute[74189]:     <acpi/>
Oct 25 21:19:04 user nova-compute[74189]:     <apic/>
Oct 25 21:19:04 user nova-compute[74189]:     <vmcoreinfo state='on'/>
Oct 25 21:19:04 user nova-compute[74189]:   </features>
Oct 25 21:19:04 user nova-compute[74189]:   <cpu mode='custom' match='exact' check='full'>
Oct 25 21:19:04 user nova-compute[74189]:     <model fallback='forbid'>Nehalem</model>
Oct 25 21:19:04 user nova-compute[74189]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 25 21:19:04 user nova-compute[74189]:     <feature policy='require' name='vme'/>
Oct 25 21:19:04 user nova-compute[74189]:     <feature policy='require' name='x2apic'/>
Oct 25 21:19:04 user nova-compute[74189]:     <feature policy='require' name='hypervisor'/>
Oct 25 21:19:04 user nova-compute[74189]:   </cpu>
Oct 25 21:19:04 user nova-compute[74189]:   <clock offset='utc'>
Oct 25 21:19:04 user nova-compute[74189]:     <timer name='pit' tickpolicy='delay'/>
Oct 25 21:19:04 user nova-compute[74189]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 25 21:19:04 user nova-compute[74189]:     <timer name='hpet' present='no'/>
Oct 25 21:19:04 user nova-compute[74189]:   </clock>
Oct 25 21:19:04 user nova-compute[74189]:   <on_poweroff>destroy</on_poweroff>
Oct 25 21:19:04 user nova-compute[74189]:   <on_reboot>restart</on_reboot>
Oct 25 21:19:04 user nova-compute[74189]:   <on_crash>destroy</on_crash>
Oct 25 21:19:04 user nova-compute[74189]:   <devices>
Oct 25 21:19:04 user nova-compute[74189]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 25 21:19:04 user nova-compute[74189]:     <disk type='file' device='disk'>
Oct 25 21:19:04 user nova-compute[74189]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 25 21:19:04 user nova-compute[74189]:       <source file='/opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk' index='2'/>
Oct 25 21:19:04 user nova-compute[74189]:       <backingStore type='file' index='3'>
Oct 25 21:19:04 user nova-compute[74189]:         <format type='raw'/>
Oct 25 21:19:04 user nova-compute[74189]:         <source file='/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8'/>
Oct 25 21:19:04 user nova-compute[74189]:         <backingStore/>
Oct 25 21:19:04 user nova-compute[74189]:       </backingStore>
Oct 25 21:19:04 user nova-compute[74189]:       <target dev='vda' bus='virtio'/>
Oct 25 21:19:04 user nova-compute[74189]:       <alias name='virtio-disk0'/>
Oct 25 21:19:04 user nova-compute[74189]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 25 21:19:04 user nova-compute[74189]:     </disk>
Oct 25 21:19:04 user nova-compute[74189]:     <disk type='file' device='cdrom'>
Oct 25 21:19:04 user nova-compute[74189]:       <driver name='qemu' type='raw' cache='none'/>
Oct 25 21:19:04 user nova-compute[74189]:       <source file='/opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk.config' index='1'/>
Oct 25 21:19:04 user nova-compute[74189]:       <backingStore/>
Oct 25 21:19:04 user nova-compute[74189]:       <target dev='hda' bus='ide'/>
Oct 25 21:19:04 user nova-compute[74189]:       <readonly/>
Oct 25 21:19:04 user nova-compute[74189]:       <alias name='ide0-0-0'/>
Oct 25 21:19:04 user nova-compute[74189]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 25 21:19:04 user nova-compute[74189]:     </disk>
Oct 25 21:19:04 user nova-compute[74189]:     <controller type='usb' index='0' model='none'>
Oct 25 21:19:04 user nova-compute[74189]:       <alias name='usb'/>
Oct 25 21:19:04 user nova-compute[74189]:     </controller>
Oct 25 21:19:04 user nova-compute[74189]:     <controller type='pci' index='0' model='pci-root'>
Oct 25 21:19:04 user nova-compute[74189]:       <alias name='pci.0'/>
Oct 25 21:19:04 user nova-compute[74189]:     </controller>
Oct 25 21:19:04 user nova-compute[74189]:     <controller type='ide' index='0'>
Oct 25 21:19:04 user nova-compute[74189]:       <alias name='ide'/>
Oct 25 21:19:04 user nova-compute[74189]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 25 21:19:04 user nova-compute[74189]:     </controller>
Oct 25 21:19:04 user nova-compute[74189]:     <interface type='ethernet'>
Oct 25 21:19:04 user nova-compute[74189]:       <mac address='fa:16:3e:63:71:94'/>
Oct 25 21:19:04 user nova-compute[74189]:       <target dev='tapa151161f-16'/>
Oct 25 21:19:04 user nova-compute[74189]:       <model type='virtio'/>
Oct 25 21:19:04 user nova-compute[74189]:       <mtu size='1442'/>
Oct 25 21:19:04 user nova-compute[74189]:       <alias name='net0'/>
Oct 25 21:19:04 user nova-compute[74189]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 25 21:19:04 user nova-compute[74189]:     </interface>
Oct 25 21:19:04 user nova-compute[74189]:     <interface type='ethernet'>
Oct 25 21:19:04 user nova-compute[74189]:       <mac address='fa:16:3e:3c:4e:d6'/>
Oct 25 21:19:04 user nova-compute[74189]:       <target dev='tapf25ca758-60'/>
Oct 25 21:19:04 user nova-compute[74189]:       <model type='virtio'/>
Oct 25 21:19:04 user nova-compute[74189]:       <mtu size='1442'/>
Oct 25 21:19:04 user nova-compute[74189]:       <alias name='net1'/>
Oct 25 21:19:04 user nova-compute[74189]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Oct 25 21:19:04 user nova-compute[74189]:     </interface>
Oct 25 21:19:04 user nova-compute[74189]:     <serial type='pty'>
Oct 25 21:19:04 user nova-compute[74189]:       <source path='/dev/pts/5'/>
Oct 25 21:19:04 user nova-compute[74189]:       <log file='/opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/console.log' append='off'/>
Oct 25 21:19:04 user nova-compute[74189]:       <target type='isa-serial' port='0'>
Oct 25 21:19:04 user nova-compute[74189]:         <model name='isa-serial'/>
Oct 25 21:19:04 user nova-compute[74189]:       </target>
Oct 25 21:19:04 user nova-compute[74189]:       <alias name='serial0'/>
Oct 25 21:19:04 user nova-compute[74189]:     </serial>
Oct 25 21:19:04 user nova-compute[74189]:     <console type='pty' tty='/dev/pts/5'>
Oct 25 21:19:04 user nova-compute[74189]:       <source path='/dev/pts/5'/>
Oct 25 21:19:04 user nova-compute[74189]:       <log file='/opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/console.log' append='off'/>
Oct 25 21:19:04 user nova-compute[74189]:       <target type='serial' port='0'/>
Oct 25 21:19:04 user nova-compute[74189]:       <alias name='serial0'/>
Oct 25 21:19:04 user nova-compute[74189]:     </console>
Oct 25 21:19:04 user nova-compute[74189]:     <input type='mouse' bus='ps2'>
Oct 25 21:19:04 user nova-compute[74189]:       <alias name='input0'/>
Oct 25 21:19:04 user nova-compute[74189]:     </input>
Oct 25 21:19:04 user nova-compute[74189]:     <input type='keyboard' bus='ps2'>
Oct 25 21:19:04 user nova-compute[74189]:       <alias name='input1'/>
Oct 25 21:19:04 user nova-compute[74189]:     </input>
Oct 25 21:19:04 user nova-compute[74189]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Oct 25 21:19:04 user nova-compute[74189]:       <listen type='address' address='0.0.0.0'/>
Oct 25 21:19:04 user nova-compute[74189]:     </graphics>
Oct 25 21:19:04 user nova-compute[74189]:     <audio id='1' type='none'/>
Oct 25 21:19:04 user nova-compute[74189]:     <video>
Oct 25 21:19:04 user nova-compute[74189]:       <model type='virtio' heads='1' primary='yes'/>
Oct 25 21:19:04 user nova-compute[74189]:       <alias name='video0'/>
Oct 25 21:19:04 user nova-compute[74189]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 25 21:19:04 user nova-compute[74189]:     </video>
Oct 25 21:19:04 user nova-compute[74189]:     <memballoon model='virtio'>
Oct 25 21:19:04 user nova-compute[74189]:       <stats period='10'/>
Oct 25 21:19:04 user nova-compute[74189]:       <alias name='balloon0'/>
Oct 25 21:19:04 user nova-compute[74189]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 25 21:19:04 user nova-compute[74189]:     </memballoon>
Oct 25 21:19:04 user nova-compute[74189]:     <rng model='virtio'>
Oct 25 21:19:04 user nova-compute[74189]:       <backend model='random'>/dev/urandom</backend>
Oct 25 21:19:04 user nova-compute[74189]:       <alias name='rng0'/>
Oct 25 21:19:04 user nova-compute[74189]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 25 21:19:04 user nova-compute[74189]:     </rng>
Oct 25 21:19:04 user nova-compute[74189]:   </devices>
Oct 25 21:19:04 user nova-compute[74189]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 25 21:19:04 user nova-compute[74189]:     <label>libvirt-ea8d22c5-3868-43d1-b101-c6cff480dea6</label>
Oct 25 21:19:04 user nova-compute[74189]:     <imagelabel>libvirt-ea8d22c5-3868-43d1-b101-c6cff480dea6</imagelabel>
Oct 25 21:19:04 user nova-compute[74189]:   </seclabel>
Oct 25 21:19:04 user nova-compute[74189]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 25 21:19:04 user nova-compute[74189]:     <label>+64055:+108</label>
Oct 25 21:19:04 user nova-compute[74189]:     <imagelabel>+64055:+108</imagelabel>
Oct 25 21:19:04 user nova-compute[74189]:   </seclabel>
Oct 25 21:19:04 user nova-compute[74189]: </domain>
Oct 25 21:19:04 user nova-compute[74189]:  {{(pid=74189) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 25 21:19:04 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-03d97097-77b5-4d01-92d4-42ec3bfa0bb7 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Successfully detached device tapf25ca758-60 from instance ea8d22c5-3868-43d1-b101-c6cff480dea6 from the persistent domain config.
Oct 25 21:19:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-03d97097-77b5-4d01-92d4-42ec3bfa0bb7 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] (1/8): Attempting to detach device tapf25ca758-60 with device alias net1 from instance ea8d22c5-3868-43d1-b101-c6cff480dea6 from the live domain config. {{(pid=74189) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-03d97097-77b5-4d01-92d4-42ec3bfa0bb7 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] detach device xml: <interface type="ethernet">
Oct 25 21:19:04 user nova-compute[74189]:   <mac address="fa:16:3e:3c:4e:d6"/>
Oct 25 21:19:04 user nova-compute[74189]:   <model type="virtio"/>
Oct 25 21:19:04 user nova-compute[74189]:   <mtu size="1442"/>
Oct 25 21:19:04 user nova-compute[74189]:   <target dev="tapf25ca758-60"/>
Oct 25 21:19:04 user nova-compute[74189]: </interface>
Oct 25 21:19:04 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:19:04 user nova-compute[74189]: INFO nova.compute.claims [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Claim successful on node user
Oct 25 21:19:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-03d97097-77b5-4d01-92d4-42ec3bfa0bb7 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Start waiting for the detach event from libvirt for device tapf25ca758-60 with device alias net1 for instance ea8d22c5-3868-43d1-b101-c6cff480dea6 {{(pid=74189) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Updating instance_info_cache with network_info: [{"id": "e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc", "address": "fa:16:3e:50:70:e6", "network": {"id": "093e46a2-3a83-46b5-a13b-661868863db1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1577201171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09c2027cbebd4ffd9989ba14156beeba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3d8e995-9e", "ovs_interfaceid": "e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-c69c0800-7a6c-4155-9f90-bbcd323276d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74189) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:19:04 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:19:05 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:19:05 user nova-compute[74189]: DEBUG nova.compute.manager [req-dba21dd9-a22a-43c4-abba-241e799d1af0 req-85ef508a-c7f8-46ef-a869-0669e407285b service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Received event network-vif-unplugged-f25ca758-602f-481b-8de2-4a8040b991cd {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-dba21dd9-a22a-43c4-abba-241e799d1af0 req-85ef508a-c7f8-46ef-a869-0669e407285b service nova] Acquiring lock "ea8d22c5-3868-43d1-b101-c6cff480dea6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-dba21dd9-a22a-43c4-abba-241e799d1af0 req-85ef508a-c7f8-46ef-a869-0669e407285b service nova] Lock "ea8d22c5-3868-43d1-b101-c6cff480dea6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-dba21dd9-a22a-43c4-abba-241e799d1af0 req-85ef508a-c7f8-46ef-a869-0669e407285b service nova] Lock "ea8d22c5-3868-43d1-b101-c6cff480dea6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:05 user nova-compute[74189]: DEBUG nova.compute.manager [req-dba21dd9-a22a-43c4-abba-241e799d1af0 req-85ef508a-c7f8-46ef-a869-0669e407285b service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] No waiting events found dispatching network-vif-unplugged-f25ca758-602f-481b-8de2-4a8040b991cd {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:19:05 user nova-compute[74189]: WARNING nova.compute.manager [req-dba21dd9-a22a-43c4-abba-241e799d1af0 req-85ef508a-c7f8-46ef-a869-0669e407285b service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Received unexpected event network-vif-unplugged-f25ca758-602f-481b-8de2-4a8040b991cd for instance with vm_state active and task_state None.
Oct 25 21:19:05 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:19:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] COPY block job progress, current cursor: 75497472 final cursor: 1073741824 {{(pid=74189) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 21:19:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.836s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:05 user nova-compute[74189]: DEBUG nova.compute.manager [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:19:05 user nova-compute[74189]: DEBUG nova.compute.manager [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:19:05 user nova-compute[74189]: DEBUG nova.network.neutron [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:19:05 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:19:05 user nova-compute[74189]: DEBUG nova.compute.manager [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:19:05 user nova-compute[74189]: DEBUG nova.policy [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '522bbceca0c6444cb16bb575f4186c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c2027cbebd4ffd9989ba14156beeba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:19:05 user nova-compute[74189]: DEBUG nova.compute.manager [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:19:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:19:05 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Creating image(s)
Oct 25 21:19:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Acquiring lock "/opt/stack/data/nova/instances/4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "/opt/stack/data/nova/instances/4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "/opt/stack/data/nova/instances/4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] COPY block job progress, current cursor: 137363456 final cursor: 1073741824 {{(pid=74189) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 21:19:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.214s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.207s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f/disk 1073741824" returned: 0 in 0.075s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:06 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] COPY block job progress, current cursor: 196083712 final cursor: 1073741824 {{(pid=74189) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 21:19:06 user nova-compute[74189]: DEBUG nova.network.neutron [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Successfully created port: 8df72a30-cfbf-4025-a343-f47fe0978c35 {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:19:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.220s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:06 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:19:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:06 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Cannot resize image /opt/stack/data/nova/instances/4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:19:06 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:19:06 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Ensure instance console log exists: /opt/stack/data/nova/instances/4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:19:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:06 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] COPY block job progress, current cursor: 268435456 final cursor: 1073741824 {{(pid=74189) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 21:19:07 user nova-compute[74189]: DEBUG nova.compute.manager [req-8ff2a37f-7220-4c2f-834a-91d4d81bd5b5 req-bb745aaa-ab13-4aa4-a8d7-720fc837f517 service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Received event network-vif-plugged-f25ca758-602f-481b-8de2-4a8040b991cd {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8ff2a37f-7220-4c2f-834a-91d4d81bd5b5 req-bb745aaa-ab13-4aa4-a8d7-720fc837f517 service nova] Acquiring lock "ea8d22c5-3868-43d1-b101-c6cff480dea6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8ff2a37f-7220-4c2f-834a-91d4d81bd5b5 req-bb745aaa-ab13-4aa4-a8d7-720fc837f517 service nova] Lock "ea8d22c5-3868-43d1-b101-c6cff480dea6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8ff2a37f-7220-4c2f-834a-91d4d81bd5b5 req-bb745aaa-ab13-4aa4-a8d7-720fc837f517 service nova] Lock "ea8d22c5-3868-43d1-b101-c6cff480dea6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:07 user nova-compute[74189]: DEBUG nova.compute.manager [req-8ff2a37f-7220-4c2f-834a-91d4d81bd5b5 req-bb745aaa-ab13-4aa4-a8d7-720fc837f517 service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] No waiting events found dispatching network-vif-plugged-f25ca758-602f-481b-8de2-4a8040b991cd {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:19:07 user nova-compute[74189]: WARNING nova.compute.manager [req-8ff2a37f-7220-4c2f-834a-91d4d81bd5b5 req-bb745aaa-ab13-4aa4-a8d7-720fc837f517 service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Received unexpected event network-vif-plugged-f25ca758-602f-481b-8de2-4a8040b991cd for instance with vm_state active and task_state None.
Oct 25 21:19:07 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] COPY block job progress, current cursor: 338690048 final cursor: 1073741824 {{(pid=74189) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 21:19:07 user nova-compute[74189]: DEBUG nova.network.neutron [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Successfully updated port: 8df72a30-cfbf-4025-a343-f47fe0978c35 {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:19:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Acquiring lock "refresh_cache-4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:19:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Acquired lock "refresh_cache-4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:19:07 user nova-compute[74189]: DEBUG nova.network.neutron [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:19:07 user nova-compute[74189]: DEBUG nova.compute.manager [req-1fdfa28e-27a8-4fe7-82b0-fd4970b40b52 req-d26fdac9-3cea-42da-b61d-ae8016a37dbb service nova] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Received event network-changed-8df72a30-cfbf-4025-a343-f47fe0978c35 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:07 user nova-compute[74189]: DEBUG nova.compute.manager [req-1fdfa28e-27a8-4fe7-82b0-fd4970b40b52 req-d26fdac9-3cea-42da-b61d-ae8016a37dbb service nova] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Refreshing instance network info cache due to event network-changed-8df72a30-cfbf-4025-a343-f47fe0978c35. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:19:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1fdfa28e-27a8-4fe7-82b0-fd4970b40b52 req-d26fdac9-3cea-42da-b61d-ae8016a37dbb service nova] Acquiring lock "refresh_cache-4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:19:07 user nova-compute[74189]: DEBUG nova.network.neutron [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] COPY block job progress, current cursor: 443547648 final cursor: 1073741824 {{(pid=74189) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG nova.network.neutron [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Updating instance_info_cache with network_info: [{"id": "8df72a30-cfbf-4025-a343-f47fe0978c35", "address": "fa:16:3e:19:6d:f5", "network": {"id": "093e46a2-3a83-46b5-a13b-661868863db1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1577201171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09c2027cbebd4ffd9989ba14156beeba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df72a30-cf", "ovs_interfaceid": "8df72a30-cfbf-4025-a343-f47fe0978c35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Releasing lock "refresh_cache-4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG nova.compute.manager [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Instance network_info: |[{"id": "8df72a30-cfbf-4025-a343-f47fe0978c35", "address": "fa:16:3e:19:6d:f5", "network": {"id": "093e46a2-3a83-46b5-a13b-661868863db1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1577201171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09c2027cbebd4ffd9989ba14156beeba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df72a30-cf", "ovs_interfaceid": "8df72a30-cfbf-4025-a343-f47fe0978c35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1fdfa28e-27a8-4fe7-82b0-fd4970b40b52 req-d26fdac9-3cea-42da-b61d-ae8016a37dbb service nova] Acquired lock "refresh_cache-4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG nova.network.neutron [req-1fdfa28e-27a8-4fe7-82b0-fd4970b40b52 req-d26fdac9-3cea-42da-b61d-ae8016a37dbb service nova] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Refreshing network info cache for port 8df72a30-cfbf-4025-a343-f47fe0978c35 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Start _get_guest_xml network_info=[{"id": "8df72a30-cfbf-4025-a343-f47fe0978c35", "address": "fa:16:3e:19:6d:f5", "network": {"id": "093e46a2-3a83-46b5-a13b-661868863db1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1577201171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09c2027cbebd4ffd9989ba14156beeba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df72a30-cf", "ovs_interfaceid": "8df72a30-cfbf-4025-a343-f47fe0978c35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:19:08 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:19:08 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:19:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:19:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-338936039',display_name='tempest-VolumesAdminNegativeTest-server-338936039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-338936039',id=13,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09c2027cbebd4ffd9989ba14156beeba',ramdisk_id='',reservation_id='r-ftlf6yfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-892271548',owner_user_name='tempest-VolumesAdminNegativeTest-892271548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:19:06Z,user_data=None,user_id='522bbceca0c6444cb16bb575f4186c5c',uuid=4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8df72a30-cfbf-4025-a343-f47fe0978c35", "address": "fa:16:3e:19:6d:f5", "network": {"id": "093e46a2-3a83-46b5-a13b-661868863db1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1577201171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09c2027cbebd4ffd9989ba14156beeba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df72a30-cf", "ovs_interfaceid": "8df72a30-cfbf-4025-a343-f47fe0978c35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Converting VIF {"id": "8df72a30-cfbf-4025-a343-f47fe0978c35", "address": "fa:16:3e:19:6d:f5", "network": {"id": "093e46a2-3a83-46b5-a13b-661868863db1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1577201171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09c2027cbebd4ffd9989ba14156beeba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df72a30-cf", "ovs_interfaceid": "8df72a30-cfbf-4025-a343-f47fe0978c35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:6d:f5,bridge_name='br-int',has_traffic_filtering=True,id=8df72a30-cfbf-4025-a343-f47fe0978c35,network=Network(093e46a2-3a83-46b5-a13b-661868863db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8df72a30-cf') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG nova.objects.instance [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lazy-loading 'pci_devices' on Instance uuid 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:19:08 user nova-compute[74189]:   <uuid>4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f</uuid>
Oct 25 21:19:08 user nova-compute[74189]:   <name>instance-0000000d</name>
Oct 25 21:19:08 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:19:08 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:19:08 user nova-compute[74189]:   <metadata>
Oct 25 21:19:08 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:19:08 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:19:08 user nova-compute[74189]:       <nova:name>tempest-VolumesAdminNegativeTest-server-338936039</nova:name>
Oct 25 21:19:08 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:19:08</nova:creationTime>
Oct 25 21:19:08 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:19:08 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:19:08 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:19:08 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:19:08 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:19:08 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:19:08 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:19:08 user nova-compute[74189]:       <nova:owner>
Oct 25 21:19:08 user nova-compute[74189]:         <nova:user uuid="522bbceca0c6444cb16bb575f4186c5c">tempest-VolumesAdminNegativeTest-892271548-project-member</nova:user>
Oct 25 21:19:08 user nova-compute[74189]:         <nova:project uuid="09c2027cbebd4ffd9989ba14156beeba">tempest-VolumesAdminNegativeTest-892271548</nova:project>
Oct 25 21:19:08 user nova-compute[74189]:       </nova:owner>
Oct 25 21:19:08 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:19:08 user nova-compute[74189]:       <nova:ports>
Oct 25 21:19:08 user nova-compute[74189]:         <nova:port uuid="8df72a30-cfbf-4025-a343-f47fe0978c35">
Oct 25 21:19:08 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 21:19:08 user nova-compute[74189]:         </nova:port>
Oct 25 21:19:08 user nova-compute[74189]:       </nova:ports>
Oct 25 21:19:08 user nova-compute[74189]:     </nova:instance>
Oct 25 21:19:08 user nova-compute[74189]:   </metadata>
Oct 25 21:19:08 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:19:08 user nova-compute[74189]:     <system>
Oct 25 21:19:08 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:19:08 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:19:08 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:19:08 user nova-compute[74189]:       <entry name="serial">4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f</entry>
Oct 25 21:19:08 user nova-compute[74189]:       <entry name="uuid">4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f</entry>
Oct 25 21:19:08 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:19:08 user nova-compute[74189]:     </system>
Oct 25 21:19:08 user nova-compute[74189]:   </sysinfo>
Oct 25 21:19:08 user nova-compute[74189]:   <os>
Oct 25 21:19:08 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:19:08 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:19:08 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:19:08 user nova-compute[74189]:   </os>
Oct 25 21:19:08 user nova-compute[74189]:   <features>
Oct 25 21:19:08 user nova-compute[74189]:     <acpi/>
Oct 25 21:19:08 user nova-compute[74189]:     <apic/>
Oct 25 21:19:08 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:19:08 user nova-compute[74189]:   </features>
Oct 25 21:19:08 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:19:08 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:19:08 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:19:08 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:19:08 user nova-compute[74189]:   </clock>
Oct 25 21:19:08 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:19:08 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:19:08 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:19:08 user nova-compute[74189]:   </cpu>
Oct 25 21:19:08 user nova-compute[74189]:   <devices>
Oct 25 21:19:08 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:19:08 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:19:08 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f/disk"/>
Oct 25 21:19:08 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:19:08 user nova-compute[74189]:     </disk>
Oct 25 21:19:08 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:19:08 user nova-compute[74189]:       <mac address="fa:16:3e:19:6d:f5"/>
Oct 25 21:19:08 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:19:08 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:19:08 user nova-compute[74189]:       <target dev="tap8df72a30-cf"/>
Oct 25 21:19:08 user nova-compute[74189]:     </interface>
Oct 25 21:19:08 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:19:08 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f/console.log" append="off"/>
Oct 25 21:19:08 user nova-compute[74189]:     </serial>
Oct 25 21:19:08 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:19:08 user nova-compute[74189]:     <video>
Oct 25 21:19:08 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:19:08 user nova-compute[74189]:     </video>
Oct 25 21:19:08 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:19:08 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:19:08 user nova-compute[74189]:     </rng>
Oct 25 21:19:08 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:19:08 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:19:08 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:19:08 user nova-compute[74189]:     </memballoon>
Oct 25 21:19:08 user nova-compute[74189]:   </devices>
Oct 25 21:19:08 user nova-compute[74189]: </domain>
Oct 25 21:19:08 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:19:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-338936039',display_name='tempest-VolumesAdminNegativeTest-server-338936039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-338936039',id=13,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09c2027cbebd4ffd9989ba14156beeba',ramdisk_id='',reservation_id='r-ftlf6yfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-892271548',owner_user_name='tempest-VolumesAdminNegativeTest-892271548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:19:06Z,user_data=None,user_id='522bbceca0c6444cb16bb575f4186c5c',uuid=4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8df72a30-cfbf-4025-a343-f47fe0978c35", "address": "fa:16:3e:19:6d:f5", "network": {"id": "093e46a2-3a83-46b5-a13b-661868863db1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1577201171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09c2027cbebd4ffd9989ba14156beeba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df72a30-cf", "ovs_interfaceid": "8df72a30-cfbf-4025-a343-f47fe0978c35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Converting VIF {"id": "8df72a30-cfbf-4025-a343-f47fe0978c35", "address": "fa:16:3e:19:6d:f5", "network": {"id": "093e46a2-3a83-46b5-a13b-661868863db1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1577201171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09c2027cbebd4ffd9989ba14156beeba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df72a30-cf", "ovs_interfaceid": "8df72a30-cfbf-4025-a343-f47fe0978c35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:6d:f5,bridge_name='br-int',has_traffic_filtering=True,id=8df72a30-cfbf-4025-a343-f47fe0978c35,network=Network(093e46a2-3a83-46b5-a13b-661868863db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8df72a30-cf') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG os_vif [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:6d:f5,bridge_name='br-int',has_traffic_filtering=True,id=8df72a30-cfbf-4025-a343-f47fe0978c35,network=Network(093e46a2-3a83-46b5-a13b-661868863db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8df72a30-cf') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7358ee15-5427-5e9b-ae00-c3ac9ba5bcfa', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] COPY block job progress, current cursor: 562036736 final cursor: 1073741824 {{(pid=74189) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8df72a30-cf, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8df72a30-cf, col_values=(('qos', UUID('d9be0601-e19a-41a8-8abe-9a322d148e92')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8df72a30-cf, col_values=(('external_ids', {'iface-id': '8df72a30-cfbf-4025-a343-f47fe0978c35', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:6d:f5', 'vm-uuid': '4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:08 user nova-compute[74189]: INFO os_vif [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:6d:f5,bridge_name='br-int',has_traffic_filtering=True,id=8df72a30-cfbf-4025-a343-f47fe0978c35,network=Network(093e46a2-3a83-46b5-a13b-661868863db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8df72a30-cf')
Oct 25 21:19:08 user nova-compute[74189]: DEBUG nova.network.neutron [req-1fdfa28e-27a8-4fe7-82b0-fd4970b40b52 req-d26fdac9-3cea-42da-b61d-ae8016a37dbb service nova] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Updated VIF entry in instance network info cache for port 8df72a30-cfbf-4025-a343-f47fe0978c35. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG nova.network.neutron [req-1fdfa28e-27a8-4fe7-82b0-fd4970b40b52 req-d26fdac9-3cea-42da-b61d-ae8016a37dbb service nova] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Updating instance_info_cache with network_info: [{"id": "8df72a30-cfbf-4025-a343-f47fe0978c35", "address": "fa:16:3e:19:6d:f5", "network": {"id": "093e46a2-3a83-46b5-a13b-661868863db1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1577201171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09c2027cbebd4ffd9989ba14156beeba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df72a30-cf", "ovs_interfaceid": "8df72a30-cfbf-4025-a343-f47fe0978c35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1fdfa28e-27a8-4fe7-82b0-fd4970b40b52 req-d26fdac9-3cea-42da-b61d-ae8016a37dbb service nova] Releasing lock "refresh_cache-4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:19:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] No VIF found with MAC fa:16:3e:19:6d:f5, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:19:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] COPY block job progress, current cursor: 664797184 final cursor: 1073741824 {{(pid=74189) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 21:19:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] COPY block job progress, current cursor: 771751936 final cursor: 1073741824 {{(pid=74189) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 21:19:10 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] COPY block job progress, current cursor: 902823936 final cursor: 1073741824 {{(pid=74189) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 21:19:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:10 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] COPY block job progress, current cursor: 1032847360 final cursor: 1073741824 {{(pid=74189) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 21:19:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:10 user nova-compute[74189]: DEBUG nova.compute.manager [req-92a742c7-1258-4d0b-94c1-1645cbdee3f0 req-9dc92e9d-052c-4511-bf14-1bd7f8ac1d0d service nova] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Received event network-vif-plugged-8df72a30-cfbf-4025-a343-f47fe0978c35 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-92a742c7-1258-4d0b-94c1-1645cbdee3f0 req-9dc92e9d-052c-4511-bf14-1bd7f8ac1d0d service nova] Acquiring lock "4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-92a742c7-1258-4d0b-94c1-1645cbdee3f0 req-9dc92e9d-052c-4511-bf14-1bd7f8ac1d0d service nova] Lock "4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-92a742c7-1258-4d0b-94c1-1645cbdee3f0 req-9dc92e9d-052c-4511-bf14-1bd7f8ac1d0d service nova] Lock "4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:10 user nova-compute[74189]: DEBUG nova.compute.manager [req-92a742c7-1258-4d0b-94c1-1645cbdee3f0 req-9dc92e9d-052c-4511-bf14-1bd7f8ac1d0d service nova] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] No waiting events found dispatching network-vif-plugged-8df72a30-cfbf-4025-a343-f47fe0978c35 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:19:10 user nova-compute[74189]: WARNING nova.compute.manager [req-92a742c7-1258-4d0b-94c1-1645cbdee3f0 req-9dc92e9d-052c-4511-bf14-1bd7f8ac1d0d service nova] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Received unexpected event network-vif-plugged-8df72a30-cfbf-4025-a343-f47fe0978c35 for instance with vm_state building and task_state spawning.
Oct 25 21:19:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:10 user nova-compute[74189]: DEBUG nova.compute.manager [req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c req-3da11cdc-9c42-4f26-abd3-b3cb36a351d1 service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Received event volume-reimaged-e6efe932-902f-41f8-82f4-1773bc305e0e {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c req-3da11cdc-9c42-4f26-abd3-b3cb36a351d1 service nova] Acquiring lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c req-3da11cdc-9c42-4f26-abd3-b3cb36a351d1 service nova] Lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c req-3da11cdc-9c42-4f26-abd3-b3cb36a351d1 service nova] Lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:10 user nova-compute[74189]: DEBUG nova.compute.manager [req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c req-3da11cdc-9c42-4f26-abd3-b3cb36a351d1 service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Processing event volume-reimaged-e6efe932-902f-41f8-82f4-1773bc305e0e {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Oct 25 21:19:10 user nova-compute[74189]: DEBUG nova.compute.manager [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Instance event wait completed in 31 seconds for volume-reimaged {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:19:11 user nova-compute[74189]: INFO nova.virt.block_device [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Booting with volume e6efe932-902f-41f8-82f4-1773bc305e0e at /dev/vda
Oct 25 21:19:11 user nova-compute[74189]: DEBUG os_brick.utils [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5805099e-61c9-4424-b73f-e9505d2ef7b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[75398d75-2c68-4b50-9a43-c248aec060d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74189) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8ad54c-671e-4711-af16-517c4b3158f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6929925-3358-407c-bb01-26314f1d99a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:19:11 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da12dde-19d3-494c-907d-5200e0049219]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG os_brick.utils [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Updating existing volume attachment record: 642c3945-bd05-42d5-8476-18f3002d7e67 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aWFZMYPT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '5f947800-cc9c-4224-86f6-d1e72d1c2d9e'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:19:11 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:19:11 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa286b5a-02a9-4c28-b1c1-707a76734e62]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:19:11 user nova-compute[74189]: No targets found.
Oct 25 21:19:11 user nova-compute[74189]: iSNS:
Oct 25 21:19:11 user nova-compute[74189]: No targets found.
Oct 25 21:19:11 user nova-compute[74189]: STATIC:
Oct 25 21:19:11 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963
Oct 25 21:19:11 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:19:11 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:19:11 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e
Oct 25 21:19:11 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:19:11 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:19:11 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:19:11 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:19:11 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:19:11 user nova-compute[74189]: FIRMWARE:
Oct 25 21:19:11 user nova-compute[74189]: No targets found.
Oct 25 21:19:11 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:19:11 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:19:11 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ceba24e-ec67-4b95-9388-ba161c674868]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4d0625-fc32-4524-b542-9a2027da34ca]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:19:11 user nova-compute[74189]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:19:11 user nova-compute[74189]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e (non-flash)
Oct 25 21:19:11 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:19:11 user nova-compute[74189]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:19:11 user nova-compute[74189]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e (non-flash)
Oct 25 21:19:11 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2e4464430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e'): ({'sdc'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Removing single pathed devices sdc {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38040d4-e091-4771-bc5f-244038d9e8fd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcca57e1-bfc6-40dd-94a8-42d186820cd4]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Flushing IO for device /dev/sdc {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b5b454-64dc-44d7-8fb4-bdb45245158d]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1212b19-7a79-4c99-bb81-14a1acc7bbb2]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] SCSI volumes sdc have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4291569c-7d0c-4584-a6b1-5115ac304158]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6766d3de-6145-412a-aff2-4b4fe96a5b74]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e, portal: 172.16.0.220,3260]
Oct 25 21:19:11 user nova-compute[74189]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e, portal: 172.16.0.220,3260] successful.
Oct 25 21:19:11 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f947800-cc9c-4224-86f6-d1e72d1c2d9e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a193473-afef-49c0-abbe-2b0295ba788c]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] <== disconnect_volume: return (333ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:19:11 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:19:12 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:12 user nova-compute[74189]: DEBUG nova.compute.manager [req-69542559-ef64-4522-80ce-69124d00b49b req-96e2a79e-9127-4db4-9850-096220d6515a service nova] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Received event network-vif-plugged-8df72a30-cfbf-4025-a343-f47fe0978c35 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-69542559-ef64-4522-80ce-69124d00b49b req-96e2a79e-9127-4db4-9850-096220d6515a service nova] Acquiring lock "4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-69542559-ef64-4522-80ce-69124d00b49b req-96e2a79e-9127-4db4-9850-096220d6515a service nova] Lock "4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-69542559-ef64-4522-80ce-69124d00b49b req-96e2a79e-9127-4db4-9850-096220d6515a service nova] Lock "4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:12 user nova-compute[74189]: DEBUG nova.compute.manager [req-69542559-ef64-4522-80ce-69124d00b49b req-96e2a79e-9127-4db4-9850-096220d6515a service nova] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] No waiting events found dispatching network-vif-plugged-8df72a30-cfbf-4025-a343-f47fe0978c35 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:19:12 user nova-compute[74189]: WARNING nova.compute.manager [req-69542559-ef64-4522-80ce-69124d00b49b req-96e2a79e-9127-4db4-9850-096220d6515a service nova] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Received unexpected event network-vif-plugged-8df72a30-cfbf-4025-a343-f47fe0978c35 for instance with vm_state building and task_state spawning.
Oct 25 21:19:12 user nova-compute[74189]: DEBUG nova.compute.manager [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:19:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:19:12 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Instance spawned successfully.
Oct 25 21:19:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:19:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:19:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:19:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:19:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:19:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:19:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:19:12 user nova-compute[74189]: INFO nova.compute.manager [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Took 7.19 seconds to spawn the instance on the hypervisor.
Oct 25 21:19:12 user nova-compute[74189]: DEBUG nova.compute.manager [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:19:13 user nova-compute[74189]: INFO nova.compute.manager [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Took 8.48 seconds to build instance.
Oct 25 21:19:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-56067d4e-9684-4979-b95a-d761a58560bc tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.614s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG nova.compute.manager [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ykUomIYH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'f52fc510-3640-468a-8a9c-b716b9d17a01', 'attached_at': '', 'detached_at': '', 'volume_id': 'e07f2603-8906-4cb9-975e-5ac25a051963', 'serial'} {{(pid=74189) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG nova.compute.manager [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] swap_volume: removing Cinder connection for volume 5f947800-cc9c-4224-86f6-d1e72d1c2d9e {{(pid=74189) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG nova.compute.manager [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:19:20 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Creating image(s)
Oct 25 21:19:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Did not create local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Ensure instance console log exists: /opt/stack/data/nova/instances/2486ac33-a881-4be1-a24e-2ff263e51818/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Start _get_guest_xml network_info=[{"id": "a334be31-0990-4647-b215-2553698e0050", "address": "fa:16:3e:86:f6:dc", "network": {"id": "6a880bb8-1359-4925-bb7c-f3383d6fd955", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1357582936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa334be31-09", "ovs_interfaceid": "a334be31-0990-4647-b215-2553698e0050", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a96d3bd5-5996-4171-87ef-082bfe44bb78", "address": "fa:16:3e:2e:ed:e9", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa96d3bd5-59", "ovs_interfaceid": "a96d3bd5-5996-4171-87ef-082bfe44bb78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f10bc396-91ea-4493-8521-69881612dd9f", "address": "fa:16:3e:95:bf:3c", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10bc396-91", "ovs_interfaceid": "f10bc396-91ea-4493-8521-69881612dd9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "81b93608-6fb4-4753-8328-df418f6d3ffe", "address": "fa:16:3e:46:4d:a5", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b93608-6f", "ovs_interfaceid": "81b93608-6fb4-4753-8328-df418f6d3ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fad83a5-d1c9-43d7-9dbd-16970bbb93b3", "address": "fa:16:3e:50:46:46", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fad83a5-d1", "ovs_interfaceid": "3fad83a5-d1c9-43d7-9dbd-16970bbb93b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "532714b6-a025-43e3-bf7b-87f8159ed408", "address": "fa:16:3e:f2:73:ca", "network": {"id": "6223be01-32f0-4db7-8b26-8ad195bbe7f3", "bridge": "br-int", "label": "tempest-device-tagging-net2-127651341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532714b6-a0", "ovs_interfaceid": "532714b6-a025-43e3-bf7b-87f8159ed408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a918de57-be1e-4ddd-b593-533130578da6", "address": "fa:16:3e:07:3c:e2", "network": {"id": "6223be01-32f0-4db7-8b26-8ad195bbe7f3", "bridge": "br-int", "label": "tempest-device-tagging-net2-127651341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa918de57-be", "ovs_interfaceid": "a918de57-be1e-4ddd-b593-533130578da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQtrdIRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2486ac33-a881-4be1-a24e-2ff263e51818', 'attached_at': '', 'detached_at': '', 'volume_id': '41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8', 'serial': '41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8'}, 'attachment_id': 'f4e88b25-b05b-48a9-a145-d66273a75aac', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDpKXYOd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2486ac33-a881-4be1-a24e-2ff263e51818', 'attached_at': '', 'detached_at': '', 'volume_id': 'd138f037-f397-45e5-a79a-c3acfa6f679c', 'serial': 'd138f037-f397-45e5-a79a-c3acfa6f679c'}, 'attachment_id': 'd8e58bdf-bcaa-4d0d-9f15-7bc6adee6a13', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': 1, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MoGyPOsh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2486ac33-a881-4be1-a24e-2ff263e51818', 'attached_at': '', 'detached_at': '', 'volume_id': '0a290ce3-7c8b-460b-919d-a5e149720eff', 'serial': '0a290ce3-7c8b-460b-919d-a5e149720eff'}, 'attachment_id': '5a66d003-5495-4071-b291-f7a7b5edf021', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'boot_index': 2, 'volume_type': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:19:20 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:19:20 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:19:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQtrdIRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:19:20 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:19:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:19:20 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:19:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:19:20 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:19:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e752f564-d5b2-442a-92b3-b0f924b79e3d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:19:20 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[76655b4e-3ae1-4192-83a9-f4973ddf0b25]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8] added
Oct 25 21:19:20 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf8922e-2bee-4b08-a141-818ecb03dadd]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a5b5d4-f921-45ad-ad20-65f26708620e]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eQtrdIRL {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eQtrdIRL" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[739b9712-7e88-4d6d-a318-7034bd8a33bf]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eQtrdIRL'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0710b7fd-5636-4199-8382-9f652debe476]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fe3561-46bf-423e-935b-8e5485c04da2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:19:20 user nova-compute[74189]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:19:20 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:19:20 user nova-compute[74189]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:19:20 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e0e2d8-bf35-47e5-9323-7373b3f6f00f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8, portal: 172.16.0.220,3260]
Oct 25 21:19:20 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8, portal: 172.16.0.220,3260] successful.
Oct 25 21:19:20 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:21 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82aef1f-bdf0-46f8-9cf3-b2168cf2f203]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:21 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f82ff8-ebc3-48e9-a17b-52e088e636fc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:19:21 user nova-compute[74189]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:19:21 user nova-compute[74189]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)
Oct 25 21:19:21 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:19:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:19:21 user nova-compute[74189]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:19:21 user nova-compute[74189]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)
Oct 25 21:19:21 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:19:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:19:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:19:21 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] HCTL ('34', '-', '-', 0) found on session 13 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:19:21 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:19:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:21 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f0361f-febf-4618-a1df-bf6de9ebddd6]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:21 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: None {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:19:21 user nova-compute[74189]: DEBUG nova.compute.manager [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] swap_volume: Updating volume 5f947800-cc9c-4224-86f6-d1e72d1c2d9e BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "ykUomIYH", "auth_password": "cR4TuWptivoraM", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "e07f2603-8906-4cb9-975e-5ac25a051963"}, "status": "reserved", "instance": "f52fc510-3640-468a-8a9c-b716b9d17a01", "attached_at": "", "detached_at": "", "volume_id": "e07f2603-8906-4cb9-975e-5ac25a051963", "serial": "e07f2603-8906-4cb9-975e-5ac25a051963"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'e07f2603-8906-4cb9-975e-5ac25a051963', 'no_device': None, 'attachment_id': '5a2c6300-28ad-4fe9-9ca6-f17de3e481c5'} {{(pid=74189) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 25 21:19:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3eb523de-4458-4c6b-82c1-e3b1d6568e76 tempest-TestVolumeSwap-1932394074 tempest-TestVolumeSwap-1932394074-project-admin] Lock "f52fc510-3640-468a-8a9c-b716b9d17a01" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 39.643s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQtrdIRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23365626264326263', 'path': '/dev/sdc'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365626264326263', 'path': '/dev/sdc'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDpKXYOd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:19:22 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:19:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:19:22 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:19:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:19:22 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b80cb0a-8cac-44ff-a22b-43c7663c0b4d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:19:22 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[254031ba-df37-4f35-872f-4a9fe665d4e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c] added
Oct 25 21:19:22 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ed564d-29a7-49ec-bdfe-4ff4860c6b81]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[823fb56b-fcae-4317-aada-b5e668f5bd2e]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gDpKXYOd {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gDpKXYOd" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea6bdfb-94b5-459f-bea4-9a1f3b9ceb9f]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gDpKXYOd'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[10076947-11bc-4a38-ab94-1fe123d49e73]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[406cdd04-ab43-47ac-8246-e1744b9a0d0c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:19:22 user nova-compute[74189]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:19:22 user nova-compute[74189]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)
Oct 25 21:19:22 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:19:22 user nova-compute[74189]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:19:22 user nova-compute[74189]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)
Oct 25 21:19:22 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf874b6-6652-4a23-a3ee-ee3c3c1c4540]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c, portal: 172.16.0.220,3260]
Oct 25 21:19:22 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c, portal: 172.16.0.220,3260] successful.
Oct 25 21:19:22 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Acquiring lock "f52fc510-3640-468a-8a9c-b716b9d17a01" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Lock "f52fc510-3640-468a-8a9c-b716b9d17a01" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ea71b2-ab97-4fc3-ac53-7b2a224fbbf4]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:22 user nova-compute[74189]: INFO nova.compute.manager [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Detaching volume e07f2603-8906-4cb9-975e-5ac25a051963
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[168c458d-4d9f-4b1f-8d73-3ccc89e0c148]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:19:22 user nova-compute[74189]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:19:22 user nova-compute[74189]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)
Oct 25 21:19:22 user nova-compute[74189]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)
Oct 25 21:19:22 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:19:22 user nova-compute[74189]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:19:22 user nova-compute[74189]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)
Oct 25 21:19:22 user nova-compute[74189]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)
Oct 25 21:19:22 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] HCTL ('35', '-', '-', 0) found on session 14 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38094f2-6425-4c81-a197-59908b75a300]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Searching for a device in session 14 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDpKXYOd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:19:22 user nova-compute[74189]: INFO nova.virt.block_device [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Attempting to driver detach volume e07f2603-8906-4cb9-975e-5ac25a051963 from mountpoint /dev/vdb
Oct 25 21:19:22 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Attempting to detach device vdb from instance f52fc510-3640-468a-8a9c-b716b9d17a01 from the persistent domain config. {{(pid=74189) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:19:22 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:19:22 user nova-compute[74189]:   <source dev="/dev/sde"/>
Oct 25 21:19:22 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:19:22 user nova-compute[74189]:   <serial>e07f2603-8906-4cb9-975e-5ac25a051963</serial>
Oct 25 21:19:22 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:19:22 user nova-compute[74189]: </disk>
Oct 25 21:19:22 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:19:22 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Successfully detached device vdb from instance f52fc510-3640-468a-8a9c-b716b9d17a01 from the persistent domain config.
Oct 25 21:19:22 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f52fc510-3640-468a-8a9c-b716b9d17a01 from the live domain config. {{(pid=74189) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 21:19:22 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:19:22 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:19:22 user nova-compute[74189]:   <source dev="/dev/sde"/>
Oct 25 21:19:22 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:19:22 user nova-compute[74189]:   <serial>e07f2603-8906-4cb9-975e-5ac25a051963</serial>
Oct 25 21:19:22 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:19:22 user nova-compute[74189]: </disk>
Oct 25 21:19:22 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f52fc510-3640-468a-8a9c-b716b9d17a01 {{(pid=74189) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Acquiring lock "28a5eb34-5e63-414b-81d9-12f2b41c699c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Lock "28a5eb34-5e63-414b-81d9-12f2b41c699c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG nova.compute.manager [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:19:23 user nova-compute[74189]: INFO nova.compute.claims [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Claim successful on node user
Oct 25 21:19:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23430393833646137', 'path': '/dev/sdd'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430393833646137', 'path': '/dev/sdd'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MoGyPOsh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:19:23 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:19:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:19:23 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:19:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:19:23 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5bfa7f-a201-4057-a30a-19392015fac7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:19:23 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc91bc71-6566-4294-b483-527c48ae12e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff] added
Oct 25 21:19:23 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bd113d-24aa-4986-8821-e12166f07592]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebc55ad-e816-4b27-83c5-4039ab1e6a80]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MoGyPOsh {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MoGyPOsh" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bc270a-a0a1-4cba-878f-474c78cd2a22]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MoGyPOsh'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77976ee-acce-43d2-85dc-c7918f6de71e]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cc3da7-5112-41bf-9444-88a9d61cf1d5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:19:23 user nova-compute[74189]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:19:23 user nova-compute[74189]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)
Oct 25 21:19:23 user nova-compute[74189]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)
Oct 25 21:19:23 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:19:23 user nova-compute[74189]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:19:23 user nova-compute[74189]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)
Oct 25 21:19:23 user nova-compute[74189]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)
Oct 25 21:19:23 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f9b22d-9f88-4ccb-8e27-b1ce841a25ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff, portal: 172.16.0.220,3260]
Oct 25 21:19:23 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff, portal: 172.16.0.220,3260] successful.
Oct 25 21:19:23 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.515s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG nova.compute.manager [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d32a170-937f-4d80-9551-4aee34ea7149]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b2a8fc-fe7e-415b-bf61-dbee29df328f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:19:23 user nova-compute[74189]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:19:23 user nova-compute[74189]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)
Oct 25 21:19:23 user nova-compute[74189]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)
Oct 25 21:19:23 user nova-compute[74189]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)
Oct 25 21:19:23 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:19:23 user nova-compute[74189]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:19:23 user nova-compute[74189]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)
Oct 25 21:19:23 user nova-compute[74189]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)
Oct 25 21:19:23 user nova-compute[74189]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)
Oct 25 21:19:23 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] HCTL ('37', '-', '-', 0) found on session 15 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9816fa7-53ae-46dc-93da-114c6b1c7b3a]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Searching for a device in session 15 and hctl ['37', '*', '*', 0] yield: None {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG nova.compute.manager [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:19:23 user nova-compute[74189]: DEBUG nova.network.neutron [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:19:23 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:19:23 user nova-compute[74189]: DEBUG nova.compute.manager [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.policy [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca9db6daf29c4e27b78a6439d1d9ec08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '927b9214b64840ee97bcbcadbe893e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.compute.manager [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:19:24 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Creating image(s)
Oct 25 21:19:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Acquiring lock "/opt/stack/data/nova/instances/28a5eb34-5e63-414b-81d9-12f2b41c699c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Lock "/opt/stack/data/nova/instances/28a5eb34-5e63-414b-81d9-12f2b41c699c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Lock "/opt/stack/data/nova/instances/28a5eb34-5e63-414b-81d9-12f2b41c699c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.179s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.180s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/28a5eb34-5e63-414b-81d9-12f2b41c699c/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.network.neutron [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Successfully created port: fc507e9a-e2b6-4604-bc65-0f62b3b6da6e {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/28a5eb34-5e63-414b-81d9-12f2b41c699c/disk 1073741824" returned: 0 in 0.054s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.229s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Checking if we can resize image /opt/stack/data/nova/instances/28a5eb34-5e63-414b-81d9-12f2b41c699c/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a5eb34-5e63-414b-81d9-12f2b41c699c/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Searching for a device in session 15 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MoGyPOsh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '26632356465626166', 'path': '/dev/sdf'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632356465626166', 'path': '/dev/sdf'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:19:24 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-03d97097-77b5-4d01-92d4-42ec3bfa0bb7 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Waiting for libvirt event about the detach of device tapf25ca758-60 with device alias net1 from instance ea8d22c5-3868-43d1-b101-c6cff480dea6 is timed out.
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-03d97097-77b5-4d01-92d4-42ec3bfa0bb7 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3c:4e:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tapf25ca758-60"/></interface> {{(pid=74189) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1375118738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1375118738',id=10,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPXivyD9PSCcBKcZvZh+k/yCFLPwJDEHuTOrNIVdvP9lTOpM/GpVs9+5TWjtEAGNXhI6qiMmJF2Y4WoaXuTzGmcToOKXmvFHYsEcrZJHlJVAiOlqP8yruVD1x6U2Zor9g==',key_name='tempest-keypair-1590854806',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e30ef76a7fd4aa39509e875017185d8',ramdisk_id='',reservation_id='r-0trr2ecy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-195465062',owner_user_name='tempest-TaggedBootDevicesTest-195465062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:17:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81350af1f40549588189c612bf5ec551',uuid=2486ac33-a881-4be1-a24e-2ff263e51818,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a334be31-0990-4647-b215-2553698e0050", "address": "fa:16:3e:86:f6:dc", "network": {"id": "6a880bb8-1359-4925-bb7c-f3383d6fd955", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1357582936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa334be31-09", "ovs_interfaceid": "a334be31-0990-4647-b215-2553698e0050", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converting VIF {"id": "a334be31-0990-4647-b215-2553698e0050", "address": "fa:16:3e:86:f6:dc", "network": {"id": "6a880bb8-1359-4925-bb7c-f3383d6fd955", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1357582936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa334be31-09", "ovs_interfaceid": "a334be31-0990-4647-b215-2553698e0050", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:f6:dc,bridge_name='br-int',has_traffic_filtering=True,id=a334be31-0990-4647-b215-2553698e0050,network=Network(6a880bb8-1359-4925-bb7c-f3383d6fd955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa334be31-09') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1375118738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1375118738',id=10,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPXivyD9PSCcBKcZvZh+k/yCFLPwJDEHuTOrNIVdvP9lTOpM/GpVs9+5TWjtEAGNXhI6qiMmJF2Y4WoaXuTzGmcToOKXmvFHYsEcrZJHlJVAiOlqP8yruVD1x6U2Zor9g==',key_name='tempest-keypair-1590854806',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e30ef76a7fd4aa39509e875017185d8',ramdisk_id='',reservation_id='r-0trr2ecy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-195465062',owner_user_name='tempest-TaggedBootDevicesTest-195465062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:17:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81350af1f40549588189c612bf5ec551',uuid=2486ac33-a881-4be1-a24e-2ff263e51818,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a96d3bd5-5996-4171-87ef-082bfe44bb78", "address": "fa:16:3e:2e:ed:e9", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa96d3bd5-59", "ovs_interfaceid": "a96d3bd5-5996-4171-87ef-082bfe44bb78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converting VIF {"id": "a96d3bd5-5996-4171-87ef-082bfe44bb78", "address": "fa:16:3e:2e:ed:e9", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa96d3bd5-59", "ovs_interfaceid": "a96d3bd5-5996-4171-87ef-082bfe44bb78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ed:e9,bridge_name='br-int',has_traffic_filtering=True,id=a96d3bd5-5996-4171-87ef-082bfe44bb78,network=Network(b51c9c50-8f73-46eb-8974-8391028d0300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa96d3bd5-59') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1375118738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1375118738',id=10,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPXivyD9PSCcBKcZvZh+k/yCFLPwJDEHuTOrNIVdvP9lTOpM/GpVs9+5TWjtEAGNXhI6qiMmJF2Y4WoaXuTzGmcToOKXmvFHYsEcrZJHlJVAiOlqP8yruVD1x6U2Zor9g==',key_name='tempest-keypair-1590854806',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e30ef76a7fd4aa39509e875017185d8',ramdisk_id='',reservation_id='r-0trr2ecy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-195465062',owner_user_name='tempest-TaggedBootDevicesTest-195465062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:17:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81350af1f40549588189c612bf5ec551',uuid=2486ac33-a881-4be1-a24e-2ff263e51818,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f10bc396-91ea-4493-8521-69881612dd9f", "address": "fa:16:3e:95:bf:3c", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10bc396-91", "ovs_interfaceid": "f10bc396-91ea-4493-8521-69881612dd9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converting VIF {"id": "f10bc396-91ea-4493-8521-69881612dd9f", "address": "fa:16:3e:95:bf:3c", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10bc396-91", "ovs_interfaceid": "f10bc396-91ea-4493-8521-69881612dd9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:bf:3c,bridge_name='br-int',has_traffic_filtering=True,id=f10bc396-91ea-4493-8521-69881612dd9f,network=Network(b51c9c50-8f73-46eb-8974-8391028d0300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf10bc396-91') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1375118738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1375118738',id=10,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPXivyD9PSCcBKcZvZh+k/yCFLPwJDEHuTOrNIVdvP9lTOpM/GpVs9+5TWjtEAGNXhI6qiMmJF2Y4WoaXuTzGmcToOKXmvFHYsEcrZJHlJVAiOlqP8yruVD1x6U2Zor9g==',key_name='tempest-keypair-1590854806',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e30ef76a7fd4aa39509e875017185d8',ramdisk_id='',reservation_id='r-0trr2ecy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-195465062',owner_user_name='tempest-TaggedBootDevicesTest-195465062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:17:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81350af1f40549588189c612bf5ec551',uuid=2486ac33-a881-4be1-a24e-2ff263e51818,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81b93608-6fb4-4753-8328-df418f6d3ffe", "address": "fa:16:3e:46:4d:a5", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b93608-6f", "ovs_interfaceid": "81b93608-6fb4-4753-8328-df418f6d3ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converting VIF {"id": "81b93608-6fb4-4753-8328-df418f6d3ffe", "address": "fa:16:3e:46:4d:a5", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b93608-6f", "ovs_interfaceid": "81b93608-6fb4-4753-8328-df418f6d3ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:4d:a5,bridge_name='br-int',has_traffic_filtering=True,id=81b93608-6fb4-4753-8328-df418f6d3ffe,network=Network(b51c9c50-8f73-46eb-8974-8391028d0300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b93608-6f') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1375118738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1375118738',id=10,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPXivyD9PSCcBKcZvZh+k/yCFLPwJDEHuTOrNIVdvP9lTOpM/GpVs9+5TWjtEAGNXhI6qiMmJF2Y4WoaXuTzGmcToOKXmvFHYsEcrZJHlJVAiOlqP8yruVD1x6U2Zor9g==',key_name='tempest-keypair-1590854806',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e30ef76a7fd4aa39509e875017185d8',ramdisk_id='',reservation_id='r-0trr2ecy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-195465062',owner_user_name='tempest-TaggedBootDevicesTest-195465062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:17:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81350af1f40549588189c612bf5ec551',uuid=2486ac33-a881-4be1-a24e-2ff263e51818,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fad83a5-d1c9-43d7-9dbd-16970bbb93b3", "address": "fa:16:3e:50:46:46", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fad83a5-d1", "ovs_interfaceid": "3fad83a5-d1c9-43d7-9dbd-16970bbb93b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converting VIF {"id": "3fad83a5-d1c9-43d7-9dbd-16970bbb93b3", "address": "fa:16:3e:50:46:46", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fad83a5-d1", "ovs_interfaceid": "3fad83a5-d1c9-43d7-9dbd-16970bbb93b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:46:46,bridge_name='br-int',has_traffic_filtering=True,id=3fad83a5-d1c9-43d7-9dbd-16970bbb93b3,network=Network(b51c9c50-8f73-46eb-8974-8391028d0300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fad83a5-d1') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1375118738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1375118738',id=10,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPXivyD9PSCcBKcZvZh+k/yCFLPwJDEHuTOrNIVdvP9lTOpM/GpVs9+5TWjtEAGNXhI6qiMmJF2Y4WoaXuTzGmcToOKXmvFHYsEcrZJHlJVAiOlqP8yruVD1x6U2Zor9g==',key_name='tempest-keypair-1590854806',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e30ef76a7fd4aa39509e875017185d8',ramdisk_id='',reservation_id='r-0trr2ecy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-195465062',owner_user_name='tempest-TaggedBootDevicesTest-195465062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:17:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81350af1f40549588189c612bf5ec551',uuid=2486ac33-a881-4be1-a24e-2ff263e51818,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "532714b6-a025-43e3-bf7b-87f8159ed408", "address": "fa:16:3e:f2:73:ca", "network": {"id": "6223be01-32f0-4db7-8b26-8ad195bbe7f3", "bridge": "br-int", "label": "tempest-device-tagging-net2-127651341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532714b6-a0", "ovs_interfaceid": "532714b6-a025-43e3-bf7b-87f8159ed408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converting VIF {"id": "532714b6-a025-43e3-bf7b-87f8159ed408", "address": "fa:16:3e:f2:73:ca", "network": {"id": "6223be01-32f0-4db7-8b26-8ad195bbe7f3", "bridge": "br-int", "label": "tempest-device-tagging-net2-127651341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532714b6-a0", "ovs_interfaceid": "532714b6-a025-43e3-bf7b-87f8159ed408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:73:ca,bridge_name='br-int',has_traffic_filtering=True,id=532714b6-a025-43e3-bf7b-87f8159ed408,network=Network(6223be01-32f0-4db7-8b26-8ad195bbe7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532714b6-a0') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1375118738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1375118738',id=10,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPXivyD9PSCcBKcZvZh+k/yCFLPwJDEHuTOrNIVdvP9lTOpM/GpVs9+5TWjtEAGNXhI6qiMmJF2Y4WoaXuTzGmcToOKXmvFHYsEcrZJHlJVAiOlqP8yruVD1x6U2Zor9g==',key_name='tempest-keypair-1590854806',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e30ef76a7fd4aa39509e875017185d8',ramdisk_id='',reservation_id='r-0trr2ecy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-195465062',owner_user_name='tempest-TaggedBootDevicesTest-195465062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:17:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81350af1f40549588189c612bf5ec551',uuid=2486ac33-a881-4be1-a24e-2ff263e51818,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a918de57-be1e-4ddd-b593-533130578da6", "address": "fa:16:3e:07:3c:e2", "network": {"id": "6223be01-32f0-4db7-8b26-8ad195bbe7f3", "bridge": "br-int", "label": "tempest-device-tagging-net2-127651341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa918de57-be", "ovs_interfaceid": "a918de57-be1e-4ddd-b593-533130578da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converting VIF {"id": "a918de57-be1e-4ddd-b593-533130578da6", "address": "fa:16:3e:07:3c:e2", "network": {"id": "6223be01-32f0-4db7-8b26-8ad195bbe7f3", "bridge": "br-int", "label": "tempest-device-tagging-net2-127651341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa918de57-be", "ovs_interfaceid": "a918de57-be1e-4ddd-b593-533130578da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:3c:e2,bridge_name='br-int',has_traffic_filtering=True,id=a918de57-be1e-4ddd-b593-533130578da6,network=Network(6223be01-32f0-4db7-8b26-8ad195bbe7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa918de57-be') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.objects.instance [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Lazy-loading 'pci_devices' on Instance uuid 2486ac33-a881-4be1-a24e-2ff263e51818 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a5eb34-5e63-414b-81d9-12f2b41c699c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Cannot resize image /opt/stack/data/nova/instances/28a5eb34-5e63-414b-81d9-12f2b41c699c/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Ensure instance console log exists: /opt/stack/data/nova/instances/28a5eb34-5e63-414b-81d9-12f2b41c699c/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-03d97097-77b5-4d01-92d4-42ec3bfa0bb7 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:3c:4e:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tapf25ca758-60"/></interface>not found in domain: <domain type='kvm' id='6'>
Oct 25 21:19:24 user nova-compute[74189]:   <name>instance-00000006</name>
Oct 25 21:19:24 user nova-compute[74189]:   <uuid>ea8d22c5-3868-43d1-b101-c6cff480dea6</uuid>
Oct 25 21:19:24 user nova-compute[74189]:   <metadata>
Oct 25 21:19:24 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:19:24 user nova-compute[74189]:   <nova:package version="0.0.0"/>
Oct 25 21:19:24 user nova-compute[74189]:   <nova:name>tempest-device-tagging-server-781387297</nova:name>
Oct 25 21:19:24 user nova-compute[74189]:   <nova:creationTime>2023-10-25 21:17:31</nova:creationTime>
Oct 25 21:19:24 user nova-compute[74189]:   <nova:flavor name="m1.tiny">
Oct 25 21:19:24 user nova-compute[74189]:     <nova:memory>512</nova:memory>
Oct 25 21:19:24 user nova-compute[74189]:     <nova:disk>1</nova:disk>
Oct 25 21:19:24 user nova-compute[74189]:     <nova:swap>0</nova:swap>
Oct 25 21:19:24 user nova-compute[74189]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:19:24 user nova-compute[74189]:     <nova:vcpus>1</nova:vcpus>
Oct 25 21:19:24 user nova-compute[74189]:   </nova:flavor>
Oct 25 21:19:24 user nova-compute[74189]:   <nova:owner>
Oct 25 21:19:24 user nova-compute[74189]:     <nova:user uuid="a147e32cb7fd45aaa1398a1332e6956a">tempest-TaggedAttachmentsTest-1187636517-project-member</nova:user>
Oct 25 21:19:24 user nova-compute[74189]:     <nova:project uuid="7d6d05f10a0647e9a014e78f2a7dab78">tempest-TaggedAttachmentsTest-1187636517</nova:project>
Oct 25 21:19:24 user nova-compute[74189]:   </nova:owner>
Oct 25 21:19:24 user nova-compute[74189]:   <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:19:24 user nova-compute[74189]:   <nova:ports>
Oct 25 21:19:24 user nova-compute[74189]:     <nova:port uuid="a151161f-1633-405f-ac74-9f379531d89a">
Oct 25 21:19:24 user nova-compute[74189]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 25 21:19:24 user nova-compute[74189]:     </nova:port>
Oct 25 21:19:24 user nova-compute[74189]:     <nova:port uuid="f25ca758-602f-481b-8de2-4a8040b991cd">
Oct 25 21:19:24 user nova-compute[74189]:       <nova:ip type="fixed" address="10.10.10.55" ipVersion="4"/>
Oct 25 21:19:24 user nova-compute[74189]:     </nova:port>
Oct 25 21:19:24 user nova-compute[74189]:   </nova:ports>
Oct 25 21:19:24 user nova-compute[74189]: </nova:instance>
Oct 25 21:19:24 user nova-compute[74189]:   </metadata>
Oct 25 21:19:24 user nova-compute[74189]:   <memory unit='KiB'>524288</memory>
Oct 25 21:19:24 user nova-compute[74189]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 25 21:19:24 user nova-compute[74189]:   <vcpu placement='static'>1</vcpu>
Oct 25 21:19:24 user nova-compute[74189]:   <resource>
Oct 25 21:19:24 user nova-compute[74189]:     <partition>/machine</partition>
Oct 25 21:19:24 user nova-compute[74189]:   </resource>
Oct 25 21:19:24 user nova-compute[74189]:   <sysinfo type='smbios'>
Oct 25 21:19:24 user nova-compute[74189]:     <system>
Oct 25 21:19:24 user nova-compute[74189]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 25 21:19:24 user nova-compute[74189]:       <entry name='product'>OpenStack Nova</entry>
Oct 25 21:19:24 user nova-compute[74189]:       <entry name='version'>0.0.0</entry>
Oct 25 21:19:24 user nova-compute[74189]:       <entry name='serial'>ea8d22c5-3868-43d1-b101-c6cff480dea6</entry>
Oct 25 21:19:24 user nova-compute[74189]:       <entry name='uuid'>ea8d22c5-3868-43d1-b101-c6cff480dea6</entry>
Oct 25 21:19:24 user nova-compute[74189]:       <entry name='family'>Virtual Machine</entry>
Oct 25 21:19:24 user nova-compute[74189]:     </system>
Oct 25 21:19:24 user nova-compute[74189]:   </sysinfo>
Oct 25 21:19:24 user nova-compute[74189]:   <os>
Oct 25 21:19:24 user nova-compute[74189]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 25 21:19:24 user nova-compute[74189]:     <boot dev='hd'/>
Oct 25 21:19:24 user nova-compute[74189]:     <smbios mode='sysinfo'/>
Oct 25 21:19:24 user nova-compute[74189]:   </os>
Oct 25 21:19:24 user nova-compute[74189]:   <features>
Oct 25 21:19:24 user nova-compute[74189]:     <acpi/>
Oct 25 21:19:24 user nova-compute[74189]:     <apic/>
Oct 25 21:19:24 user nova-compute[74189]:     <vmcoreinfo state='on'/>
Oct 25 21:19:24 user nova-compute[74189]:   </features>
Oct 25 21:19:24 user nova-compute[74189]:   <cpu mode='custom' match='exact' check='full'>
Oct 25 21:19:24 user nova-compute[74189]:     <model fallback='forbid'>Nehalem</model>
Oct 25 21:19:24 user nova-compute[74189]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 25 21:19:24 user nova-compute[74189]:     <feature policy='require' name='vme'/>
Oct 25 21:19:24 user nova-compute[74189]:     <feature policy='require' name='x2apic'/>
Oct 25 21:19:24 user nova-compute[74189]:     <feature policy='require' name='hypervisor'/>
Oct 25 21:19:24 user nova-compute[74189]:   </cpu>
Oct 25 21:19:24 user nova-compute[74189]:   <clock offset='utc'>
Oct 25 21:19:24 user nova-compute[74189]:     <timer name='pit' tickpolicy='delay'/>
Oct 25 21:19:24 user nova-compute[74189]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 25 21:19:24 user nova-compute[74189]:     <timer name='hpet' present='no'/>
Oct 25 21:19:24 user nova-compute[74189]:   </clock>
Oct 25 21:19:24 user nova-compute[74189]:   <on_poweroff>destroy</on_poweroff>
Oct 25 21:19:24 user nova-compute[74189]:   <on_reboot>restart</on_reboot>
Oct 25 21:19:24 user nova-compute[74189]:   <on_crash>destroy</on_crash>
Oct 25 21:19:24 user nova-compute[74189]:   <devices>
Oct 25 21:19:24 user nova-compute[74189]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 25 21:19:24 user nova-compute[74189]:     <disk type='file' device='disk'>
Oct 25 21:19:24 user nova-compute[74189]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 25 21:19:24 user nova-compute[74189]:       <source file='/opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk' index='2'/>
Oct 25 21:19:24 user nova-compute[74189]:       <backingStore type='file' index='3'>
Oct 25 21:19:24 user nova-compute[74189]:         <format type='raw'/>
Oct 25 21:19:24 user nova-compute[74189]:         <source file='/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8'/>
Oct 25 21:19:24 user nova-compute[74189]:         <backingStore/>
Oct 25 21:19:24 user nova-compute[74189]:       </backingStore>
Oct 25 21:19:24 user nova-compute[74189]:       <target dev='vda' bus='virtio'/>
Oct 25 21:19:24 user nova-compute[74189]:       <alias name='virtio-disk0'/>
Oct 25 21:19:24 user nova-compute[74189]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 25 21:19:24 user nova-compute[74189]:     </disk>
Oct 25 21:19:24 user nova-compute[74189]:     <disk type='file' device='cdrom'>
Oct 25 21:19:24 user nova-compute[74189]:       <driver name='qemu' type='raw' cache='none'/>
Oct 25 21:19:24 user nova-compute[74189]:       <source file='/opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk.config' index='1'/>
Oct 25 21:19:24 user nova-compute[74189]:       <backingStore/>
Oct 25 21:19:24 user nova-compute[74189]:       <target dev='hda' bus='ide'/>
Oct 25 21:19:24 user nova-compute[74189]:       <readonly/>
Oct 25 21:19:24 user nova-compute[74189]:       <alias name='ide0-0-0'/>
Oct 25 21:19:24 user nova-compute[74189]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 25 21:19:24 user nova-compute[74189]:     </disk>
Oct 25 21:19:24 user nova-compute[74189]:     <controller type='usb' index='0' model='none'>
Oct 25 21:19:24 user nova-compute[74189]:       <alias name='usb'/>
Oct 25 21:19:24 user nova-compute[74189]:     </controller>
Oct 25 21:19:24 user nova-compute[74189]:     <controller type='pci' index='0' model='pci-root'>
Oct 25 21:19:24 user nova-compute[74189]:       <alias name='pci.0'/>
Oct 25 21:19:24 user nova-compute[74189]:     </controller>
Oct 25 21:19:24 user nova-compute[74189]:     <controller type='ide' index='0'>
Oct 25 21:19:24 user nova-compute[74189]:       <alias name='ide'/>
Oct 25 21:19:24 user nova-compute[74189]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 25 21:19:24 user nova-compute[74189]:     </controller>
Oct 25 21:19:24 user nova-compute[74189]:     <interface type='ethernet'>
Oct 25 21:19:24 user nova-compute[74189]:       <mac address='fa:16:3e:63:71:94'/>
Oct 25 21:19:24 user nova-compute[74189]:       <target dev='tapa151161f-16'/>
Oct 25 21:19:24 user nova-compute[74189]:       <model type='virtio'/>
Oct 25 21:19:24 user nova-compute[74189]:       <mtu size='1442'/>
Oct 25 21:19:24 user nova-compute[74189]:       <alias name='net0'/>
Oct 25 21:19:24 user nova-compute[74189]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 25 21:19:24 user nova-compute[74189]:     </interface>
Oct 25 21:19:24 user nova-compute[74189]:     <serial type='pty'>
Oct 25 21:19:24 user nova-compute[74189]:       <source path='/dev/pts/5'/>
Oct 25 21:19:24 user nova-compute[74189]:       <log file='/opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/console.log' append='off'/>
Oct 25 21:19:24 user nova-compute[74189]:       <target type='isa-serial' port='0'>
Oct 25 21:19:24 user nova-compute[74189]:         <model name='isa-serial'/>
Oct 25 21:19:24 user nova-compute[74189]:       </target>
Oct 25 21:19:24 user nova-compute[74189]:       <alias name='serial0'/>
Oct 25 21:19:24 user nova-compute[74189]:     </serial>
Oct 25 21:19:24 user nova-compute[74189]:     <console type='pty' tty='/dev/pts/5'>
Oct 25 21:19:24 user nova-compute[74189]:       <source path='/dev/pts/5'/>
Oct 25 21:19:24 user nova-compute[74189]:       <log file='/opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/console.log' append='off'/>
Oct 25 21:19:24 user nova-compute[74189]:       <target type='serial' port='0'/>
Oct 25 21:19:24 user nova-compute[74189]:       <alias name='serial0'/>
Oct 25 21:19:24 user nova-compute[74189]:     </console>
Oct 25 21:19:24 user nova-compute[74189]:     <input type='mouse' bus='ps2'>
Oct 25 21:19:24 user nova-compute[74189]:       <alias name='input0'/>
Oct 25 21:19:24 user nova-compute[74189]:     </input>
Oct 25 21:19:24 user nova-compute[74189]:     <input type='keyboard' bus='ps2'>
Oct 25 21:19:24 user nova-compute[74189]:       <alias name='input1'/>
Oct 25 21:19:24 user nova-compute[74189]:     </input>
Oct 25 21:19:24 user nova-compute[74189]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Oct 25 21:19:24 user nova-compute[74189]:       <listen type='address' address='0.0.0.0'/>
Oct 25 21:19:24 user nova-compute[74189]:     </graphics>
Oct 25 21:19:24 user nova-compute[74189]:     <audio id='1' type='none'/>
Oct 25 21:19:24 user nova-compute[74189]:     <video>
Oct 25 21:19:24 user nova-compute[74189]:       <model type='virtio' heads='1' primary='yes'/>
Oct 25 21:19:24 user nova-compute[74189]:       <alias name='video0'/>
Oct 25 21:19:24 user nova-compute[74189]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 25 21:19:24 user nova-compute[74189]:     </video>
Oct 25 21:19:24 user nova-compute[74189]:     <memballoon model='virtio'>
Oct 25 21:19:24 user nova-compute[74189]:       <stats period='10'/>
Oct 25 21:19:24 user nova-compute[74189]:       <alias name='balloon0'/>
Oct 25 21:19:24 user nova-compute[74189]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 25 21:19:24 user nova-compute[74189]:     </memballoon>
Oct 25 21:19:24 user nova-compute[74189]:     <rng model='virtio'>
Oct 25 21:19:24 user nova-compute[74189]:       <backend model='random'>/dev/urandom</backend>
Oct 25 21:19:24 user nova-compute[74189]:       <alias name='rng0'/>
Oct 25 21:19:24 user nova-compute[74189]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 25 21:19:24 user nova-compute[74189]:     </rng>
Oct 25 21:19:24 user nova-compute[74189]:   </devices>
Oct 25 21:19:24 user nova-compute[74189]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 25 21:19:24 user nova-compute[74189]:     <label>libvirt-ea8d22c5-3868-43d1-b101-c6cff480dea6</label>
Oct 25 21:19:24 user nova-compute[74189]:     <imagelabel>libvirt-ea8d22c5-3868-43d1-b101-c6cff480dea6</imagelabel>
Oct 25 21:19:24 user nova-compute[74189]:   </seclabel>
Oct 25 21:19:24 user nova-compute[74189]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 25 21:19:24 user nova-compute[74189]:     <label>+64055:+108</label>
Oct 25 21:19:24 user nova-compute[74189]:     <imagelabel>+64055:+108</imagelabel>
Oct 25 21:19:24 user nova-compute[74189]:   </seclabel>
Oct 25 21:19:24 user nova-compute[74189]: </domain>
Oct 25 21:19:24 user nova-compute[74189]:  {{(pid=74189) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 25 21:19:24 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-03d97097-77b5-4d01-92d4-42ec3bfa0bb7 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Successfully detached device tapf25ca758-60 from instance ea8d22c5-3868-43d1-b101-c6cff480dea6 from the live domain config.
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-03d97097-77b5-4d01-92d4-42ec3bfa0bb7 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-781387297',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-781387297',id=6,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHJgDbw7K7bwNJyj3WQeM4O7X1T/XxzeuPN+AM4eJ62yayGmYQQS1OGbI1fYrJusZqdcuogdpmdUBe6qoNmEvj36GKw2Ywp/JElU+pyp8QCNHY9uIrm3I9Zf5tuFbEg3Q==',key_name='tempest-keypair-159731972',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:15:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d6d05f10a0647e9a014e78f2a7dab78',ramdisk_id='',reservation_id='r-oi1337uc',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1187636517',owner_user_name='tempest-TaggedAttachmentsTest-1187636517-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:15:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a147e32cb7fd45aaa1398a1332e6956a',uuid=ea8d22c5-3868-43d1-b101-c6cff480dea6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f25ca758-602f-481b-8de2-4a8040b991cd", "address": "fa:16:3e:3c:4e:d6", "network": {"id": "2b3af293-fcd7-4868-89bd-0701f2814a8b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-227584648", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7d6d05f10a0647e9a014e78f2a7dab78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25ca758-60", "ovs_interfaceid": "f25ca758-602f-481b-8de2-4a8040b991cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-03d97097-77b5-4d01-92d4-42ec3bfa0bb7 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Converting VIF {"id": "f25ca758-602f-481b-8de2-4a8040b991cd", "address": "fa:16:3e:3c:4e:d6", "network": {"id": "2b3af293-fcd7-4868-89bd-0701f2814a8b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-227584648", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7d6d05f10a0647e9a014e78f2a7dab78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25ca758-60", "ovs_interfaceid": "f25ca758-602f-481b-8de2-4a8040b991cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-03d97097-77b5-4d01-92d4-42ec3bfa0bb7 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:4e:d6,bridge_name='br-int',has_traffic_filtering=True,id=f25ca758-602f-481b-8de2-4a8040b991cd,network=Network(2b3af293-fcd7-4868-89bd-0701f2814a8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf25ca758-60') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG os_vif [None req-03d97097-77b5-4d01-92d4-42ec3bfa0bb7 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:4e:d6,bridge_name='br-int',has_traffic_filtering=True,id=f25ca758-602f-481b-8de2-4a8040b991cd,network=Network(2b3af293-fcd7-4868-89bd-0701f2814a8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf25ca758-60') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:19:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:19:24 user nova-compute[74189]:   <uuid>2486ac33-a881-4be1-a24e-2ff263e51818</uuid>
Oct 25 21:19:24 user nova-compute[74189]:   <name>instance-0000000a</name>
Oct 25 21:19:24 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:19:24 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:19:24 user nova-compute[74189]:   <metadata>
Oct 25 21:19:24 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:19:24 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:19:24 user nova-compute[74189]:       <nova:name>tempest-device-tagging-server-1375118738</nova:name>
Oct 25 21:19:24 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:19:20</nova:creationTime>
Oct 25 21:19:24 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:19:24 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:19:24 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:19:24 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:19:24 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:19:24 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:19:24 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:19:24 user nova-compute[74189]:       <nova:owner>
Oct 25 21:19:24 user nova-compute[74189]:         <nova:user uuid="81350af1f40549588189c612bf5ec551">tempest-TaggedBootDevicesTest-195465062-project-member</nova:user>
Oct 25 21:19:24 user nova-compute[74189]:         <nova:project uuid="2e30ef76a7fd4aa39509e875017185d8">tempest-TaggedBootDevicesTest-195465062</nova:project>
Oct 25 21:19:24 user nova-compute[74189]:       </nova:owner>
Oct 25 21:19:24 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:19:24 user nova-compute[74189]:       <nova:ports>
Oct 25 21:19:24 user nova-compute[74189]:         <nova:port uuid="a334be31-0990-4647-b215-2553698e0050">
Oct 25 21:19:24 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 25 21:19:24 user nova-compute[74189]:         </nova:port>
Oct 25 21:19:24 user nova-compute[74189]:         <nova:port uuid="a96d3bd5-5996-4171-87ef-082bfe44bb78">
Oct 25 21:19:24 user nova-compute[74189]:           <nova:ip type="fixed" address="10.1.1.197" ipVersion="4"/>
Oct 25 21:19:24 user nova-compute[74189]:         </nova:port>
Oct 25 21:19:24 user nova-compute[74189]:         <nova:port uuid="f10bc396-91ea-4493-8521-69881612dd9f">
Oct 25 21:19:24 user nova-compute[74189]:           <nova:ip type="fixed" address="10.1.1.177" ipVersion="4"/>
Oct 25 21:19:24 user nova-compute[74189]:         </nova:port>
Oct 25 21:19:24 user nova-compute[74189]:         <nova:port uuid="81b93608-6fb4-4753-8328-df418f6d3ffe">
Oct 25 21:19:24 user nova-compute[74189]:           <nova:ip type="fixed" address="10.1.1.168" ipVersion="4"/>
Oct 25 21:19:24 user nova-compute[74189]:         </nova:port>
Oct 25 21:19:24 user nova-compute[74189]:         <nova:port uuid="3fad83a5-d1c9-43d7-9dbd-16970bbb93b3">
Oct 25 21:19:24 user nova-compute[74189]:           <nova:ip type="fixed" address="10.1.1.60" ipVersion="4"/>
Oct 25 21:19:24 user nova-compute[74189]:         </nova:port>
Oct 25 21:19:24 user nova-compute[74189]:         <nova:port uuid="532714b6-a025-43e3-bf7b-87f8159ed408">
Oct 25 21:19:24 user nova-compute[74189]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 25 21:19:24 user nova-compute[74189]:         </nova:port>
Oct 25 21:19:24 user nova-compute[74189]:         <nova:port uuid="a918de57-be1e-4ddd-b593-533130578da6">
Oct 25 21:19:24 user nova-compute[74189]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 25 21:19:24 user nova-compute[74189]:         </nova:port>
Oct 25 21:19:24 user nova-compute[74189]:       </nova:ports>
Oct 25 21:19:24 user nova-compute[74189]:     </nova:instance>
Oct 25 21:19:24 user nova-compute[74189]:   </metadata>
Oct 25 21:19:24 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:19:24 user nova-compute[74189]:     <system>
Oct 25 21:19:24 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:19:24 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:19:24 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:19:24 user nova-compute[74189]:       <entry name="serial">2486ac33-a881-4be1-a24e-2ff263e51818</entry>
Oct 25 21:19:24 user nova-compute[74189]:       <entry name="uuid">2486ac33-a881-4be1-a24e-2ff263e51818</entry>
Oct 25 21:19:24 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:19:24 user nova-compute[74189]:     </system>
Oct 25 21:19:24 user nova-compute[74189]:   </sysinfo>
Oct 25 21:19:24 user nova-compute[74189]:   <os>
Oct 25 21:19:24 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:19:24 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:19:24 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:19:24 user nova-compute[74189]:   </os>
Oct 25 21:19:24 user nova-compute[74189]:   <features>
Oct 25 21:19:24 user nova-compute[74189]:     <acpi/>
Oct 25 21:19:24 user nova-compute[74189]:     <apic/>
Oct 25 21:19:24 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:19:24 user nova-compute[74189]:   </features>
Oct 25 21:19:24 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:19:24 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:19:24 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:19:24 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:19:24 user nova-compute[74189]:   </clock>
Oct 25 21:19:24 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:19:24 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:19:24 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:19:24 user nova-compute[74189]:   </cpu>
Oct 25 21:19:24 user nova-compute[74189]:   <devices>
Oct 25 21:19:24 user nova-compute[74189]:     <disk type="file" device="cdrom">
Oct 25 21:19:24 user nova-compute[74189]:       <driver name="qemu" type="raw" cache="none"/>
Oct 25 21:19:24 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/2486ac33-a881-4be1-a24e-2ff263e51818/disk.config"/>
Oct 25 21:19:24 user nova-compute[74189]:       <target dev="hda" bus="ide"/>
Oct 25 21:19:24 user nova-compute[74189]:     </disk>
Oct 25 21:19:24 user nova-compute[74189]:     <disk type="block" device="disk">
Oct 25 21:19:24 user nova-compute[74189]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:19:24 user nova-compute[74189]:       <source dev="/dev/sdc"/>
Oct 25 21:19:24 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:19:24 user nova-compute[74189]:       <serial>41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8</serial>
Oct 25 21:19:24 user nova-compute[74189]:     </disk>
Oct 25 21:19:24 user nova-compute[74189]:     <disk type="block" device="disk">
Oct 25 21:19:24 user nova-compute[74189]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:19:24 user nova-compute[74189]:       <source dev="/dev/sdd"/>
Oct 25 21:19:24 user nova-compute[74189]:       <target dev="vdb" bus="virtio"/>
Oct 25 21:19:24 user nova-compute[74189]:       <serial>d138f037-f397-45e5-a79a-c3acfa6f679c</serial>
Oct 25 21:19:24 user nova-compute[74189]:     </disk>
Oct 25 21:19:24 user nova-compute[74189]:     <disk type="block" device="disk">
Oct 25 21:19:24 user nova-compute[74189]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:19:24 user nova-compute[74189]:       <source dev="/dev/sdf"/>
Oct 25 21:19:24 user nova-compute[74189]:       <target dev="vdc" bus="virtio"/>
Oct 25 21:19:24 user nova-compute[74189]:       <serial>0a290ce3-7c8b-460b-919d-a5e149720eff</serial>
Oct 25 21:19:24 user nova-compute[74189]:     </disk>
Oct 25 21:19:24 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:19:24 user nova-compute[74189]:       <mac address="fa:16:3e:86:f6:dc"/>
Oct 25 21:19:24 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:19:24 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:19:24 user nova-compute[74189]:       <target dev="tapa334be31-09"/>
Oct 25 21:19:24 user nova-compute[74189]:     </interface>
Oct 25 21:19:24 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:19:24 user nova-compute[74189]:       <mac address="fa:16:3e:2e:ed:e9"/>
Oct 25 21:19:24 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:19:24 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:19:24 user nova-compute[74189]:       <target dev="tapa96d3bd5-59"/>
Oct 25 21:19:24 user nova-compute[74189]:     </interface>
Oct 25 21:19:24 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:19:24 user nova-compute[74189]:       <mac address="fa:16:3e:95:bf:3c"/>
Oct 25 21:19:24 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:19:24 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:19:24 user nova-compute[74189]:       <target dev="tapf10bc396-91"/>
Oct 25 21:19:24 user nova-compute[74189]:     </interface>
Oct 25 21:19:24 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:19:24 user nova-compute[74189]:       <mac address="fa:16:3e:46:4d:a5"/>
Oct 25 21:19:24 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:19:24 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:19:24 user nova-compute[74189]:       <target dev="tap81b93608-6f"/>
Oct 25 21:19:24 user nova-compute[74189]:     </interface>
Oct 25 21:19:24 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:19:24 user nova-compute[74189]:       <mac address="fa:16:3e:50:46:46"/>
Oct 25 21:19:24 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:19:24 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:19:24 user nova-compute[74189]:       <target dev="tap3fad83a5-d1"/>
Oct 25 21:19:24 user nova-compute[74189]:     </interface>
Oct 25 21:19:24 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:19:24 user nova-compute[74189]:       <mac address="fa:16:3e:f2:73:ca"/>
Oct 25 21:19:24 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:19:24 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:19:24 user nova-compute[74189]:       <target dev="tap532714b6-a0"/>
Oct 25 21:19:24 user nova-compute[74189]:     </interface>
Oct 25 21:19:24 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:19:24 user nova-compute[74189]:       <mac address="fa:16:3e:07:3c:e2"/>
Oct 25 21:19:24 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:19:24 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:19:24 user nova-compute[74189]:       <target dev="tapa918de57-be"/>
Oct 25 21:19:24 user nova-compute[74189]:     </interface>
Oct 25 21:19:24 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:19:24 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/2486ac33-a881-4be1-a24e-2ff263e51818/console.log" append="off"/>
Oct 25 21:19:24 user nova-compute[74189]:     </serial>
Oct 25 21:19:24 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:19:24 user nova-compute[74189]:     <video>
Oct 25 21:19:24 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:19:24 user nova-compute[74189]:     </video>
Oct 25 21:19:24 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:19:24 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:19:24 user nova-compute[74189]:     </rng>
Oct 25 21:19:24 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:19:24 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:19:24 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:19:24 user nova-compute[74189]:     </memballoon>
Oct 25 21:19:24 user nova-compute[74189]:   </devices>
Oct 25 21:19:24 user nova-compute[74189]: </domain>
Oct 25 21:19:24 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1375118738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1375118738',id=10,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPXivyD9PSCcBKcZvZh+k/yCFLPwJDEHuTOrNIVdvP9lTOpM/GpVs9+5TWjtEAGNXhI6qiMmJF2Y4WoaXuTzGmcToOKXmvFHYsEcrZJHlJVAiOlqP8yruVD1x6U2Zor9g==',key_name='tempest-keypair-1590854806',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e30ef76a7fd4aa39509e875017185d8',ramdisk_id='',reservation_id='r-0trr2ecy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-195465062',owner_user_name='tempest-TaggedBootDevicesTest-195465062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:17:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81350af1f40549588189c612bf5ec551',uuid=2486ac33-a881-4be1-a24e-2ff263e51818,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a334be31-0990-4647-b215-2553698e0050", "address": "fa:16:3e:86:f6:dc", "network": {"id": "6a880bb8-1359-4925-bb7c-f3383d6fd955", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1357582936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa334be31-09", "ovs_interfaceid": "a334be31-0990-4647-b215-2553698e0050", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converting VIF {"id": "a334be31-0990-4647-b215-2553698e0050", "address": "fa:16:3e:86:f6:dc", "network": {"id": "6a880bb8-1359-4925-bb7c-f3383d6fd955", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1357582936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa334be31-09", "ovs_interfaceid": "a334be31-0990-4647-b215-2553698e0050", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:f6:dc,bridge_name='br-int',has_traffic_filtering=True,id=a334be31-0990-4647-b215-2553698e0050,network=Network(6a880bb8-1359-4925-bb7c-f3383d6fd955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa334be31-09') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG os_vif [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:f6:dc,bridge_name='br-int',has_traffic_filtering=True,id=a334be31-0990-4647-b215-2553698e0050,network=Network(6a880bb8-1359-4925-bb7c-f3383d6fd955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa334be31-09') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf25ca758-60, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9cec0b8-b0a5-4ba0-a362-fd779dba1173) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a3e02097-0bb3-5805-b2b4-85f8413f8943', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: INFO os_vif [None req-03d97097-77b5-4d01-92d4-42ec3bfa0bb7 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:4e:d6,bridge_name='br-int',has_traffic_filtering=True,id=f25ca758-602f-481b-8de2-4a8040b991cd,network=Network(2b3af293-fcd7-4868-89bd-0701f2814a8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf25ca758-60')
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-03d97097-77b5-4d01-92d4-42ec3bfa0bb7 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:19:25 user nova-compute[74189]:   <nova:package version="0.0.0"/>
Oct 25 21:19:25 user nova-compute[74189]:   <nova:name>tempest-device-tagging-server-781387297</nova:name>
Oct 25 21:19:25 user nova-compute[74189]:   <nova:creationTime>2023-10-25 21:19:24</nova:creationTime>
Oct 25 21:19:25 user nova-compute[74189]:   <nova:flavor name="m1.tiny">
Oct 25 21:19:25 user nova-compute[74189]:     <nova:memory>512</nova:memory>
Oct 25 21:19:25 user nova-compute[74189]:     <nova:disk>1</nova:disk>
Oct 25 21:19:25 user nova-compute[74189]:     <nova:swap>0</nova:swap>
Oct 25 21:19:25 user nova-compute[74189]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:19:25 user nova-compute[74189]:     <nova:vcpus>1</nova:vcpus>
Oct 25 21:19:25 user nova-compute[74189]:   </nova:flavor>
Oct 25 21:19:25 user nova-compute[74189]:   <nova:owner>
Oct 25 21:19:25 user nova-compute[74189]:     <nova:user uuid="a147e32cb7fd45aaa1398a1332e6956a">tempest-TaggedAttachmentsTest-1187636517-project-member</nova:user>
Oct 25 21:19:25 user nova-compute[74189]:     <nova:project uuid="7d6d05f10a0647e9a014e78f2a7dab78">tempest-TaggedAttachmentsTest-1187636517</nova:project>
Oct 25 21:19:25 user nova-compute[74189]:   </nova:owner>
Oct 25 21:19:25 user nova-compute[74189]:   <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:19:25 user nova-compute[74189]:   <nova:ports>
Oct 25 21:19:25 user nova-compute[74189]:     <nova:port uuid="a151161f-1633-405f-ac74-9f379531d89a">
Oct 25 21:19:25 user nova-compute[74189]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 25 21:19:25 user nova-compute[74189]:     </nova:port>
Oct 25 21:19:25 user nova-compute[74189]:   </nova:ports>
Oct 25 21:19:25 user nova-compute[74189]: </nova:instance>
Oct 25 21:19:25 user nova-compute[74189]:  {{(pid=74189) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa334be31-09, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa334be31-09, col_values=(('qos', UUID('8db046f6-ad7f-4c55-a787-ad9aa16d5732')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa334be31-09, col_values=(('external_ids', {'iface-id': 'a334be31-0990-4647-b215-2553698e0050', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:f6:dc', 'vm-uuid': '2486ac33-a881-4be1-a24e-2ff263e51818'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: INFO os_vif [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:f6:dc,bridge_name='br-int',has_traffic_filtering=True,id=a334be31-0990-4647-b215-2553698e0050,network=Network(6a880bb8-1359-4925-bb7c-f3383d6fd955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa334be31-09')
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1375118738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1375118738',id=10,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPXivyD9PSCcBKcZvZh+k/yCFLPwJDEHuTOrNIVdvP9lTOpM/GpVs9+5TWjtEAGNXhI6qiMmJF2Y4WoaXuTzGmcToOKXmvFHYsEcrZJHlJVAiOlqP8yruVD1x6U2Zor9g==',key_name='tempest-keypair-1590854806',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e30ef76a7fd4aa39509e875017185d8',ramdisk_id='',reservation_id='r-0trr2ecy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-195465062',owner_user_name='tempest-TaggedBootDevicesTest-195465062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:17:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81350af1f40549588189c612bf5ec551',uuid=2486ac33-a881-4be1-a24e-2ff263e51818,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a96d3bd5-5996-4171-87ef-082bfe44bb78", "address": "fa:16:3e:2e:ed:e9", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa96d3bd5-59", "ovs_interfaceid": "a96d3bd5-5996-4171-87ef-082bfe44bb78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converting VIF {"id": "a96d3bd5-5996-4171-87ef-082bfe44bb78", "address": "fa:16:3e:2e:ed:e9", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa96d3bd5-59", "ovs_interfaceid": "a96d3bd5-5996-4171-87ef-082bfe44bb78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ed:e9,bridge_name='br-int',has_traffic_filtering=True,id=a96d3bd5-5996-4171-87ef-082bfe44bb78,network=Network(b51c9c50-8f73-46eb-8974-8391028d0300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa96d3bd5-59') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG os_vif [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ed:e9,bridge_name='br-int',has_traffic_filtering=True,id=a96d3bd5-5996-4171-87ef-082bfe44bb78,network=Network(b51c9c50-8f73-46eb-8974-8391028d0300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa96d3bd5-59') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f40fa378-d473-5374-94a7-aa8ac1183702', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa96d3bd5-59, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa96d3bd5-59, col_values=(('qos', UUID('eada5708-7ced-4505-8cad-672bf92f0a60')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa96d3bd5-59, col_values=(('external_ids', {'iface-id': 'a96d3bd5-5996-4171-87ef-082bfe44bb78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:ed:e9', 'vm-uuid': '2486ac33-a881-4be1-a24e-2ff263e51818'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: INFO os_vif [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ed:e9,bridge_name='br-int',has_traffic_filtering=True,id=a96d3bd5-5996-4171-87ef-082bfe44bb78,network=Network(b51c9c50-8f73-46eb-8974-8391028d0300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa96d3bd5-59')
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1375118738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1375118738',id=10,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPXivyD9PSCcBKcZvZh+k/yCFLPwJDEHuTOrNIVdvP9lTOpM/GpVs9+5TWjtEAGNXhI6qiMmJF2Y4WoaXuTzGmcToOKXmvFHYsEcrZJHlJVAiOlqP8yruVD1x6U2Zor9g==',key_name='tempest-keypair-1590854806',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e30ef76a7fd4aa39509e875017185d8',ramdisk_id='',reservation_id='r-0trr2ecy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-195465062',owner_user_name='tempest-TaggedBootDevicesTest-195465062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:17:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81350af1f40549588189c612bf5ec551',uuid=2486ac33-a881-4be1-a24e-2ff263e51818,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f10bc396-91ea-4493-8521-69881612dd9f", "address": "fa:16:3e:95:bf:3c", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10bc396-91", "ovs_interfaceid": "f10bc396-91ea-4493-8521-69881612dd9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converting VIF {"id": "f10bc396-91ea-4493-8521-69881612dd9f", "address": "fa:16:3e:95:bf:3c", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10bc396-91", "ovs_interfaceid": "f10bc396-91ea-4493-8521-69881612dd9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:bf:3c,bridge_name='br-int',has_traffic_filtering=True,id=f10bc396-91ea-4493-8521-69881612dd9f,network=Network(b51c9c50-8f73-46eb-8974-8391028d0300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf10bc396-91') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG os_vif [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:bf:3c,bridge_name='br-int',has_traffic_filtering=True,id=f10bc396-91ea-4493-8521-69881612dd9f,network=Network(b51c9c50-8f73-46eb-8974-8391028d0300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf10bc396-91') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '13cf9471-b858-5899-b2a6-d582bc59bdc0', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf10bc396-91, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf10bc396-91, col_values=(('qos', UUID('909a3928-d844-4476-a7ef-e218ac7c0575')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf10bc396-91, col_values=(('external_ids', {'iface-id': 'f10bc396-91ea-4493-8521-69881612dd9f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:bf:3c', 'vm-uuid': '2486ac33-a881-4be1-a24e-2ff263e51818'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.network.neutron [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Successfully updated port: fc507e9a-e2b6-4604-bc65-0f62b3b6da6e {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: INFO os_vif [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:bf:3c,bridge_name='br-int',has_traffic_filtering=True,id=f10bc396-91ea-4493-8521-69881612dd9f,network=Network(b51c9c50-8f73-46eb-8974-8391028d0300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf10bc396-91')
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1375118738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1375118738',id=10,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPXivyD9PSCcBKcZvZh+k/yCFLPwJDEHuTOrNIVdvP9lTOpM/GpVs9+5TWjtEAGNXhI6qiMmJF2Y4WoaXuTzGmcToOKXmvFHYsEcrZJHlJVAiOlqP8yruVD1x6U2Zor9g==',key_name='tempest-keypair-1590854806',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e30ef76a7fd4aa39509e875017185d8',ramdisk_id='',reservation_id='r-0trr2ecy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-195465062',owner_user_name='tempest-TaggedBootDevicesTest-195465062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:17:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81350af1f40549588189c612bf5ec551',uuid=2486ac33-a881-4be1-a24e-2ff263e51818,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81b93608-6fb4-4753-8328-df418f6d3ffe", "address": "fa:16:3e:46:4d:a5", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b93608-6f", "ovs_interfaceid": "81b93608-6fb4-4753-8328-df418f6d3ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converting VIF {"id": "81b93608-6fb4-4753-8328-df418f6d3ffe", "address": "fa:16:3e:46:4d:a5", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b93608-6f", "ovs_interfaceid": "81b93608-6fb4-4753-8328-df418f6d3ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:4d:a5,bridge_name='br-int',has_traffic_filtering=True,id=81b93608-6fb4-4753-8328-df418f6d3ffe,network=Network(b51c9c50-8f73-46eb-8974-8391028d0300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b93608-6f') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG os_vif [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:4d:a5,bridge_name='br-int',has_traffic_filtering=True,id=81b93608-6fb4-4753-8328-df418f6d3ffe,network=Network(b51c9c50-8f73-46eb-8974-8391028d0300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b93608-6f') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a325e32-f8a6-5310-9065-5cf37e833a48', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Acquiring lock "refresh_cache-28a5eb34-5e63-414b-81d9-12f2b41c699c" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Acquired lock "refresh_cache-28a5eb34-5e63-414b-81d9-12f2b41c699c" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.network.neutron [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.compute.manager [req-6d7accd1-662c-4a9c-9102-581decc04211 req-3bb4f3f5-e9b1-406f-8ed0-f83b88d5d129 service nova] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Received event network-changed-fc507e9a-e2b6-4604-bc65-0f62b3b6da6e {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.compute.manager [req-6d7accd1-662c-4a9c-9102-581decc04211 req-3bb4f3f5-e9b1-406f-8ed0-f83b88d5d129 service nova] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Refreshing instance network info cache due to event network-changed-fc507e9a-e2b6-4604-bc65-0f62b3b6da6e. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-6d7accd1-662c-4a9c-9102-581decc04211 req-3bb4f3f5-e9b1-406f-8ed0-f83b88d5d129 service nova] Acquiring lock "refresh_cache-28a5eb34-5e63-414b-81d9-12f2b41c699c" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81b93608-6f, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap81b93608-6f, col_values=(('qos', UUID('2815f373-23f2-4231-8084-a562931060e2')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap81b93608-6f, col_values=(('external_ids', {'iface-id': '81b93608-6fb4-4753-8328-df418f6d3ffe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:4d:a5', 'vm-uuid': '2486ac33-a881-4be1-a24e-2ff263e51818'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.network.neutron [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: INFO os_vif [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:4d:a5,bridge_name='br-int',has_traffic_filtering=True,id=81b93608-6fb4-4753-8328-df418f6d3ffe,network=Network(b51c9c50-8f73-46eb-8974-8391028d0300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b93608-6f')
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1375118738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1375118738',id=10,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPXivyD9PSCcBKcZvZh+k/yCFLPwJDEHuTOrNIVdvP9lTOpM/GpVs9+5TWjtEAGNXhI6qiMmJF2Y4WoaXuTzGmcToOKXmvFHYsEcrZJHlJVAiOlqP8yruVD1x6U2Zor9g==',key_name='tempest-keypair-1590854806',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e30ef76a7fd4aa39509e875017185d8',ramdisk_id='',reservation_id='r-0trr2ecy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-195465062',owner_user_name='tempest-TaggedBootDevicesTest-195465062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:17:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81350af1f40549588189c612bf5ec551',uuid=2486ac33-a881-4be1-a24e-2ff263e51818,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fad83a5-d1c9-43d7-9dbd-16970bbb93b3", "address": "fa:16:3e:50:46:46", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fad83a5-d1", "ovs_interfaceid": "3fad83a5-d1c9-43d7-9dbd-16970bbb93b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converting VIF {"id": "3fad83a5-d1c9-43d7-9dbd-16970bbb93b3", "address": "fa:16:3e:50:46:46", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fad83a5-d1", "ovs_interfaceid": "3fad83a5-d1c9-43d7-9dbd-16970bbb93b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:46:46,bridge_name='br-int',has_traffic_filtering=True,id=3fad83a5-d1c9-43d7-9dbd-16970bbb93b3,network=Network(b51c9c50-8f73-46eb-8974-8391028d0300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fad83a5-d1') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG os_vif [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:46:46,bridge_name='br-int',has_traffic_filtering=True,id=3fad83a5-d1c9-43d7-9dbd-16970bbb93b3,network=Network(b51c9c50-8f73-46eb-8974-8391028d0300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fad83a5-d1') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd691cb1e-1a8a-5fa3-a68a-d6786ee3a3f9', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3fad83a5-d1, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3fad83a5-d1, col_values=(('qos', UUID('97e77755-e6ac-4463-8677-bc8fea51b06e')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3fad83a5-d1, col_values=(('external_ids', {'iface-id': '3fad83a5-d1c9-43d7-9dbd-16970bbb93b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:46:46', 'vm-uuid': '2486ac33-a881-4be1-a24e-2ff263e51818'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: INFO os_vif [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:46:46,bridge_name='br-int',has_traffic_filtering=True,id=3fad83a5-d1c9-43d7-9dbd-16970bbb93b3,network=Network(b51c9c50-8f73-46eb-8974-8391028d0300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fad83a5-d1')
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1375118738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1375118738',id=10,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPXivyD9PSCcBKcZvZh+k/yCFLPwJDEHuTOrNIVdvP9lTOpM/GpVs9+5TWjtEAGNXhI6qiMmJF2Y4WoaXuTzGmcToOKXmvFHYsEcrZJHlJVAiOlqP8yruVD1x6U2Zor9g==',key_name='tempest-keypair-1590854806',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e30ef76a7fd4aa39509e875017185d8',ramdisk_id='',reservation_id='r-0trr2ecy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-195465062',owner_user_name='tempest-TaggedBootDevicesTest-195465062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:17:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81350af1f40549588189c612bf5ec551',uuid=2486ac33-a881-4be1-a24e-2ff263e51818,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "532714b6-a025-43e3-bf7b-87f8159ed408", "address": "fa:16:3e:f2:73:ca", "network": {"id": "6223be01-32f0-4db7-8b26-8ad195bbe7f3", "bridge": "br-int", "label": "tempest-device-tagging-net2-127651341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532714b6-a0", "ovs_interfaceid": "532714b6-a025-43e3-bf7b-87f8159ed408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converting VIF {"id": "532714b6-a025-43e3-bf7b-87f8159ed408", "address": "fa:16:3e:f2:73:ca", "network": {"id": "6223be01-32f0-4db7-8b26-8ad195bbe7f3", "bridge": "br-int", "label": "tempest-device-tagging-net2-127651341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532714b6-a0", "ovs_interfaceid": "532714b6-a025-43e3-bf7b-87f8159ed408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:73:ca,bridge_name='br-int',has_traffic_filtering=True,id=532714b6-a025-43e3-bf7b-87f8159ed408,network=Network(6223be01-32f0-4db7-8b26-8ad195bbe7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532714b6-a0') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG os_vif [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:73:ca,bridge_name='br-int',has_traffic_filtering=True,id=532714b6-a025-43e3-bf7b-87f8159ed408,network=Network(6223be01-32f0-4db7-8b26-8ad195bbe7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532714b6-a0') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b351a7ad-1817-5e18-a803-838be0ae4f67', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap532714b6-a0, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap532714b6-a0, col_values=(('qos', UUID('f6697380-266e-4c4e-9217-e7fcb5e15b02')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap532714b6-a0, col_values=(('external_ids', {'iface-id': '532714b6-a025-43e3-bf7b-87f8159ed408', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:73:ca', 'vm-uuid': '2486ac33-a881-4be1-a24e-2ff263e51818'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.network.neutron [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Updating instance_info_cache with network_info: [{"id": "fc507e9a-e2b6-4604-bc65-0f62b3b6da6e", "address": "fa:16:3e:91:e6:5a", "network": {"id": "925c3fd0-b4db-47a8-95c3-dcff4b31c3b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2002620134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "927b9214b64840ee97bcbcadbe893e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc507e9a-e2", "ovs_interfaceid": "fc507e9a-e2b6-4604-bc65-0f62b3b6da6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: INFO os_vif [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:73:ca,bridge_name='br-int',has_traffic_filtering=True,id=532714b6-a025-43e3-bf7b-87f8159ed408,network=Network(6223be01-32f0-4db7-8b26-8ad195bbe7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532714b6-a0')
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1375118738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1375118738',id=10,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPXivyD9PSCcBKcZvZh+k/yCFLPwJDEHuTOrNIVdvP9lTOpM/GpVs9+5TWjtEAGNXhI6qiMmJF2Y4WoaXuTzGmcToOKXmvFHYsEcrZJHlJVAiOlqP8yruVD1x6U2Zor9g==',key_name='tempest-keypair-1590854806',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e30ef76a7fd4aa39509e875017185d8',ramdisk_id='',reservation_id='r-0trr2ecy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-195465062',owner_user_name='tempest-TaggedBootDevicesTest-195465062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:17:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81350af1f40549588189c612bf5ec551',uuid=2486ac33-a881-4be1-a24e-2ff263e51818,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a918de57-be1e-4ddd-b593-533130578da6", "address": "fa:16:3e:07:3c:e2", "network": {"id": "6223be01-32f0-4db7-8b26-8ad195bbe7f3", "bridge": "br-int", "label": "tempest-device-tagging-net2-127651341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa918de57-be", "ovs_interfaceid": "a918de57-be1e-4ddd-b593-533130578da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converting VIF {"id": "a918de57-be1e-4ddd-b593-533130578da6", "address": "fa:16:3e:07:3c:e2", "network": {"id": "6223be01-32f0-4db7-8b26-8ad195bbe7f3", "bridge": "br-int", "label": "tempest-device-tagging-net2-127651341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa918de57-be", "ovs_interfaceid": "a918de57-be1e-4ddd-b593-533130578da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:3c:e2,bridge_name='br-int',has_traffic_filtering=True,id=a918de57-be1e-4ddd-b593-533130578da6,network=Network(6223be01-32f0-4db7-8b26-8ad195bbe7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa918de57-be') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG os_vif [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:3c:e2,bridge_name='br-int',has_traffic_filtering=True,id=a918de57-be1e-4ddd-b593-533130578da6,network=Network(6223be01-32f0-4db7-8b26-8ad195bbe7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa918de57-be') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3517b348-43df-5cc0-af0d-e6daf5a72804', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Releasing lock "refresh_cache-28a5eb34-5e63-414b-81d9-12f2b41c699c" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.compute.manager [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Instance network_info: |[{"id": "fc507e9a-e2b6-4604-bc65-0f62b3b6da6e", "address": "fa:16:3e:91:e6:5a", "network": {"id": "925c3fd0-b4db-47a8-95c3-dcff4b31c3b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2002620134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "927b9214b64840ee97bcbcadbe893e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc507e9a-e2", "ovs_interfaceid": "fc507e9a-e2b6-4604-bc65-0f62b3b6da6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-6d7accd1-662c-4a9c-9102-581decc04211 req-3bb4f3f5-e9b1-406f-8ed0-f83b88d5d129 service nova] Acquired lock "refresh_cache-28a5eb34-5e63-414b-81d9-12f2b41c699c" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.network.neutron [req-6d7accd1-662c-4a9c-9102-581decc04211 req-3bb4f3f5-e9b1-406f-8ed0-f83b88d5d129 service nova] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Refreshing network info cache for port fc507e9a-e2b6-4604-bc65-0f62b3b6da6e {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Start _get_guest_xml network_info=[{"id": "fc507e9a-e2b6-4604-bc65-0f62b3b6da6e", "address": "fa:16:3e:91:e6:5a", "network": {"id": "925c3fd0-b4db-47a8-95c3-dcff4b31c3b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2002620134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "927b9214b64840ee97bcbcadbe893e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc507e9a-e2", "ovs_interfaceid": "fc507e9a-e2b6-4604-bc65-0f62b3b6da6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:19:25 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:19:25 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:19:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1279099933',display_name='tempest-VolumesActionsTest-instance-1279099933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1279099933',id=14,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='927b9214b64840ee97bcbcadbe893e04',ramdisk_id='',reservation_id='r-7pes3jq2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1374618448',owner_user_name='tempest-VolumesActionsTest-1374618448-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:19:24Z,user_data=None,user_id='ca9db6daf29c4e27b78a6439d1d9ec08',uuid=28a5eb34-5e63-414b-81d9-12f2b41c699c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc507e9a-e2b6-4604-bc65-0f62b3b6da6e", "address": "fa:16:3e:91:e6:5a", "network": {"id": "925c3fd0-b4db-47a8-95c3-dcff4b31c3b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2002620134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "927b9214b64840ee97bcbcadbe893e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc507e9a-e2", "ovs_interfaceid": "fc507e9a-e2b6-4604-bc65-0f62b3b6da6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Converting VIF {"id": "fc507e9a-e2b6-4604-bc65-0f62b3b6da6e", "address": "fa:16:3e:91:e6:5a", "network": {"id": "925c3fd0-b4db-47a8-95c3-dcff4b31c3b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2002620134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "927b9214b64840ee97bcbcadbe893e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc507e9a-e2", "ovs_interfaceid": "fc507e9a-e2b6-4604-bc65-0f62b3b6da6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:e6:5a,bridge_name='br-int',has_traffic_filtering=True,id=fc507e9a-e2b6-4604-bc65-0f62b3b6da6e,network=Network(925c3fd0-b4db-47a8-95c3-dcff4b31c3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc507e9a-e2') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.objects.instance [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Lazy-loading 'pci_devices' on Instance uuid 28a5eb34-5e63-414b-81d9-12f2b41c699c {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa918de57-be, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa918de57-be, col_values=(('qos', UUID('ffc65608-5533-4b99-a22a-36396a6e60b5')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa918de57-be, col_values=(('external_ids', {'iface-id': 'a918de57-be1e-4ddd-b593-533130578da6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:3c:e2', 'vm-uuid': '2486ac33-a881-4be1-a24e-2ff263e51818'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:19:25 user nova-compute[74189]:   <uuid>28a5eb34-5e63-414b-81d9-12f2b41c699c</uuid>
Oct 25 21:19:25 user nova-compute[74189]:   <name>instance-0000000e</name>
Oct 25 21:19:25 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:19:25 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:19:25 user nova-compute[74189]:   <metadata>
Oct 25 21:19:25 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:19:25 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:19:25 user nova-compute[74189]:       <nova:name>tempest-VolumesActionsTest-instance-1279099933</nova:name>
Oct 25 21:19:25 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:19:25</nova:creationTime>
Oct 25 21:19:25 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:19:25 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:19:25 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:19:25 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:19:25 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:19:25 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:19:25 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:19:25 user nova-compute[74189]:       <nova:owner>
Oct 25 21:19:25 user nova-compute[74189]:         <nova:user uuid="ca9db6daf29c4e27b78a6439d1d9ec08">tempest-VolumesActionsTest-1374618448-project-member</nova:user>
Oct 25 21:19:25 user nova-compute[74189]:         <nova:project uuid="927b9214b64840ee97bcbcadbe893e04">tempest-VolumesActionsTest-1374618448</nova:project>
Oct 25 21:19:25 user nova-compute[74189]:       </nova:owner>
Oct 25 21:19:25 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:19:25 user nova-compute[74189]:       <nova:ports>
Oct 25 21:19:25 user nova-compute[74189]:         <nova:port uuid="fc507e9a-e2b6-4604-bc65-0f62b3b6da6e">
Oct 25 21:19:25 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 25 21:19:25 user nova-compute[74189]:         </nova:port>
Oct 25 21:19:25 user nova-compute[74189]:       </nova:ports>
Oct 25 21:19:25 user nova-compute[74189]:     </nova:instance>
Oct 25 21:19:25 user nova-compute[74189]:   </metadata>
Oct 25 21:19:25 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:19:25 user nova-compute[74189]:     <system>
Oct 25 21:19:25 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:19:25 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:19:25 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:19:25 user nova-compute[74189]:       <entry name="serial">28a5eb34-5e63-414b-81d9-12f2b41c699c</entry>
Oct 25 21:19:25 user nova-compute[74189]:       <entry name="uuid">28a5eb34-5e63-414b-81d9-12f2b41c699c</entry>
Oct 25 21:19:25 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:19:25 user nova-compute[74189]:     </system>
Oct 25 21:19:25 user nova-compute[74189]:   </sysinfo>
Oct 25 21:19:25 user nova-compute[74189]:   <os>
Oct 25 21:19:25 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:19:25 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:19:25 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:19:25 user nova-compute[74189]:   </os>
Oct 25 21:19:25 user nova-compute[74189]:   <features>
Oct 25 21:19:25 user nova-compute[74189]:     <acpi/>
Oct 25 21:19:25 user nova-compute[74189]:     <apic/>
Oct 25 21:19:25 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:19:25 user nova-compute[74189]:   </features>
Oct 25 21:19:25 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:19:25 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:19:25 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:19:25 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:19:25 user nova-compute[74189]:   </clock>
Oct 25 21:19:25 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:19:25 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:19:25 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:19:25 user nova-compute[74189]:   </cpu>
Oct 25 21:19:25 user nova-compute[74189]:   <devices>
Oct 25 21:19:25 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:19:25 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:19:25 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/28a5eb34-5e63-414b-81d9-12f2b41c699c/disk"/>
Oct 25 21:19:25 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:19:25 user nova-compute[74189]:     </disk>
Oct 25 21:19:25 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:19:25 user nova-compute[74189]:       <mac address="fa:16:3e:91:e6:5a"/>
Oct 25 21:19:25 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:19:25 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:19:25 user nova-compute[74189]:       <target dev="tapfc507e9a-e2"/>
Oct 25 21:19:25 user nova-compute[74189]:     </interface>
Oct 25 21:19:25 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:19:25 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/28a5eb34-5e63-414b-81d9-12f2b41c699c/console.log" append="off"/>
Oct 25 21:19:25 user nova-compute[74189]:     </serial>
Oct 25 21:19:25 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:19:25 user nova-compute[74189]:     <video>
Oct 25 21:19:25 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:19:25 user nova-compute[74189]:     </video>
Oct 25 21:19:25 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:19:25 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:19:25 user nova-compute[74189]:     </rng>
Oct 25 21:19:25 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:19:25 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:19:25 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:19:25 user nova-compute[74189]:     </memballoon>
Oct 25 21:19:25 user nova-compute[74189]:   </devices>
Oct 25 21:19:25 user nova-compute[74189]: </domain>
Oct 25 21:19:25 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:19:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1279099933',display_name='tempest-VolumesActionsTest-instance-1279099933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1279099933',id=14,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='927b9214b64840ee97bcbcadbe893e04',ramdisk_id='',reservation_id='r-7pes3jq2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1374618448',owner_user_name='tempest-VolumesActionsTest-1374618448-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:19:24Z,user_data=None,user_id='ca9db6daf29c4e27b78a6439d1d9ec08',uuid=28a5eb34-5e63-414b-81d9-12f2b41c699c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc507e9a-e2b6-4604-bc65-0f62b3b6da6e", "address": "fa:16:3e:91:e6:5a", "network": {"id": "925c3fd0-b4db-47a8-95c3-dcff4b31c3b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2002620134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "927b9214b64840ee97bcbcadbe893e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc507e9a-e2", "ovs_interfaceid": "fc507e9a-e2b6-4604-bc65-0f62b3b6da6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Converting VIF {"id": "fc507e9a-e2b6-4604-bc65-0f62b3b6da6e", "address": "fa:16:3e:91:e6:5a", "network": {"id": "925c3fd0-b4db-47a8-95c3-dcff4b31c3b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2002620134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "927b9214b64840ee97bcbcadbe893e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc507e9a-e2", "ovs_interfaceid": "fc507e9a-e2b6-4604-bc65-0f62b3b6da6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:e6:5a,bridge_name='br-int',has_traffic_filtering=True,id=fc507e9a-e2b6-4604-bc65-0f62b3b6da6e,network=Network(925c3fd0-b4db-47a8-95c3-dcff4b31c3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc507e9a-e2') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG os_vif [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:e6:5a,bridge_name='br-int',has_traffic_filtering=True,id=fc507e9a-e2b6-4604-bc65-0f62b3b6da6e,network=Network(925c3fd0-b4db-47a8-95c3-dcff4b31c3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc507e9a-e2') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: INFO os_vif [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:3c:e2,bridge_name='br-int',has_traffic_filtering=True,id=a918de57-be1e-4ddd-b593-533130578da6,network=Network(6223be01-32f0-4db7-8b26-8ad195bbe7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa918de57-be')
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e27f0ae9-1576-5fdd-b492-0405ffa5f216', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.compute.manager [req-d8a84243-2f63-47fa-bada-b1b3f4fa2e4a req-727c5667-8c71-4605-82bc-e309b989003b service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Received event network-vif-deleted-f25ca758-602f-481b-8de2-4a8040b991cd {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:25 user nova-compute[74189]: INFO nova.compute.manager [req-d8a84243-2f63-47fa-bada-b1b3f4fa2e4a req-727c5667-8c71-4605-82bc-e309b989003b service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Neutron deleted interface f25ca758-602f-481b-8de2-4a8040b991cd; detaching it from the instance and deleting it from the info cache
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.network.neutron [req-d8a84243-2f63-47fa-bada-b1b3f4fa2e4a req-727c5667-8c71-4605-82bc-e309b989003b service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Updating instance_info_cache with network_info: [{"id": "a151161f-1633-405f-ac74-9f379531d89a", "address": "fa:16:3e:63:71:94", "network": {"id": "62a86fdc-b28d-442a-9d62-0c3286ad0abb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1182690237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6d05f10a0647e9a014e78f2a7dab78", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa151161f-16", "ovs_interfaceid": "a151161f-1633-405f-ac74-9f379531d89a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-03d97097-77b5-4d01-92d4-42ec3bfa0bb7 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Acquiring lock "refresh_cache-ea8d22c5-3868-43d1-b101-c6cff480dea6" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-03d97097-77b5-4d01-92d4-42ec3bfa0bb7 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Acquired lock "refresh_cache-ea8d22c5-3868-43d1-b101-c6cff480dea6" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.network.neutron [None req-03d97097-77b5-4d01-92d4-42ec3bfa0bb7 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc507e9a-e2, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfc507e9a-e2, col_values=(('qos', UUID('68cea62f-e9cc-40ca-87d8-8dfed4b0e1ba')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfc507e9a-e2, col_values=(('external_ids', {'iface-id': 'fc507e9a-e2b6-4604-bc65-0f62b3b6da6e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:e6:5a', 'vm-uuid': '28a5eb34-5e63-414b-81d9-12f2b41c699c'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.objects.instance [req-d8a84243-2f63-47fa-bada-b1b3f4fa2e4a req-727c5667-8c71-4605-82bc-e309b989003b service nova] Lazy-loading 'system_metadata' on Instance uuid ea8d22c5-3868-43d1-b101-c6cff480dea6 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] No BDM found with device name hda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] No VIF found with MAC fa:16:3e:86:f6:dc, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] No VIF found with MAC fa:16:3e:50:46:46, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:19:25 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Using config drive
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.objects.instance [req-d8a84243-2f63-47fa-bada-b1b3f4fa2e4a req-727c5667-8c71-4605-82bc-e309b989003b service nova] Lazy-loading 'flavor' on Instance uuid ea8d22c5-3868-43d1-b101-c6cff480dea6 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.objects.base [req-d8a84243-2f63-47fa-bada-b1b3f4fa2e4a req-727c5667-8c71-4605-82bc-e309b989003b service nova] Object Instance<ea8d22c5-3868-43d1-b101-c6cff480dea6> lazy-loaded attributes: system_metadata,flavor {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [req-d8a84243-2f63-47fa-bada-b1b3f4fa2e4a req-727c5667-8c71-4605-82bc-e309b989003b service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-781387297',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-781387297',id=6,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHJgDbw7K7bwNJyj3WQeM4O7X1T/XxzeuPN+AM4eJ62yayGmYQQS1OGbI1fYrJusZqdcuogdpmdUBe6qoNmEvj36GKw2Ywp/JElU+pyp8QCNHY9uIrm3I9Zf5tuFbEg3Q==',key_name='tempest-keypair-159731972',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:15:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d6d05f10a0647e9a014e78f2a7dab78',ramdisk_id='',reservation_id='r-oi1337uc',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1187636517',owner_user_name='tempest-TaggedAttachmentsTest-1187636517-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:15:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a147e32cb7fd45aaa1398a1332e6956a',uuid=ea8d22c5-3868-43d1-b101-c6cff480dea6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f25ca758-602f-481b-8de2-4a8040b991cd", "address": "fa:16:3e:3c:4e:d6", "network": {"id": "2b3af293-fcd7-4868-89bd-0701f2814a8b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-227584648", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7d6d05f10a0647e9a014e78f2a7dab78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25ca758-60", "ovs_interfaceid": "f25ca758-602f-481b-8de2-4a8040b991cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.network.os_vif_util [req-d8a84243-2f63-47fa-bada-b1b3f4fa2e4a req-727c5667-8c71-4605-82bc-e309b989003b service nova] Converting VIF {"id": "f25ca758-602f-481b-8de2-4a8040b991cd", "address": "fa:16:3e:3c:4e:d6", "network": {"id": "2b3af293-fcd7-4868-89bd-0701f2814a8b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-227584648", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7d6d05f10a0647e9a014e78f2a7dab78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25ca758-60", "ovs_interfaceid": "f25ca758-602f-481b-8de2-4a8040b991cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.network.os_vif_util [req-d8a84243-2f63-47fa-bada-b1b3f4fa2e4a req-727c5667-8c71-4605-82bc-e309b989003b service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:4e:d6,bridge_name='br-int',has_traffic_filtering=True,id=f25ca758-602f-481b-8de2-4a8040b991cd,network=Network(2b3af293-fcd7-4868-89bd-0701f2814a8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf25ca758-60') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [req-d8a84243-2f63-47fa-bada-b1b3f4fa2e4a req-727c5667-8c71-4605-82bc-e309b989003b service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3c:4e:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tapf25ca758-60"/></interface> {{(pid=74189) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [req-d8a84243-2f63-47fa-bada-b1b3f4fa2e4a req-727c5667-8c71-4605-82bc-e309b989003b service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:3c:4e:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tapf25ca758-60"/></interface>not found in domain: <domain type='kvm' id='6'>
Oct 25 21:19:25 user nova-compute[74189]:   <name>instance-00000006</name>
Oct 25 21:19:25 user nova-compute[74189]:   <uuid>ea8d22c5-3868-43d1-b101-c6cff480dea6</uuid>
Oct 25 21:19:25 user nova-compute[74189]:   <metadata>
Oct 25 21:19:25 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:19:25 user nova-compute[74189]:   <nova:package version="0.0.0"/>
Oct 25 21:19:25 user nova-compute[74189]:   <nova:name>tempest-device-tagging-server-781387297</nova:name>
Oct 25 21:19:25 user nova-compute[74189]:   <nova:creationTime>2023-10-25 21:19:24</nova:creationTime>
Oct 25 21:19:25 user nova-compute[74189]:   <nova:flavor name="m1.tiny">
Oct 25 21:19:25 user nova-compute[74189]:     <nova:memory>512</nova:memory>
Oct 25 21:19:25 user nova-compute[74189]:     <nova:disk>1</nova:disk>
Oct 25 21:19:25 user nova-compute[74189]:     <nova:swap>0</nova:swap>
Oct 25 21:19:25 user nova-compute[74189]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:19:25 user nova-compute[74189]:     <nova:vcpus>1</nova:vcpus>
Oct 25 21:19:25 user nova-compute[74189]:   </nova:flavor>
Oct 25 21:19:25 user nova-compute[74189]:   <nova:owner>
Oct 25 21:19:25 user nova-compute[74189]:     <nova:user uuid="a147e32cb7fd45aaa1398a1332e6956a">tempest-TaggedAttachmentsTest-1187636517-project-member</nova:user>
Oct 25 21:19:25 user nova-compute[74189]:     <nova:project uuid="7d6d05f10a0647e9a014e78f2a7dab78">tempest-TaggedAttachmentsTest-1187636517</nova:project>
Oct 25 21:19:25 user nova-compute[74189]:   </nova:owner>
Oct 25 21:19:25 user nova-compute[74189]:   <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:19:25 user nova-compute[74189]:   <nova:ports>
Oct 25 21:19:25 user nova-compute[74189]:     <nova:port uuid="a151161f-1633-405f-ac74-9f379531d89a">
Oct 25 21:19:25 user nova-compute[74189]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 25 21:19:25 user nova-compute[74189]:     </nova:port>
Oct 25 21:19:25 user nova-compute[74189]:   </nova:ports>
Oct 25 21:19:25 user nova-compute[74189]: </nova:instance>
Oct 25 21:19:25 user nova-compute[74189]:   </metadata>
Oct 25 21:19:25 user nova-compute[74189]:   <memory unit='KiB'>524288</memory>
Oct 25 21:19:25 user nova-compute[74189]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 25 21:19:25 user nova-compute[74189]:   <vcpu placement='static'>1</vcpu>
Oct 25 21:19:25 user nova-compute[74189]:   <resource>
Oct 25 21:19:25 user nova-compute[74189]:     <partition>/machine</partition>
Oct 25 21:19:25 user nova-compute[74189]:   </resource>
Oct 25 21:19:25 user nova-compute[74189]:   <sysinfo type='smbios'>
Oct 25 21:19:25 user nova-compute[74189]:     <system>
Oct 25 21:19:25 user nova-compute[74189]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 25 21:19:25 user nova-compute[74189]:       <entry name='product'>OpenStack Nova</entry>
Oct 25 21:19:25 user nova-compute[74189]:       <entry name='version'>0.0.0</entry>
Oct 25 21:19:25 user nova-compute[74189]:       <entry name='serial'>ea8d22c5-3868-43d1-b101-c6cff480dea6</entry>
Oct 25 21:19:25 user nova-compute[74189]:       <entry name='uuid'>ea8d22c5-3868-43d1-b101-c6cff480dea6</entry>
Oct 25 21:19:25 user nova-compute[74189]:       <entry name='family'>Virtual Machine</entry>
Oct 25 21:19:25 user nova-compute[74189]:     </system>
Oct 25 21:19:25 user nova-compute[74189]:   </sysinfo>
Oct 25 21:19:25 user nova-compute[74189]:   <os>
Oct 25 21:19:25 user nova-compute[74189]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 25 21:19:25 user nova-compute[74189]:     <boot dev='hd'/>
Oct 25 21:19:25 user nova-compute[74189]:     <smbios mode='sysinfo'/>
Oct 25 21:19:25 user nova-compute[74189]:   </os>
Oct 25 21:19:25 user nova-compute[74189]:   <features>
Oct 25 21:19:25 user nova-compute[74189]:     <acpi/>
Oct 25 21:19:25 user nova-compute[74189]:     <apic/>
Oct 25 21:19:25 user nova-compute[74189]:     <vmcoreinfo state='on'/>
Oct 25 21:19:25 user nova-compute[74189]:   </features>
Oct 25 21:19:25 user nova-compute[74189]:   <cpu mode='custom' match='exact' check='full'>
Oct 25 21:19:25 user nova-compute[74189]:     <model fallback='forbid'>Nehalem</model>
Oct 25 21:19:25 user nova-compute[74189]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 25 21:19:25 user nova-compute[74189]:     <feature policy='require' name='vme'/>
Oct 25 21:19:25 user nova-compute[74189]:     <feature policy='require' name='x2apic'/>
Oct 25 21:19:25 user nova-compute[74189]:     <feature policy='require' name='hypervisor'/>
Oct 25 21:19:25 user nova-compute[74189]:   </cpu>
Oct 25 21:19:25 user nova-compute[74189]:   <clock offset='utc'>
Oct 25 21:19:25 user nova-compute[74189]:     <timer name='pit' tickpolicy='delay'/>
Oct 25 21:19:25 user nova-compute[74189]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 25 21:19:25 user nova-compute[74189]:     <timer name='hpet' present='no'/>
Oct 25 21:19:25 user nova-compute[74189]:   </clock>
Oct 25 21:19:25 user nova-compute[74189]:   <on_poweroff>destroy</on_poweroff>
Oct 25 21:19:25 user nova-compute[74189]:   <on_reboot>restart</on_reboot>
Oct 25 21:19:25 user nova-compute[74189]:   <on_crash>destroy</on_crash>
Oct 25 21:19:25 user nova-compute[74189]:   <devices>
Oct 25 21:19:25 user nova-compute[74189]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 25 21:19:25 user nova-compute[74189]:     <disk type='file' device='disk'>
Oct 25 21:19:25 user nova-compute[74189]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 25 21:19:25 user nova-compute[74189]:       <source file='/opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk' index='2'/>
Oct 25 21:19:25 user nova-compute[74189]:       <backingStore type='file' index='3'>
Oct 25 21:19:25 user nova-compute[74189]:         <format type='raw'/>
Oct 25 21:19:25 user nova-compute[74189]:         <source file='/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8'/>
Oct 25 21:19:25 user nova-compute[74189]:         <backingStore/>
Oct 25 21:19:25 user nova-compute[74189]:       </backingStore>
Oct 25 21:19:25 user nova-compute[74189]:       <target dev='vda' bus='virtio'/>
Oct 25 21:19:25 user nova-compute[74189]:       <alias name='virtio-disk0'/>
Oct 25 21:19:25 user nova-compute[74189]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 25 21:19:25 user nova-compute[74189]:     </disk>
Oct 25 21:19:25 user nova-compute[74189]:     <disk type='file' device='cdrom'>
Oct 25 21:19:25 user nova-compute[74189]:       <driver name='qemu' type='raw' cache='none'/>
Oct 25 21:19:25 user nova-compute[74189]:       <source file='/opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk.config' index='1'/>
Oct 25 21:19:25 user nova-compute[74189]:       <backingStore/>
Oct 25 21:19:25 user nova-compute[74189]:       <target dev='hda' bus='ide'/>
Oct 25 21:19:25 user nova-compute[74189]:       <readonly/>
Oct 25 21:19:25 user nova-compute[74189]:       <alias name='ide0-0-0'/>
Oct 25 21:19:25 user nova-compute[74189]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 25 21:19:25 user nova-compute[74189]:     </disk>
Oct 25 21:19:25 user nova-compute[74189]:     <controller type='usb' index='0' model='none'>
Oct 25 21:19:25 user nova-compute[74189]:       <alias name='usb'/>
Oct 25 21:19:25 user nova-compute[74189]:     </controller>
Oct 25 21:19:25 user nova-compute[74189]:     <controller type='pci' index='0' model='pci-root'>
Oct 25 21:19:25 user nova-compute[74189]:       <alias name='pci.0'/>
Oct 25 21:19:25 user nova-compute[74189]:     </controller>
Oct 25 21:19:25 user nova-compute[74189]:     <controller type='ide' index='0'>
Oct 25 21:19:25 user nova-compute[74189]:       <alias name='ide'/>
Oct 25 21:19:25 user nova-compute[74189]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 25 21:19:25 user nova-compute[74189]:     </controller>
Oct 25 21:19:25 user nova-compute[74189]:     <interface type='ethernet'>
Oct 25 21:19:25 user nova-compute[74189]:       <mac address='fa:16:3e:63:71:94'/>
Oct 25 21:19:25 user nova-compute[74189]:       <target dev='tapa151161f-16'/>
Oct 25 21:19:25 user nova-compute[74189]:       <model type='virtio'/>
Oct 25 21:19:25 user nova-compute[74189]:       <mtu size='1442'/>
Oct 25 21:19:25 user nova-compute[74189]:       <alias name='net0'/>
Oct 25 21:19:25 user nova-compute[74189]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 25 21:19:25 user nova-compute[74189]:     </interface>
Oct 25 21:19:25 user nova-compute[74189]:     <serial type='pty'>
Oct 25 21:19:25 user nova-compute[74189]:       <source path='/dev/pts/5'/>
Oct 25 21:19:25 user nova-compute[74189]:       <log file='/opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/console.log' append='off'/>
Oct 25 21:19:25 user nova-compute[74189]:       <target type='isa-serial' port='0'>
Oct 25 21:19:25 user nova-compute[74189]:         <model name='isa-serial'/>
Oct 25 21:19:25 user nova-compute[74189]:       </target>
Oct 25 21:19:25 user nova-compute[74189]:       <alias name='serial0'/>
Oct 25 21:19:25 user nova-compute[74189]:     </serial>
Oct 25 21:19:25 user nova-compute[74189]:     <console type='pty' tty='/dev/pts/5'>
Oct 25 21:19:25 user nova-compute[74189]:       <source path='/dev/pts/5'/>
Oct 25 21:19:25 user nova-compute[74189]:       <log file='/opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/console.log' append='off'/>
Oct 25 21:19:25 user nova-compute[74189]:       <target type='serial' port='0'/>
Oct 25 21:19:25 user nova-compute[74189]:       <alias name='serial0'/>
Oct 25 21:19:25 user nova-compute[74189]:     </console>
Oct 25 21:19:25 user nova-compute[74189]:     <input type='mouse' bus='ps2'>
Oct 25 21:19:25 user nova-compute[74189]:       <alias name='input0'/>
Oct 25 21:19:25 user nova-compute[74189]:     </input>
Oct 25 21:19:25 user nova-compute[74189]:     <input type='keyboard' bus='ps2'>
Oct 25 21:19:25 user nova-compute[74189]:       <alias name='input1'/>
Oct 25 21:19:25 user nova-compute[74189]:     </input>
Oct 25 21:19:25 user nova-compute[74189]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Oct 25 21:19:25 user nova-compute[74189]:       <listen type='address' address='0.0.0.0'/>
Oct 25 21:19:25 user nova-compute[74189]:     </graphics>
Oct 25 21:19:25 user nova-compute[74189]:     <audio id='1' type='none'/>
Oct 25 21:19:25 user nova-compute[74189]:     <video>
Oct 25 21:19:25 user nova-compute[74189]:       <model type='virtio' heads='1' primary='yes'/>
Oct 25 21:19:25 user nova-compute[74189]:       <alias name='video0'/>
Oct 25 21:19:25 user nova-compute[74189]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 25 21:19:25 user nova-compute[74189]:     </video>
Oct 25 21:19:25 user nova-compute[74189]:     <memballoon model='virtio'>
Oct 25 21:19:25 user nova-compute[74189]:       <stats period='10'/>
Oct 25 21:19:25 user nova-compute[74189]:       <alias name='balloon0'/>
Oct 25 21:19:25 user nova-compute[74189]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 25 21:19:25 user nova-compute[74189]:     </memballoon>
Oct 25 21:19:25 user nova-compute[74189]:     <rng model='virtio'>
Oct 25 21:19:25 user nova-compute[74189]:       <backend model='random'>/dev/urandom</backend>
Oct 25 21:19:25 user nova-compute[74189]:       <alias name='rng0'/>
Oct 25 21:19:25 user nova-compute[74189]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 25 21:19:25 user nova-compute[74189]:     </rng>
Oct 25 21:19:25 user nova-compute[74189]:   </devices>
Oct 25 21:19:25 user nova-compute[74189]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 25 21:19:25 user nova-compute[74189]:     <label>libvirt-ea8d22c5-3868-43d1-b101-c6cff480dea6</label>
Oct 25 21:19:25 user nova-compute[74189]:     <imagelabel>libvirt-ea8d22c5-3868-43d1-b101-c6cff480dea6</imagelabel>
Oct 25 21:19:25 user nova-compute[74189]:   </seclabel>
Oct 25 21:19:25 user nova-compute[74189]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 25 21:19:25 user nova-compute[74189]:     <label>+64055:+108</label>
Oct 25 21:19:25 user nova-compute[74189]:     <imagelabel>+64055:+108</imagelabel>
Oct 25 21:19:25 user nova-compute[74189]:   </seclabel>
Oct 25 21:19:25 user nova-compute[74189]: </domain>
Oct 25 21:19:25 user nova-compute[74189]:  {{(pid=74189) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [req-d8a84243-2f63-47fa-bada-b1b3f4fa2e4a req-727c5667-8c71-4605-82bc-e309b989003b service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3c:4e:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tapf25ca758-60"/></interface> {{(pid=74189) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [req-d8a84243-2f63-47fa-bada-b1b3f4fa2e4a req-727c5667-8c71-4605-82bc-e309b989003b service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:3c:4e:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tapf25ca758-60"/></interface>not found in domain: <domain type='kvm' id='6'>
Oct 25 21:19:25 user nova-compute[74189]:   <name>instance-00000006</name>
Oct 25 21:19:25 user nova-compute[74189]:   <uuid>ea8d22c5-3868-43d1-b101-c6cff480dea6</uuid>
Oct 25 21:19:25 user nova-compute[74189]:   <metadata>
Oct 25 21:19:25 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:19:25 user nova-compute[74189]:   <nova:package version="0.0.0"/>
Oct 25 21:19:25 user nova-compute[74189]:   <nova:name>tempest-device-tagging-server-781387297</nova:name>
Oct 25 21:19:25 user nova-compute[74189]:   <nova:creationTime>2023-10-25 21:19:24</nova:creationTime>
Oct 25 21:19:25 user nova-compute[74189]:   <nova:flavor name="m1.tiny">
Oct 25 21:19:25 user nova-compute[74189]:     <nova:memory>512</nova:memory>
Oct 25 21:19:25 user nova-compute[74189]:     <nova:disk>1</nova:disk>
Oct 25 21:19:25 user nova-compute[74189]:     <nova:swap>0</nova:swap>
Oct 25 21:19:25 user nova-compute[74189]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:19:25 user nova-compute[74189]:     <nova:vcpus>1</nova:vcpus>
Oct 25 21:19:25 user nova-compute[74189]:   </nova:flavor>
Oct 25 21:19:25 user nova-compute[74189]:   <nova:owner>
Oct 25 21:19:25 user nova-compute[74189]:     <nova:user uuid="a147e32cb7fd45aaa1398a1332e6956a">tempest-TaggedAttachmentsTest-1187636517-project-member</nova:user>
Oct 25 21:19:25 user nova-compute[74189]:     <nova:project uuid="7d6d05f10a0647e9a014e78f2a7dab78">tempest-TaggedAttachmentsTest-1187636517</nova:project>
Oct 25 21:19:25 user nova-compute[74189]:   </nova:owner>
Oct 25 21:19:25 user nova-compute[74189]:   <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:19:25 user nova-compute[74189]:   <nova:ports>
Oct 25 21:19:25 user nova-compute[74189]:     <nova:port uuid="a151161f-1633-405f-ac74-9f379531d89a">
Oct 25 21:19:25 user nova-compute[74189]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 25 21:19:25 user nova-compute[74189]:     </nova:port>
Oct 25 21:19:25 user nova-compute[74189]:   </nova:ports>
Oct 25 21:19:25 user nova-compute[74189]: </nova:instance>
Oct 25 21:19:25 user nova-compute[74189]:   </metadata>
Oct 25 21:19:25 user nova-compute[74189]:   <memory unit='KiB'>524288</memory>
Oct 25 21:19:25 user nova-compute[74189]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 25 21:19:25 user nova-compute[74189]:   <vcpu placement='static'>1</vcpu>
Oct 25 21:19:25 user nova-compute[74189]:   <resource>
Oct 25 21:19:25 user nova-compute[74189]:     <partition>/machine</partition>
Oct 25 21:19:25 user nova-compute[74189]:   </resource>
Oct 25 21:19:25 user nova-compute[74189]:   <sysinfo type='smbios'>
Oct 25 21:19:25 user nova-compute[74189]:     <system>
Oct 25 21:19:25 user nova-compute[74189]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 25 21:19:25 user nova-compute[74189]:       <entry name='product'>OpenStack Nova</entry>
Oct 25 21:19:25 user nova-compute[74189]:       <entry name='version'>0.0.0</entry>
Oct 25 21:19:25 user nova-compute[74189]:       <entry name='serial'>ea8d22c5-3868-43d1-b101-c6cff480dea6</entry>
Oct 25 21:19:25 user nova-compute[74189]:       <entry name='uuid'>ea8d22c5-3868-43d1-b101-c6cff480dea6</entry>
Oct 25 21:19:25 user nova-compute[74189]:       <entry name='family'>Virtual Machine</entry>
Oct 25 21:19:25 user nova-compute[74189]:     </system>
Oct 25 21:19:25 user nova-compute[74189]:   </sysinfo>
Oct 25 21:19:25 user nova-compute[74189]:   <os>
Oct 25 21:19:25 user nova-compute[74189]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 25 21:19:25 user nova-compute[74189]:     <boot dev='hd'/>
Oct 25 21:19:25 user nova-compute[74189]:     <smbios mode='sysinfo'/>
Oct 25 21:19:25 user nova-compute[74189]:   </os>
Oct 25 21:19:25 user nova-compute[74189]:   <features>
Oct 25 21:19:25 user nova-compute[74189]:     <acpi/>
Oct 25 21:19:25 user nova-compute[74189]:     <apic/>
Oct 25 21:19:25 user nova-compute[74189]:     <vmcoreinfo state='on'/>
Oct 25 21:19:25 user nova-compute[74189]:   </features>
Oct 25 21:19:25 user nova-compute[74189]:   <cpu mode='custom' match='exact' check='full'>
Oct 25 21:19:25 user nova-compute[74189]:     <model fallback='forbid'>Nehalem</model>
Oct 25 21:19:25 user nova-compute[74189]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 25 21:19:25 user nova-compute[74189]:     <feature policy='require' name='vme'/>
Oct 25 21:19:25 user nova-compute[74189]:     <feature policy='require' name='x2apic'/>
Oct 25 21:19:25 user nova-compute[74189]:     <feature policy='require' name='hypervisor'/>
Oct 25 21:19:25 user nova-compute[74189]:   </cpu>
Oct 25 21:19:25 user nova-compute[74189]:   <clock offset='utc'>
Oct 25 21:19:25 user nova-compute[74189]:     <timer name='pit' tickpolicy='delay'/>
Oct 25 21:19:25 user nova-compute[74189]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 25 21:19:25 user nova-compute[74189]:     <timer name='hpet' present='no'/>
Oct 25 21:19:25 user nova-compute[74189]:   </clock>
Oct 25 21:19:25 user nova-compute[74189]:   <on_poweroff>destroy</on_poweroff>
Oct 25 21:19:25 user nova-compute[74189]:   <on_reboot>restart</on_reboot>
Oct 25 21:19:25 user nova-compute[74189]:   <on_crash>destroy</on_crash>
Oct 25 21:19:25 user nova-compute[74189]:   <devices>
Oct 25 21:19:25 user nova-compute[74189]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 25 21:19:25 user nova-compute[74189]:     <disk type='file' device='disk'>
Oct 25 21:19:25 user nova-compute[74189]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 25 21:19:25 user nova-compute[74189]:       <source file='/opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk' index='2'/>
Oct 25 21:19:25 user nova-compute[74189]:       <backingStore type='file' index='3'>
Oct 25 21:19:25 user nova-compute[74189]:         <format type='raw'/>
Oct 25 21:19:25 user nova-compute[74189]:         <source file='/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8'/>
Oct 25 21:19:25 user nova-compute[74189]:         <backingStore/>
Oct 25 21:19:25 user nova-compute[74189]:       </backingStore>
Oct 25 21:19:25 user nova-compute[74189]:       <target dev='vda' bus='virtio'/>
Oct 25 21:19:25 user nova-compute[74189]:       <alias name='virtio-disk0'/>
Oct 25 21:19:25 user nova-compute[74189]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 25 21:19:25 user nova-compute[74189]:     </disk>
Oct 25 21:19:25 user nova-compute[74189]:     <disk type='file' device='cdrom'>
Oct 25 21:19:25 user nova-compute[74189]:       <driver name='qemu' type='raw' cache='none'/>
Oct 25 21:19:25 user nova-compute[74189]:       <source file='/opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/disk.config' index='1'/>
Oct 25 21:19:25 user nova-compute[74189]:       <backingStore/>
Oct 25 21:19:25 user nova-compute[74189]:       <target dev='hda' bus='ide'/>
Oct 25 21:19:25 user nova-compute[74189]:       <readonly/>
Oct 25 21:19:25 user nova-compute[74189]:       <alias name='ide0-0-0'/>
Oct 25 21:19:25 user nova-compute[74189]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 25 21:19:25 user nova-compute[74189]:     </disk>
Oct 25 21:19:25 user nova-compute[74189]:     <controller type='usb' index='0' model='none'>
Oct 25 21:19:25 user nova-compute[74189]:       <alias name='usb'/>
Oct 25 21:19:25 user nova-compute[74189]:     </controller>
Oct 25 21:19:25 user nova-compute[74189]:     <controller type='pci' index='0' model='pci-root'>
Oct 25 21:19:25 user nova-compute[74189]:       <alias name='pci.0'/>
Oct 25 21:19:25 user nova-compute[74189]:     </controller>
Oct 25 21:19:25 user nova-compute[74189]:     <controller type='ide' index='0'>
Oct 25 21:19:25 user nova-compute[74189]:       <alias name='ide'/>
Oct 25 21:19:25 user nova-compute[74189]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 25 21:19:25 user nova-compute[74189]:     </controller>
Oct 25 21:19:25 user nova-compute[74189]:     <interface type='ethernet'>
Oct 25 21:19:25 user nova-compute[74189]:       <mac address='fa:16:3e:63:71:94'/>
Oct 25 21:19:25 user nova-compute[74189]:       <target dev='tapa151161f-16'/>
Oct 25 21:19:25 user nova-compute[74189]:       <model type='virtio'/>
Oct 25 21:19:25 user nova-compute[74189]:       <mtu size='1442'/>
Oct 25 21:19:25 user nova-compute[74189]:       <alias name='net0'/>
Oct 25 21:19:25 user nova-compute[74189]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 25 21:19:25 user nova-compute[74189]:     </interface>
Oct 25 21:19:25 user nova-compute[74189]:     <serial type='pty'>
Oct 25 21:19:25 user nova-compute[74189]:       <source path='/dev/pts/5'/>
Oct 25 21:19:25 user nova-compute[74189]:       <log file='/opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/console.log' append='off'/>
Oct 25 21:19:25 user nova-compute[74189]:       <target type='isa-serial' port='0'>
Oct 25 21:19:25 user nova-compute[74189]:         <model name='isa-serial'/>
Oct 25 21:19:25 user nova-compute[74189]:       </target>
Oct 25 21:19:25 user nova-compute[74189]:       <alias name='serial0'/>
Oct 25 21:19:25 user nova-compute[74189]:     </serial>
Oct 25 21:19:25 user nova-compute[74189]:     <console type='pty' tty='/dev/pts/5'>
Oct 25 21:19:25 user nova-compute[74189]:       <source path='/dev/pts/5'/>
Oct 25 21:19:25 user nova-compute[74189]:       <log file='/opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6/console.log' append='off'/>
Oct 25 21:19:25 user nova-compute[74189]:       <target type='serial' port='0'/>
Oct 25 21:19:25 user nova-compute[74189]:       <alias name='serial0'/>
Oct 25 21:19:25 user nova-compute[74189]:     </console>
Oct 25 21:19:25 user nova-compute[74189]:     <input type='mouse' bus='ps2'>
Oct 25 21:19:25 user nova-compute[74189]:       <alias name='input0'/>
Oct 25 21:19:25 user nova-compute[74189]:     </input>
Oct 25 21:19:25 user nova-compute[74189]:     <input type='keyboard' bus='ps2'>
Oct 25 21:19:25 user nova-compute[74189]:       <alias name='input1'/>
Oct 25 21:19:25 user nova-compute[74189]:     </input>
Oct 25 21:19:25 user nova-compute[74189]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Oct 25 21:19:25 user nova-compute[74189]:       <listen type='address' address='0.0.0.0'/>
Oct 25 21:19:25 user nova-compute[74189]:     </graphics>
Oct 25 21:19:25 user nova-compute[74189]:     <audio id='1' type='none'/>
Oct 25 21:19:25 user nova-compute[74189]:     <video>
Oct 25 21:19:25 user nova-compute[74189]:       <model type='virtio' heads='1' primary='yes'/>
Oct 25 21:19:25 user nova-compute[74189]:       <alias name='video0'/>
Oct 25 21:19:25 user nova-compute[74189]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 25 21:19:25 user nova-compute[74189]:     </video>
Oct 25 21:19:25 user nova-compute[74189]:     <memballoon model='virtio'>
Oct 25 21:19:25 user nova-compute[74189]:       <stats period='10'/>
Oct 25 21:19:25 user nova-compute[74189]:       <alias name='balloon0'/>
Oct 25 21:19:25 user nova-compute[74189]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 25 21:19:25 user nova-compute[74189]:     </memballoon>
Oct 25 21:19:25 user nova-compute[74189]:     <rng model='virtio'>
Oct 25 21:19:25 user nova-compute[74189]:       <backend model='random'>/dev/urandom</backend>
Oct 25 21:19:25 user nova-compute[74189]:       <alias name='rng0'/>
Oct 25 21:19:25 user nova-compute[74189]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 25 21:19:25 user nova-compute[74189]:     </rng>
Oct 25 21:19:25 user nova-compute[74189]:   </devices>
Oct 25 21:19:25 user nova-compute[74189]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 25 21:19:25 user nova-compute[74189]:     <label>libvirt-ea8d22c5-3868-43d1-b101-c6cff480dea6</label>
Oct 25 21:19:25 user nova-compute[74189]:     <imagelabel>libvirt-ea8d22c5-3868-43d1-b101-c6cff480dea6</imagelabel>
Oct 25 21:19:25 user nova-compute[74189]:   </seclabel>
Oct 25 21:19:25 user nova-compute[74189]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 25 21:19:25 user nova-compute[74189]:     <label>+64055:+108</label>
Oct 25 21:19:25 user nova-compute[74189]:     <imagelabel>+64055:+108</imagelabel>
Oct 25 21:19:25 user nova-compute[74189]:   </seclabel>
Oct 25 21:19:25 user nova-compute[74189]: </domain>
Oct 25 21:19:25 user nova-compute[74189]:  {{(pid=74189) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 25 21:19:25 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [req-d8a84243-2f63-47fa-bada-b1b3f4fa2e4a req-727c5667-8c71-4605-82bc-e309b989003b service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Detaching interface fa:16:3e:3c:4e:d6 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapf25ca758-60' not found.
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [req-d8a84243-2f63-47fa-bada-b1b3f4fa2e4a req-727c5667-8c71-4605-82bc-e309b989003b service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-781387297',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-781387297',id=6,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHJgDbw7K7bwNJyj3WQeM4O7X1T/XxzeuPN+AM4eJ62yayGmYQQS1OGbI1fYrJusZqdcuogdpmdUBe6qoNmEvj36GKw2Ywp/JElU+pyp8QCNHY9uIrm3I9Zf5tuFbEg3Q==',key_name='tempest-keypair-159731972',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:15:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d6d05f10a0647e9a014e78f2a7dab78',ramdisk_id='',reservation_id='r-oi1337uc',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1187636517',owner_user_name='tempest-TaggedAttachmentsTest-1187636517-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:15:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a147e32cb7fd45aaa1398a1332e6956a',uuid=ea8d22c5-3868-43d1-b101-c6cff480dea6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f25ca758-602f-481b-8de2-4a8040b991cd", "address": "fa:16:3e:3c:4e:d6", "network": {"id": "2b3af293-fcd7-4868-89bd-0701f2814a8b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-227584648", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7d6d05f10a0647e9a014e78f2a7dab78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25ca758-60", "ovs_interfaceid": "f25ca758-602f-481b-8de2-4a8040b991cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.network.os_vif_util [req-d8a84243-2f63-47fa-bada-b1b3f4fa2e4a req-727c5667-8c71-4605-82bc-e309b989003b service nova] Converting VIF {"id": "f25ca758-602f-481b-8de2-4a8040b991cd", "address": "fa:16:3e:3c:4e:d6", "network": {"id": "2b3af293-fcd7-4868-89bd-0701f2814a8b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-227584648", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7d6d05f10a0647e9a014e78f2a7dab78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25ca758-60", "ovs_interfaceid": "f25ca758-602f-481b-8de2-4a8040b991cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.network.os_vif_util [req-d8a84243-2f63-47fa-bada-b1b3f4fa2e4a req-727c5667-8c71-4605-82bc-e309b989003b service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:4e:d6,bridge_name='br-int',has_traffic_filtering=True,id=f25ca758-602f-481b-8de2-4a8040b991cd,network=Network(2b3af293-fcd7-4868-89bd-0701f2814a8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf25ca758-60') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG os_vif [req-d8a84243-2f63-47fa-bada-b1b3f4fa2e4a req-727c5667-8c71-4605-82bc-e309b989003b service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:4e:d6,bridge_name='br-int',has_traffic_filtering=True,id=f25ca758-602f-481b-8de2-4a8040b991cd,network=Network(2b3af293-fcd7-4868-89bd-0701f2814a8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf25ca758-60') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: INFO os_vif [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:e6:5a,bridge_name='br-int',has_traffic_filtering=True,id=fc507e9a-e2b6-4604-bc65-0f62b3b6da6e,network=Network(925c3fd0-b4db-47a8-95c3-dcff4b31c3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc507e9a-e2')
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf25ca758-60, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:19:25 user nova-compute[74189]: INFO os_vif [req-d8a84243-2f63-47fa-bada-b1b3f4fa2e4a req-727c5667-8c71-4605-82bc-e309b989003b service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:4e:d6,bridge_name='br-int',has_traffic_filtering=True,id=f25ca758-602f-481b-8de2-4a8040b991cd,network=Network(2b3af293-fcd7-4868-89bd-0701f2814a8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf25ca758-60')
Oct 25 21:19:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [req-d8a84243-2f63-47fa-bada-b1b3f4fa2e4a req-727c5667-8c71-4605-82bc-e309b989003b service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:19:25 user nova-compute[74189]:   <nova:package version="0.0.0"/>
Oct 25 21:19:25 user nova-compute[74189]:   <nova:name>tempest-device-tagging-server-781387297</nova:name>
Oct 25 21:19:25 user nova-compute[74189]:   <nova:creationTime>2023-10-25 21:19:25</nova:creationTime>
Oct 25 21:19:25 user nova-compute[74189]:   <nova:flavor name="m1.tiny">
Oct 25 21:19:25 user nova-compute[74189]:     <nova:memory>512</nova:memory>
Oct 25 21:19:25 user nova-compute[74189]:     <nova:disk>1</nova:disk>
Oct 25 21:19:25 user nova-compute[74189]:     <nova:swap>0</nova:swap>
Oct 25 21:19:25 user nova-compute[74189]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:19:25 user nova-compute[74189]:     <nova:vcpus>1</nova:vcpus>
Oct 25 21:19:25 user nova-compute[74189]:   </nova:flavor>
Oct 25 21:19:25 user nova-compute[74189]:   <nova:owner>
Oct 25 21:19:25 user nova-compute[74189]:     <nova:user uuid="a147e32cb7fd45aaa1398a1332e6956a">tempest-TaggedAttachmentsTest-1187636517-project-member</nova:user>
Oct 25 21:19:25 user nova-compute[74189]:     <nova:project uuid="7d6d05f10a0647e9a014e78f2a7dab78">tempest-TaggedAttachmentsTest-1187636517</nova:project>
Oct 25 21:19:25 user nova-compute[74189]:   </nova:owner>
Oct 25 21:19:25 user nova-compute[74189]:   <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:19:25 user nova-compute[74189]:   <nova:ports>
Oct 25 21:19:25 user nova-compute[74189]:     <nova:port uuid="a151161f-1633-405f-ac74-9f379531d89a">
Oct 25 21:19:25 user nova-compute[74189]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 25 21:19:25 user nova-compute[74189]:     </nova:port>
Oct 25 21:19:25 user nova-compute[74189]:   </nova:ports>
Oct 25 21:19:25 user nova-compute[74189]: </nova:instance>
Oct 25 21:19:25 user nova-compute[74189]:  {{(pid=74189) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 25 21:19:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:19:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] No VIF found with MAC fa:16:3e:91:e6:5a, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:19:26 user nova-compute[74189]: DEBUG nova.network.neutron [req-6d7accd1-662c-4a9c-9102-581decc04211 req-3bb4f3f5-e9b1-406f-8ed0-f83b88d5d129 service nova] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Updated VIF entry in instance network info cache for port fc507e9a-e2b6-4604-bc65-0f62b3b6da6e. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:19:26 user nova-compute[74189]: DEBUG nova.network.neutron [req-6d7accd1-662c-4a9c-9102-581decc04211 req-3bb4f3f5-e9b1-406f-8ed0-f83b88d5d129 service nova] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Updating instance_info_cache with network_info: [{"id": "fc507e9a-e2b6-4604-bc65-0f62b3b6da6e", "address": "fa:16:3e:91:e6:5a", "network": {"id": "925c3fd0-b4db-47a8-95c3-dcff4b31c3b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2002620134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "927b9214b64840ee97bcbcadbe893e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc507e9a-e2", "ovs_interfaceid": "fc507e9a-e2b6-4604-bc65-0f62b3b6da6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:19:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-6d7accd1-662c-4a9c-9102-581decc04211 req-3bb4f3f5-e9b1-406f-8ed0-f83b88d5d129 service nova] Releasing lock "refresh_cache-28a5eb34-5e63-414b-81d9-12f2b41c699c" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:19:26 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Creating config drive at /opt/stack/data/nova/instances/2486ac33-a881-4be1-a24e-2ff263e51818/disk.config
Oct 25 21:19:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2486ac33-a881-4be1-a24e-2ff263e51818/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppha6mb8n {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2486ac33-a881-4be1-a24e-2ff263e51818/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppha6mb8n" returned: 0 in 0.054s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:26 user nova-compute[74189]: INFO nova.network.neutron [None req-03d97097-77b5-4d01-92d4-42ec3bfa0bb7 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Port f25ca758-602f-481b-8de2-4a8040b991cd from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Oct 25 21:19:26 user nova-compute[74189]: DEBUG nova.network.neutron [None req-03d97097-77b5-4d01-92d4-42ec3bfa0bb7 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Updating instance_info_cache with network_info: [{"id": "a151161f-1633-405f-ac74-9f379531d89a", "address": "fa:16:3e:63:71:94", "network": {"id": "62a86fdc-b28d-442a-9d62-0c3286ad0abb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1182690237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6d05f10a0647e9a014e78f2a7dab78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa151161f-16", "ovs_interfaceid": "a151161f-1633-405f-ac74-9f379531d89a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:19:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-03d97097-77b5-4d01-92d4-42ec3bfa0bb7 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Releasing lock "refresh_cache-ea8d22c5-3868-43d1-b101-c6cff480dea6" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:19:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-03d97097-77b5-4d01-92d4-42ec3bfa0bb7 tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lock "interface-ea8d22c5-3868-43d1-b101-c6cff480dea6-f25ca758-602f-481b-8de2-4a8040b991cd" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.909s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDQlxprB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:19:27 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:19:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:19:27 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:19:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:19:27 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:19:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca68042e-47f4-46dc-b7ea-91ecac9a6a43]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:19:27 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[203f4b57-bcaa-431f-bf2c-6038e15f9026]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78] added
Oct 25 21:19:27 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8679bd-c96f-4112-be78-a53a28314d32]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fd48f0-e619-40b3-beae-aade6d4dc3c8]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CDQlxprB {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CDQlxprB" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d807a11a-2ac0-4ef6-968f-cd25e7f0e414]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CDQlxprB'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e28080b-bb34-4fd5-916c-cb11c27a406e]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4d415b-3957-4f16-99c5-6bd4e73803db]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:19:27 user nova-compute[74189]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:19:27 user nova-compute[74189]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)
Oct 25 21:19:27 user nova-compute[74189]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)
Oct 25 21:19:27 user nova-compute[74189]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)
Oct 25 21:19:27 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:19:27 user nova-compute[74189]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:19:27 user nova-compute[74189]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)
Oct 25 21:19:27 user nova-compute[74189]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)
Oct 25 21:19:27 user nova-compute[74189]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)
Oct 25 21:19:27 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdd2941-bdff-45f5-aaa6-06e117e5c8e8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78, portal: 172.16.0.220,3260]
Oct 25 21:19:27 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78, portal: 172.16.0.220,3260] successful.
Oct 25 21:19:27 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e5705e-316e-461a-8cf9-27b803ab7731]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c304e1-249d-4e37-8295-27ac857e0123]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:19:27 user nova-compute[74189]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:19:27 user nova-compute[74189]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)
Oct 25 21:19:27 user nova-compute[74189]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)
Oct 25 21:19:27 user nova-compute[74189]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)
Oct 25 21:19:27 user nova-compute[74189]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:19:27 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:19:27 user nova-compute[74189]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:19:27 user nova-compute[74189]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)
Oct 25 21:19:27 user nova-compute[74189]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)
Oct 25 21:19:27 user nova-compute[74189]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)
Oct 25 21:19:27 user nova-compute[74189]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:19:27 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] HCTL ('38', '-', '-', 0) found on session 16 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[23335320-6391-44fe-ba0b-b07dace6e6da]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Searching for a device in session 16 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:19:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDQlxprB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:19:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:28 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:19:28 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '26332383433326233', 'path': '/dev/sdg'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:19:28 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332383433326233', 'path': '/dev/sdg'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:19:28 user nova-compute[74189]: DEBUG nova.objects.instance [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lazy-loading 'flavor' on Instance uuid 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:19:28 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 21:19:28 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:19:28 user nova-compute[74189]:   <source dev="/dev/sdg"/>
Oct 25 21:19:28 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:19:28 user nova-compute[74189]:   <serial>baed35ad-5534-47eb-93f6-2393d45d9e78</serial>
Oct 25 21:19:28 user nova-compute[74189]: </disk>
Oct 25 21:19:28 user nova-compute[74189]:  {{(pid=74189) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 21:19:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:28 user nova-compute[74189]: DEBUG nova.compute.manager [req-b4962477-d56a-401e-8d72-e12cad7e7e9b req-62a59dba-753c-462d-a96b-dd7dbedea82d service nova] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Received event network-vif-plugged-fc507e9a-e2b6-4604-bc65-0f62b3b6da6e {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b4962477-d56a-401e-8d72-e12cad7e7e9b req-62a59dba-753c-462d-a96b-dd7dbedea82d service nova] Acquiring lock "28a5eb34-5e63-414b-81d9-12f2b41c699c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b4962477-d56a-401e-8d72-e12cad7e7e9b req-62a59dba-753c-462d-a96b-dd7dbedea82d service nova] Lock "28a5eb34-5e63-414b-81d9-12f2b41c699c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b4962477-d56a-401e-8d72-e12cad7e7e9b req-62a59dba-753c-462d-a96b-dd7dbedea82d service nova] Lock "28a5eb34-5e63-414b-81d9-12f2b41c699c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:28 user nova-compute[74189]: DEBUG nova.compute.manager [req-b4962477-d56a-401e-8d72-e12cad7e7e9b req-62a59dba-753c-462d-a96b-dd7dbedea82d service nova] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] No waiting events found dispatching network-vif-plugged-fc507e9a-e2b6-4604-bc65-0f62b3b6da6e {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:19:28 user nova-compute[74189]: WARNING nova.compute.manager [req-b4962477-d56a-401e-8d72-e12cad7e7e9b req-62a59dba-753c-462d-a96b-dd7dbedea82d service nova] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Received unexpected event network-vif-plugged-fc507e9a-e2b6-4604-bc65-0f62b3b6da6e for instance with vm_state building and task_state spawning.
Oct 25 21:19:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:28 user nova-compute[74189]: DEBUG nova.compute.manager [req-b319ce34-732a-4bf0-9552-af66312c32c6 req-f5d75af7-26ac-40cb-bf9d-98c9038b3149 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-plugged-a334be31-0990-4647-b215-2553698e0050 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b319ce34-732a-4bf0-9552-af66312c32c6 req-f5d75af7-26ac-40cb-bf9d-98c9038b3149 service nova] Acquiring lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b319ce34-732a-4bf0-9552-af66312c32c6 req-f5d75af7-26ac-40cb-bf9d-98c9038b3149 service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b319ce34-732a-4bf0-9552-af66312c32c6 req-f5d75af7-26ac-40cb-bf9d-98c9038b3149 service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:28 user nova-compute[74189]: DEBUG nova.compute.manager [req-b319ce34-732a-4bf0-9552-af66312c32c6 req-f5d75af7-26ac-40cb-bf9d-98c9038b3149 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] No waiting events found dispatching network-vif-plugged-a334be31-0990-4647-b215-2553698e0050 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:19:28 user nova-compute[74189]: WARNING nova.compute.manager [req-b319ce34-732a-4bf0-9552-af66312c32c6 req-f5d75af7-26ac-40cb-bf9d-98c9038b3149 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received unexpected event network-vif-plugged-a334be31-0990-4647-b215-2553698e0050 for instance with vm_state building and task_state spawning.
Oct 25 21:19:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:19:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:19:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] No VIF found with MAC fa:16:3e:92:dc:7e, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:19:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-890be724-b286-417b-8850-b4581ad24faa tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.584s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:30 user nova-compute[74189]: DEBUG nova.compute.manager [req-d13ca3b0-a250-4964-9599-3b9d3236345a req-4732344f-df9a-4e3e-918e-76dfb61ffd4a service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-plugged-a334be31-0990-4647-b215-2553698e0050 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d13ca3b0-a250-4964-9599-3b9d3236345a req-4732344f-df9a-4e3e-918e-76dfb61ffd4a service nova] Acquiring lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d13ca3b0-a250-4964-9599-3b9d3236345a req-4732344f-df9a-4e3e-918e-76dfb61ffd4a service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d13ca3b0-a250-4964-9599-3b9d3236345a req-4732344f-df9a-4e3e-918e-76dfb61ffd4a service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:30 user nova-compute[74189]: DEBUG nova.compute.manager [req-d13ca3b0-a250-4964-9599-3b9d3236345a req-4732344f-df9a-4e3e-918e-76dfb61ffd4a service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] No waiting events found dispatching network-vif-plugged-a334be31-0990-4647-b215-2553698e0050 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:19:30 user nova-compute[74189]: WARNING nova.compute.manager [req-d13ca3b0-a250-4964-9599-3b9d3236345a req-4732344f-df9a-4e3e-918e-76dfb61ffd4a service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received unexpected event network-vif-plugged-a334be31-0990-4647-b215-2553698e0050 for instance with vm_state building and task_state spawning.
Oct 25 21:19:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:31 user nova-compute[74189]: DEBUG nova.compute.manager [req-a5ed3b94-3fb2-4f30-9233-7329f312ba13 req-15452a6c-391f-45a3-a608-017a06dcae64 service nova] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Received event network-vif-plugged-fc507e9a-e2b6-4604-bc65-0f62b3b6da6e {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a5ed3b94-3fb2-4f30-9233-7329f312ba13 req-15452a6c-391f-45a3-a608-017a06dcae64 service nova] Acquiring lock "28a5eb34-5e63-414b-81d9-12f2b41c699c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a5ed3b94-3fb2-4f30-9233-7329f312ba13 req-15452a6c-391f-45a3-a608-017a06dcae64 service nova] Lock "28a5eb34-5e63-414b-81d9-12f2b41c699c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a5ed3b94-3fb2-4f30-9233-7329f312ba13 req-15452a6c-391f-45a3-a608-017a06dcae64 service nova] Lock "28a5eb34-5e63-414b-81d9-12f2b41c699c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:31 user nova-compute[74189]: DEBUG nova.compute.manager [req-a5ed3b94-3fb2-4f30-9233-7329f312ba13 req-15452a6c-391f-45a3-a608-017a06dcae64 service nova] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] No waiting events found dispatching network-vif-plugged-fc507e9a-e2b6-4604-bc65-0f62b3b6da6e {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:19:31 user nova-compute[74189]: WARNING nova.compute.manager [req-a5ed3b94-3fb2-4f30-9233-7329f312ba13 req-15452a6c-391f-45a3-a608-017a06dcae64 service nova] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Received unexpected event network-vif-plugged-fc507e9a-e2b6-4604-bc65-0f62b3b6da6e for instance with vm_state building and task_state spawning.
Oct 25 21:19:31 user nova-compute[74189]: DEBUG nova.compute.manager [req-a5ed3b94-3fb2-4f30-9233-7329f312ba13 req-15452a6c-391f-45a3-a608-017a06dcae64 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-plugged-a96d3bd5-5996-4171-87ef-082bfe44bb78 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a5ed3b94-3fb2-4f30-9233-7329f312ba13 req-15452a6c-391f-45a3-a608-017a06dcae64 service nova] Acquiring lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a5ed3b94-3fb2-4f30-9233-7329f312ba13 req-15452a6c-391f-45a3-a608-017a06dcae64 service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a5ed3b94-3fb2-4f30-9233-7329f312ba13 req-15452a6c-391f-45a3-a608-017a06dcae64 service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:31 user nova-compute[74189]: DEBUG nova.compute.manager [req-a5ed3b94-3fb2-4f30-9233-7329f312ba13 req-15452a6c-391f-45a3-a608-017a06dcae64 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] No waiting events found dispatching network-vif-plugged-a96d3bd5-5996-4171-87ef-082bfe44bb78 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:19:31 user nova-compute[74189]: WARNING nova.compute.manager [req-a5ed3b94-3fb2-4f30-9233-7329f312ba13 req-15452a6c-391f-45a3-a608-017a06dcae64 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received unexpected event network-vif-plugged-a96d3bd5-5996-4171-87ef-082bfe44bb78 for instance with vm_state building and task_state spawning.
Oct 25 21:19:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:31 user nova-compute[74189]: DEBUG nova.compute.manager [req-86a6a4f3-7079-42ad-b41b-ebcd68a4d4a1 req-da85858b-8d17-45f9-b7cf-3df90d3b2467 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-plugged-81b93608-6fb4-4753-8328-df418f6d3ffe {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-86a6a4f3-7079-42ad-b41b-ebcd68a4d4a1 req-da85858b-8d17-45f9-b7cf-3df90d3b2467 service nova] Acquiring lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-86a6a4f3-7079-42ad-b41b-ebcd68a4d4a1 req-da85858b-8d17-45f9-b7cf-3df90d3b2467 service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-86a6a4f3-7079-42ad-b41b-ebcd68a4d4a1 req-da85858b-8d17-45f9-b7cf-3df90d3b2467 service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:31 user nova-compute[74189]: DEBUG nova.compute.manager [req-86a6a4f3-7079-42ad-b41b-ebcd68a4d4a1 req-da85858b-8d17-45f9-b7cf-3df90d3b2467 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] No waiting events found dispatching network-vif-plugged-81b93608-6fb4-4753-8328-df418f6d3ffe {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:19:31 user nova-compute[74189]: WARNING nova.compute.manager [req-86a6a4f3-7079-42ad-b41b-ebcd68a4d4a1 req-da85858b-8d17-45f9-b7cf-3df90d3b2467 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received unexpected event network-vif-plugged-81b93608-6fb4-4753-8328-df418f6d3ffe for instance with vm_state building and task_state spawning.
Oct 25 21:19:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:19:32 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Creating image(s)
Oct 25 21:19:32 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Did not create local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Ensure instance console log exists: /opt/stack/data/nova/instances/a05b75c0-c064-42c5-aca7-c4b07cfabcfb/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Start _get_guest_xml network_info=[{"id": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "address": "fa:16:3e:88:75:56", "network": {"id": "75c09903-d1c6-4197-bc70-cfe7f3e7a772", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1909568880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa384e522324f0fa297ca277820909f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd28e4203-5f", "ovs_interfaceid": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fKgarFiL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a05b75c0-c064-42c5-aca7-c4b07cfabcfb', 'attached_at': '', 'detached_at': '', 'volume_id': 'e6efe932-902f-41f8-82f4-1773bc305e0e', 'serial': 'e6efe932-902f-41f8-82f4-1773bc305e0e'}, 'attachment_id': '642c3945-bd05-42d5-8476-18f3002d7e67', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:19:32 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 25 21:19:32 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 25 21:19:32 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG nova.objects.instance [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lazy-loading 'vcpu_model' on Instance uuid a05b75c0-c064-42c5-aca7-c4b07cfabcfb {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fKgarFiL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:19:32 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 21:19:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:19:32 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 21:19:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:19:32 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:19:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb99979-4d2d-4b99-a535-94976b790352]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:19:32 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ba4592-bb6e-4ff9-a716-0bc4779e3a1b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e] added
Oct 25 21:19:32 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG nova.compute.manager [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad34fef-c390-4a4e-bf48-26965207759f]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:32 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Instance spawned successfully.
Oct 25 21:19:32 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc97ab1f-9b78-4555-8126-1b0e9a68c665]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fKgarFiL {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fKgarFiL" returned: 0 in 0.044s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[407112ee-c4ab-4962-85b3-b407e818362a]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fKgarFiL'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5055786b-6700-421c-b28c-e125c288bc0b]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c836214d-d363-4c43-b35d-ef67913ef363]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:19:32 user nova-compute[74189]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:19:32 user nova-compute[74189]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)
Oct 25 21:19:32 user nova-compute[74189]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)
Oct 25 21:19:32 user nova-compute[74189]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)
Oct 25 21:19:32 user nova-compute[74189]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:19:32 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:19:32 user nova-compute[74189]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:19:32 user nova-compute[74189]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)
Oct 25 21:19:32 user nova-compute[74189]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)
Oct 25 21:19:32 user nova-compute[74189]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)
Oct 25 21:19:32 user nova-compute[74189]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:19:32 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:32 user nova-compute[74189]: INFO nova.compute.manager [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Took 8.83 seconds to spawn the instance on the hypervisor.
Oct 25 21:19:32 user nova-compute[74189]: DEBUG nova.compute.manager [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[36db64c9-a2d8-408c-87e1-81092ba4338e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e, portal: 172.16.0.220,3260]
Oct 25 21:19:32 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e, portal: 172.16.0.220,3260] successful.
Oct 25 21:19:32 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7101aaf4-ae3a-4795-8d17-7e235582c03e]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG nova.compute.manager [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Stashing vm_state: active {{(pid=74189) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.059s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1120145-a8d7-4936-b16c-bc4882432b8a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:19:33 user nova-compute[74189]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:19:33 user nova-compute[74189]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)
Oct 25 21:19:33 user nova-compute[74189]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)
Oct 25 21:19:33 user nova-compute[74189]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)
Oct 25 21:19:33 user nova-compute[74189]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:19:33 user nova-compute[74189]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:19:33 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:19:33 user nova-compute[74189]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:19:33 user nova-compute[74189]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)
Oct 25 21:19:33 user nova-compute[74189]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)
Oct 25 21:19:33 user nova-compute[74189]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)
Oct 25 21:19:33 user nova-compute[74189]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:19:33 user nova-compute[74189]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:19:33 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.462s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] HCTL ('39', '-', '-', 0) found on session 17 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:33 user nova-compute[74189]: INFO nova.compute.manager [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Took 9.85 seconds to build instance.
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f6f96976-60d8-4402-8412-fee89179f001 tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Lock "28a5eb34-5e63-414b-81d9-12f2b41c699c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.965s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.029s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fcf9ac-2ef7-448e-a631-86c4cd70b45f]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Searching for a device in session 17 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fKgarFiL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-plugged-a96d3bd5-5996-4171-87ef-082bfe44bb78 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] Acquiring lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] No waiting events found dispatching network-vif-plugged-a96d3bd5-5996-4171-87ef-082bfe44bb78 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:19:33 user nova-compute[74189]: WARNING nova.compute.manager [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received unexpected event network-vif-plugged-a96d3bd5-5996-4171-87ef-082bfe44bb78 for instance with vm_state building and task_state spawning.
Oct 25 21:19:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-plugged-f10bc396-91ea-4493-8521-69881612dd9f {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] Acquiring lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] No waiting events found dispatching network-vif-plugged-f10bc396-91ea-4493-8521-69881612dd9f {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:19:33 user nova-compute[74189]: WARNING nova.compute.manager [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received unexpected event network-vif-plugged-f10bc396-91ea-4493-8521-69881612dd9f for instance with vm_state building and task_state spawning.
Oct 25 21:19:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-plugged-f10bc396-91ea-4493-8521-69881612dd9f {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] Acquiring lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] No waiting events found dispatching network-vif-plugged-f10bc396-91ea-4493-8521-69881612dd9f {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:19:33 user nova-compute[74189]: WARNING nova.compute.manager [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received unexpected event network-vif-plugged-f10bc396-91ea-4493-8521-69881612dd9f for instance with vm_state building and task_state spawning.
Oct 25 21:19:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-plugged-3fad83a5-d1c9-43d7-9dbd-16970bbb93b3 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] Acquiring lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] No waiting events found dispatching network-vif-plugged-3fad83a5-d1c9-43d7-9dbd-16970bbb93b3 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:19:33 user nova-compute[74189]: WARNING nova.compute.manager [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received unexpected event network-vif-plugged-3fad83a5-d1c9-43d7-9dbd-16970bbb93b3 for instance with vm_state building and task_state spawning.
Oct 25 21:19:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-plugged-3fad83a5-d1c9-43d7-9dbd-16970bbb93b3 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] Acquiring lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] No waiting events found dispatching network-vif-plugged-3fad83a5-d1c9-43d7-9dbd-16970bbb93b3 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:19:33 user nova-compute[74189]: WARNING nova.compute.manager [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received unexpected event network-vif-plugged-3fad83a5-d1c9-43d7-9dbd-16970bbb93b3 for instance with vm_state building and task_state spawning.
Oct 25 21:19:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-plugged-a918de57-be1e-4ddd-b593-533130578da6 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] Acquiring lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] No waiting events found dispatching network-vif-plugged-a918de57-be1e-4ddd-b593-533130578da6 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:19:33 user nova-compute[74189]: WARNING nova.compute.manager [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received unexpected event network-vif-plugged-a918de57-be1e-4ddd-b593-533130578da6 for instance with vm_state building and task_state spawning.
Oct 25 21:19:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-plugged-a918de57-be1e-4ddd-b593-533130578da6 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] Acquiring lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] No waiting events found dispatching network-vif-plugged-a918de57-be1e-4ddd-b593-533130578da6 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:19:33 user nova-compute[74189]: WARNING nova.compute.manager [req-731c1560-7714-484e-8cf7-5ebea06754d7 req-0ae9b39d-16e6-4220-bd7e-d0adbf9e792b service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received unexpected event network-vif-plugged-a918de57-be1e-4ddd-b593-533130578da6 for instance with vm_state building and task_state spawning.
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:19:33 user nova-compute[74189]: INFO nova.compute.claims [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Claim successful on node user
Oct 25 21:19:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-2947070b-0965-4a7d-b4f2-e370956b4c19 req-bd3eb670-84e6-4413-9ccf-c2a41316b980 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-plugged-81b93608-6fb4-4753-8328-df418f6d3ffe {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2947070b-0965-4a7d-b4f2-e370956b4c19 req-bd3eb670-84e6-4413-9ccf-c2a41316b980 service nova] Acquiring lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2947070b-0965-4a7d-b4f2-e370956b4c19 req-bd3eb670-84e6-4413-9ccf-c2a41316b980 service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2947070b-0965-4a7d-b4f2-e370956b4c19 req-bd3eb670-84e6-4413-9ccf-c2a41316b980 service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-2947070b-0965-4a7d-b4f2-e370956b4c19 req-bd3eb670-84e6-4413-9ccf-c2a41316b980 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] No waiting events found dispatching network-vif-plugged-81b93608-6fb4-4753-8328-df418f6d3ffe {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:19:33 user nova-compute[74189]: WARNING nova.compute.manager [req-2947070b-0965-4a7d-b4f2-e370956b4c19 req-bd3eb670-84e6-4413-9ccf-c2a41316b980 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received unexpected event network-vif-plugged-81b93608-6fb4-4753-8328-df418f6d3ffe for instance with vm_state building and task_state spawning.
Oct 25 21:19:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-2947070b-0965-4a7d-b4f2-e370956b4c19 req-bd3eb670-84e6-4413-9ccf-c2a41316b980 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-plugged-532714b6-a025-43e3-bf7b-87f8159ed408 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2947070b-0965-4a7d-b4f2-e370956b4c19 req-bd3eb670-84e6-4413-9ccf-c2a41316b980 service nova] Acquiring lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2947070b-0965-4a7d-b4f2-e370956b4c19 req-bd3eb670-84e6-4413-9ccf-c2a41316b980 service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2947070b-0965-4a7d-b4f2-e370956b4c19 req-bd3eb670-84e6-4413-9ccf-c2a41316b980 service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-2947070b-0965-4a7d-b4f2-e370956b4c19 req-bd3eb670-84e6-4413-9ccf-c2a41316b980 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] No waiting events found dispatching network-vif-plugged-532714b6-a025-43e3-bf7b-87f8159ed408 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:19:33 user nova-compute[74189]: WARNING nova.compute.manager [req-2947070b-0965-4a7d-b4f2-e370956b4c19 req-bd3eb670-84e6-4413-9ccf-c2a41316b980 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received unexpected event network-vif-plugged-532714b6-a025-43e3-bf7b-87f8159ed408 for instance with vm_state building and task_state spawning.
Oct 25 21:19:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-2947070b-0965-4a7d-b4f2-e370956b4c19 req-bd3eb670-84e6-4413-9ccf-c2a41316b980 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-plugged-532714b6-a025-43e3-bf7b-87f8159ed408 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2947070b-0965-4a7d-b4f2-e370956b4c19 req-bd3eb670-84e6-4413-9ccf-c2a41316b980 service nova] Acquiring lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2947070b-0965-4a7d-b4f2-e370956b4c19 req-bd3eb670-84e6-4413-9ccf-c2a41316b980 service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2947070b-0965-4a7d-b4f2-e370956b4c19 req-bd3eb670-84e6-4413-9ccf-c2a41316b980 service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-2947070b-0965-4a7d-b4f2-e370956b4c19 req-bd3eb670-84e6-4413-9ccf-c2a41316b980 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] No waiting events found dispatching network-vif-plugged-532714b6-a025-43e3-bf7b-87f8159ed408 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:19:33 user nova-compute[74189]: WARNING nova.compute.manager [req-2947070b-0965-4a7d-b4f2-e370956b4c19 req-bd3eb670-84e6-4413-9ccf-c2a41316b980 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received unexpected event network-vif-plugged-532714b6-a025-43e3-bf7b-87f8159ed408 for instance with vm_state building and task_state spawning.
Oct 25 21:19:33 user nova-compute[74189]: INFO nova.compute.resource_tracker [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Updating resource usage from migration e69c91a9-6190-44b8-be8b-aa63f8edf28a
Oct 25 21:19:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.667s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:33 user nova-compute[74189]: INFO nova.compute.manager [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Migrating
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:19:33 user nova-compute[74189]: INFO nova.compute.rpcapi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 25 21:19:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquiring lock "refresh_cache-5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquired lock "refresh_cache-5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG nova.network.neutron [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.527s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] <== connect_volume: return (1529ms) {'type': 'block', 'scsi_wwn': '23733653333316463', 'path': '/dev/sdh'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733653333316463', 'path': '/dev/sdh'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T21:16:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1713435964',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1904014555',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVLWL/l3Vh79OaGgsN5D2te6r87t4qcVR5zA3W/Bg4mTE1zl7sJSoyjbQnhD3AeWV9gsQAwGKkMtvg9ZV6+YMk7vzNB4DgcV0PFaLz2rgjVpHTuxF9n1BWLqiTcunhiVw==',key_name='tempest-keypair-1447510267',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:17:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4aa384e522324f0fa297ca277820909f',ramdisk_id='',reservation_id='r-z4gtu1al',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1192138157',owner_user_name='tempest-ServerActionsV293TestJSON-1192138157-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:19:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df67ddee61b04820b0968636a2eddbed',uuid=a05b75c0-c064-42c5-aca7-c4b07cfabcfb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "address": "fa:16:3e:88:75:56", "network": {"id": "75c09903-d1c6-4197-bc70-cfe7f3e7a772", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1909568880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa384e522324f0fa297ca277820909f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd28e4203-5f", "ovs_interfaceid": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Converting VIF {"id": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "address": "fa:16:3e:88:75:56", "network": {"id": "75c09903-d1c6-4197-bc70-cfe7f3e7a772", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1909568880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa384e522324f0fa297ca277820909f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd28e4203-5f", "ovs_interfaceid": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:75:56,bridge_name='br-int',has_traffic_filtering=True,id=d28e4203-5fff-4a0b-b360-fe29bfa131b8,network=Network(75c09903-d1c6-4197-bc70-cfe7f3e7a772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd28e4203-5f') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:19:34 user nova-compute[74189]:   <uuid>a05b75c0-c064-42c5-aca7-c4b07cfabcfb</uuid>
Oct 25 21:19:34 user nova-compute[74189]:   <name>instance-00000009</name>
Oct 25 21:19:34 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:19:34 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:19:34 user nova-compute[74189]:   <metadata>
Oct 25 21:19:34 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:19:34 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:19:34 user nova-compute[74189]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1713435964</nova:name>
Oct 25 21:19:34 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:19:32</nova:creationTime>
Oct 25 21:19:34 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:19:34 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:19:34 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:19:34 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:19:34 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:19:34 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:19:34 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:19:34 user nova-compute[74189]:       <nova:owner>
Oct 25 21:19:34 user nova-compute[74189]:         <nova:user uuid="df67ddee61b04820b0968636a2eddbed">tempest-ServerActionsV293TestJSON-1192138157-project-member</nova:user>
Oct 25 21:19:34 user nova-compute[74189]:         <nova:project uuid="4aa384e522324f0fa297ca277820909f">tempest-ServerActionsV293TestJSON-1192138157</nova:project>
Oct 25 21:19:34 user nova-compute[74189]:       </nova:owner>
Oct 25 21:19:34 user nova-compute[74189]:       <nova:ports>
Oct 25 21:19:34 user nova-compute[74189]:         <nova:port uuid="d28e4203-5fff-4a0b-b360-fe29bfa131b8">
Oct 25 21:19:34 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 25 21:19:34 user nova-compute[74189]:         </nova:port>
Oct 25 21:19:34 user nova-compute[74189]:       </nova:ports>
Oct 25 21:19:34 user nova-compute[74189]:     </nova:instance>
Oct 25 21:19:34 user nova-compute[74189]:   </metadata>
Oct 25 21:19:34 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:19:34 user nova-compute[74189]:     <system>
Oct 25 21:19:34 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:19:34 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:19:34 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:19:34 user nova-compute[74189]:       <entry name="serial">a05b75c0-c064-42c5-aca7-c4b07cfabcfb</entry>
Oct 25 21:19:34 user nova-compute[74189]:       <entry name="uuid">a05b75c0-c064-42c5-aca7-c4b07cfabcfb</entry>
Oct 25 21:19:34 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:19:34 user nova-compute[74189]:     </system>
Oct 25 21:19:34 user nova-compute[74189]:   </sysinfo>
Oct 25 21:19:34 user nova-compute[74189]:   <os>
Oct 25 21:19:34 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:19:34 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:19:34 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:19:34 user nova-compute[74189]:   </os>
Oct 25 21:19:34 user nova-compute[74189]:   <features>
Oct 25 21:19:34 user nova-compute[74189]:     <acpi/>
Oct 25 21:19:34 user nova-compute[74189]:     <apic/>
Oct 25 21:19:34 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:19:34 user nova-compute[74189]:   </features>
Oct 25 21:19:34 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:19:34 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:19:34 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:19:34 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:19:34 user nova-compute[74189]:   </clock>
Oct 25 21:19:34 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:19:34 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:19:34 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:19:34 user nova-compute[74189]:   </cpu>
Oct 25 21:19:34 user nova-compute[74189]:   <devices>
Oct 25 21:19:34 user nova-compute[74189]:     <disk type="block" device="disk">
Oct 25 21:19:34 user nova-compute[74189]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:19:34 user nova-compute[74189]:       <source dev="/dev/sdh"/>
Oct 25 21:19:34 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:19:34 user nova-compute[74189]:       <serial>e6efe932-902f-41f8-82f4-1773bc305e0e</serial>
Oct 25 21:19:34 user nova-compute[74189]:     </disk>
Oct 25 21:19:34 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:19:34 user nova-compute[74189]:       <mac address="fa:16:3e:88:75:56"/>
Oct 25 21:19:34 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:19:34 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:19:34 user nova-compute[74189]:       <target dev="tapd28e4203-5f"/>
Oct 25 21:19:34 user nova-compute[74189]:     </interface>
Oct 25 21:19:34 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:19:34 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/a05b75c0-c064-42c5-aca7-c4b07cfabcfb/console.log" append="off"/>
Oct 25 21:19:34 user nova-compute[74189]:     </serial>
Oct 25 21:19:34 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:19:34 user nova-compute[74189]:     <video>
Oct 25 21:19:34 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:19:34 user nova-compute[74189]:     </video>
Oct 25 21:19:34 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:19:34 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:19:34 user nova-compute[74189]:     </rng>
Oct 25 21:19:34 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:19:34 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:19:34 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:19:34 user nova-compute[74189]:     </memballoon>
Oct 25 21:19:34 user nova-compute[74189]:   </devices>
Oct 25 21:19:34 user nova-compute[74189]: </domain>
Oct 25 21:19:34 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T21:16:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1713435964',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1904014555',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVLWL/l3Vh79OaGgsN5D2te6r87t4qcVR5zA3W/Bg4mTE1zl7sJSoyjbQnhD3AeWV9gsQAwGKkMtvg9ZV6+YMk7vzNB4DgcV0PFaLz2rgjVpHTuxF9n1BWLqiTcunhiVw==',key_name='tempest-keypair-1447510267',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:17:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4aa384e522324f0fa297ca277820909f',ramdisk_id='',reservation_id='r-z4gtu1al',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1192138157',owner_user_name='tempest-ServerActionsV293TestJSON-1192138157-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:19:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df67ddee61b04820b0968636a2eddbed',uuid=a05b75c0-c064-42c5-aca7-c4b07cfabcfb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "address": "fa:16:3e:88:75:56", "network": {"id": "75c09903-d1c6-4197-bc70-cfe7f3e7a772", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1909568880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa384e522324f0fa297ca277820909f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd28e4203-5f", "ovs_interfaceid": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Converting VIF {"id": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "address": "fa:16:3e:88:75:56", "network": {"id": "75c09903-d1c6-4197-bc70-cfe7f3e7a772", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1909568880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa384e522324f0fa297ca277820909f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd28e4203-5f", "ovs_interfaceid": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:75:56,bridge_name='br-int',has_traffic_filtering=True,id=d28e4203-5fff-4a0b-b360-fe29bfa131b8,network=Network(75c09903-d1c6-4197-bc70-cfe7f3e7a772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd28e4203-5f') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG os_vif [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:75:56,bridge_name='br-int',has_traffic_filtering=True,id=d28e4203-5fff-4a0b-b360-fe29bfa131b8,network=Network(75c09903-d1c6-4197-bc70-cfe7f3e7a772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd28e4203-5f') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e7fc0d96-a22d-5586-abba-8e20fdea4cd6', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd28e4203-5f, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd28e4203-5f, col_values=(('qos', UUID('10eb36c2-e578-401d-a4f9-5aa309fb46de')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd28e4203-5f, col_values=(('external_ids', {'iface-id': 'd28e4203-5fff-4a0b-b360-fe29bfa131b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:75:56', 'vm-uuid': 'a05b75c0-c064-42c5-aca7-c4b07cfabcfb'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:34 user nova-compute[74189]: INFO os_vif [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:75:56,bridge_name='br-int',has_traffic_filtering=True,id=d28e4203-5fff-4a0b-b360-fe29bfa131b8,network=Network(75c09903-d1c6-4197-bc70-cfe7f3e7a772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd28e4203-5f')
Oct 25 21:19:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] No VIF found with MAC fa:16:3e:88:75:56, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG nova.network.neutron [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Updating instance_info_cache with network_info: [{"id": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "address": "fa:16:3e:92:dc:7e", "network": {"id": "197dd483-54ad-4b81-a0d0-26c633b3a101", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1141346509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e426fbc4bb374115a46d927092d62423", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a0280f-de", "ovs_interfaceid": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Releasing lock "refresh_cache-5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Starting migrate_disk_and_power_off {{(pid=74189) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG nova.compute.manager [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:34 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Instance spawned successfully.
Oct 25 21:19:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:35 user nova-compute[74189]: INFO nova.compute.manager [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Took 14.51 seconds to spawn the instance on the hypervisor.
Oct 25 21:19:35 user nova-compute[74189]: DEBUG nova.compute.manager [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:19:35 user nova-compute[74189]: INFO nova.compute.manager [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Took 136.98 seconds to build instance.
Oct 25 21:19:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-54317526-bad4-471f-9c07-ed3ad1f63db2 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Lock "2486ac33-a881-4be1-a24e-2ff263e51818" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 137.092s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-9b11a722-edca-407a-8d83-9e80f9a84e8e req-adba7240-f279-4b96-bc55-08ac1f9af430 service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Received event network-vif-unplugged-c6a0280f-def7-4677-910c-7a3a3c6b57df {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9b11a722-edca-407a-8d83-9e80f9a84e8e req-adba7240-f279-4b96-bc55-08ac1f9af430 service nova] Acquiring lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9b11a722-edca-407a-8d83-9e80f9a84e8e req-adba7240-f279-4b96-bc55-08ac1f9af430 service nova] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9b11a722-edca-407a-8d83-9e80f9a84e8e req-adba7240-f279-4b96-bc55-08ac1f9af430 service nova] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-9b11a722-edca-407a-8d83-9e80f9a84e8e req-adba7240-f279-4b96-bc55-08ac1f9af430 service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] No waiting events found dispatching network-vif-unplugged-c6a0280f-def7-4677-910c-7a3a3c6b57df {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:19:35 user nova-compute[74189]: WARNING nova.compute.manager [req-9b11a722-edca-407a-8d83-9e80f9a84e8e req-adba7240-f279-4b96-bc55-08ac1f9af430 service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Received unexpected event network-vif-unplugged-c6a0280f-def7-4677-910c-7a3a3c6b57df for instance with vm_state active and task_state resize_migrating.
Oct 25 21:19:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:36 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Instance destroyed successfully.
Oct 25 21:19:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:15:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2127723699',display_name='tempest-ServerActionsTestOtherB-server-2127723699',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2127723699',id=3,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjedofMSVtj00tqk1jqFMH5AZ5Pyw9+9WP37zpM0w2hcAIIw4fFannJXo68FjlEI0XSKwz6/AZjg4uhqhEM0AXh7nvdUT82CEMoJ2RGXuMes6AOS513uwlo8CUT17ABSg==',key_name='tempest-keypair-611941333',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:15:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e426fbc4bb374115a46d927092d62423',ramdisk_id='',reservation_id='r-q0q32lk1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-40176194',owner_user_name='tempest-ServerActionsTestOtherB-40176194-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:19:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e81aaad00624abdafe04f6c8de4c5c0',uuid=5d21b93a-b312-4c1b-9e43-ffb4b729c7d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "address": "fa:16:3e:92:dc:7e", "network": {"id": "197dd483-54ad-4b81-a0d0-26c633b3a101", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1141346509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1141346509-network", "vif_mac": "fa:16:3e:92:dc:7e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e426fbc4bb374115a46d927092d62423", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a0280f-de", "ovs_interfaceid": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Converting VIF {"id": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "address": "fa:16:3e:92:dc:7e", "network": {"id": "197dd483-54ad-4b81-a0d0-26c633b3a101", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1141346509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1141346509-network", "vif_mac": "fa:16:3e:92:dc:7e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e426fbc4bb374115a46d927092d62423", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a0280f-de", "ovs_interfaceid": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:dc:7e,bridge_name='br-int',has_traffic_filtering=True,id=c6a0280f-def7-4677-910c-7a3a3c6b57df,network=Network(197dd483-54ad-4b81-a0d0-26c633b3a101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6a0280f-de') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG os_vif [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:dc:7e,bridge_name='br-int',has_traffic_filtering=True,id=c6a0280f-def7-4677-910c-7a3a3c6b57df,network=Network(197dd483-54ad-4b81-a0d0-26c633b3a101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6a0280f-de') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6a0280f-de, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=243d15ca-834d-4483-8fb7-a029cdcb6a1d) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:36 user nova-compute[74189]: INFO os_vif [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:dc:7e,bridge_name='br-int',has_traffic_filtering=True,id=c6a0280f-def7-4677-910c-7a3a3c6b57df,network=Network(197dd483-54ad-4b81-a0d0-26c633b3a101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6a0280f-de')
Oct 25 21:19:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDQlxprB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:19:36 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:19:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[601a980d-bb08-4f78-9589-e23e209647d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:19:36 user nova-compute[74189]: No targets found.
Oct 25 21:19:36 user nova-compute[74189]: iSNS:
Oct 25 21:19:36 user nova-compute[74189]: No targets found.
Oct 25 21:19:36 user nova-compute[74189]: STATIC:
Oct 25 21:19:36 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963
Oct 25 21:19:36 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:19:36 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:19:36 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e
Oct 25 21:19:36 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:19:36 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:19:36 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78
Oct 25 21:19:36 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:19:36 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:19:36 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c
Oct 25 21:19:36 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:19:36 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:19:36 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff
Oct 25 21:19:36 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:19:36 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:19:36 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8
Oct 25 21:19:36 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:19:36 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:19:36 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:19:36 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:19:36 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:19:36 user nova-compute[74189]: FIRMWARE:
Oct 25 21:19:36 user nova-compute[74189]: No targets found.
Oct 25 21:19:36 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:19:36 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:19:36 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fdbb3a-761c-49b8-b32b-8712f66a1b8c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3bf4b0-88f2-46f1-8c1f-4aefa4330e15]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:19:36 user nova-compute[74189]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:19:36 user nova-compute[74189]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)
Oct 25 21:19:36 user nova-compute[74189]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)
Oct 25 21:19:36 user nova-compute[74189]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)
Oct 25 21:19:36 user nova-compute[74189]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:19:36 user nova-compute[74189]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:19:36 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:19:36 user nova-compute[74189]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:19:36 user nova-compute[74189]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)
Oct 25 21:19:36 user nova-compute[74189]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)
Oct 25 21:19:36 user nova-compute[74189]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)
Oct 25 21:19:36 user nova-compute[74189]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:19:36 user nova-compute[74189]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:19:36 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe304480f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78'): ({'sdg'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Removing single pathed devices sdg {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.042s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4feddf0f-cdcc-485f-80c9-30b33525bdd3]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG nova.compute.manager [req-6ef4e109-817a-46fe-8a93-d83f0b821cd1 req-43e1061c-30b8-4640-bd2f-25c602a58fad service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Received event network-vif-plugged-d28e4203-5fff-4a0b-b360-fe29bfa131b8 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-6ef4e109-817a-46fe-8a93-d83f0b821cd1 req-43e1061c-30b8-4640-bd2f-25c602a58fad service nova] Acquiring lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-6ef4e109-817a-46fe-8a93-d83f0b821cd1 req-43e1061c-30b8-4640-bd2f-25c602a58fad service nova] Lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-6ef4e109-817a-46fe-8a93-d83f0b821cd1 req-43e1061c-30b8-4640-bd2f-25c602a58fad service nova] Lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG nova.compute.manager [req-6ef4e109-817a-46fe-8a93-d83f0b821cd1 req-43e1061c-30b8-4640-bd2f-25c602a58fad service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] No waiting events found dispatching network-vif-plugged-d28e4203-5fff-4a0b-b360-fe29bfa131b8 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:19:36 user nova-compute[74189]: WARNING nova.compute.manager [req-6ef4e109-817a-46fe-8a93-d83f0b821cd1 req-43e1061c-30b8-4640-bd2f-25c602a58fad service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Received unexpected event network-vif-plugged-d28e4203-5fff-4a0b-b360-fe29bfa131b8 for instance with vm_state active and task_state rebuild_spawning.
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.028s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[90562ab3-db76-4000-8341-4409fc951c9e]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Flushing IO for device /dev/sdg {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe09352-156e-45d5-87d1-907133e3a20d]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.056s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4065d4db-b2f5-4744-9db4-34eb3eacd942]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] SCSI volumes sdg have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO4b47e875-c28432b3ea80f201', '/dev/disk/by-id/scsi-26332383433326233') {{(pid=85079) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 25 21:19:36 user nova-compute[74189]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO4b47e875-c28432b3ea80f201
Oct 25 21:19:36 user nova-compute[74189]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26332383433326233
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4187e485-21a2-4f0f-b7b0-251dd31a14c9]: (4, None) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12b124a-768f-4ac8-ab48-9790e871cc12]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1e0e8c-659e-46a2-9ff6-88088976da8f]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78, portal: 172.16.0.220,3260]
Oct 25 21:19:36 user nova-compute[74189]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78, portal: 172.16.0.220,3260] successful.
Oct 25 21:19:36 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb8a843-d7ef-4891-be33-66b934d496c2]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.457s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] <== disconnect_volume: return (461ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:19:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json" returned: 0 in 0.393s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:19:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3_resize/disk /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:37 user nova-compute[74189]: DEBUG nova.compute.manager [req-b425fead-a50e-4036-b325-8e1ac0781680 req-8e730b84-6233-4197-9737-3db03a6652aa service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Received event network-vif-plugged-c6a0280f-def7-4677-910c-7a3a3c6b57df {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b425fead-a50e-4036-b325-8e1ac0781680 req-8e730b84-6233-4197-9737-3db03a6652aa service nova] Acquiring lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b425fead-a50e-4036-b325-8e1ac0781680 req-8e730b84-6233-4197-9737-3db03a6652aa service nova] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b425fead-a50e-4036-b325-8e1ac0781680 req-8e730b84-6233-4197-9737-3db03a6652aa service nova] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:37 user nova-compute[74189]: DEBUG nova.compute.manager [req-b425fead-a50e-4036-b325-8e1ac0781680 req-8e730b84-6233-4197-9737-3db03a6652aa service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] No waiting events found dispatching network-vif-plugged-c6a0280f-def7-4677-910c-7a3a3c6b57df {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:19:37 user nova-compute[74189]: WARNING nova.compute.manager [req-b425fead-a50e-4036-b325-8e1ac0781680 req-8e730b84-6233-4197-9737-3db03a6652aa service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Received unexpected event network-vif-plugged-c6a0280f-def7-4677-910c-7a3a3c6b57df for instance with vm_state active and task_state resize_migrating.
Oct 25 21:19:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] CMD "cp -r /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3_resize/disk /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk" returned: 0 in 0.399s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3_resize/disk.info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk.info {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] CMD "cp -r /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3_resize/disk.info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk.info" returned: 0 in 0.036s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:38 user nova-compute[74189]: DEBUG nova.compute.manager [req-4f2a635d-589a-4012-9957-aa0723099718 req-48a2096a-1ebc-4c56-a46c-1f9e1b80f733 service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Received event network-vif-plugged-d28e4203-5fff-4a0b-b360-fe29bfa131b8 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4f2a635d-589a-4012-9957-aa0723099718 req-48a2096a-1ebc-4c56-a46c-1f9e1b80f733 service nova] Acquiring lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4f2a635d-589a-4012-9957-aa0723099718 req-48a2096a-1ebc-4c56-a46c-1f9e1b80f733 service nova] Lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4f2a635d-589a-4012-9957-aa0723099718 req-48a2096a-1ebc-4c56-a46c-1f9e1b80f733 service nova] Lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:38 user nova-compute[74189]: DEBUG nova.compute.manager [req-4f2a635d-589a-4012-9957-aa0723099718 req-48a2096a-1ebc-4c56-a46c-1f9e1b80f733 service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] No waiting events found dispatching network-vif-plugged-d28e4203-5fff-4a0b-b360-fe29bfa131b8 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:19:38 user nova-compute[74189]: WARNING nova.compute.manager [req-4f2a635d-589a-4012-9957-aa0723099718 req-48a2096a-1ebc-4c56-a46c-1f9e1b80f733 service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Received unexpected event network-vif-plugged-d28e4203-5fff-4a0b-b360-fe29bfa131b8 for instance with vm_state active and task_state rebuild_spawning.
Oct 25 21:19:39 user nova-compute[74189]: DEBUG nova.compute.manager [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:19:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:19:39 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Instance spawned successfully.
Oct 25 21:19:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:19:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:19:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:19:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:19:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:19:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:19:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:19:39 user nova-compute[74189]: DEBUG nova.compute.manager [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:19:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:39 user nova-compute[74189]: DEBUG nova.objects.instance [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74189) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 25 21:19:39 user nova-compute[74189]: DEBUG nova.network.neutron [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Port c6a0280f-def7-4677-910c-7a3a3c6b57df binding to destination host user is already ACTIVE {{(pid=74189) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 25 21:19:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d67cc0ea-c789-43b0-94bc-570a9a5f0c8c tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.155s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquiring lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquiring lock "refresh_cache-5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:19:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquired lock "refresh_cache-5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:19:39 user nova-compute[74189]: DEBUG nova.network.neutron [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:19:40 user nova-compute[74189]: DEBUG nova.network.neutron [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Updating instance_info_cache with network_info: [{"id": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "address": "fa:16:3e:92:dc:7e", "network": {"id": "197dd483-54ad-4b81-a0d0-26c633b3a101", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1141346509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e426fbc4bb374115a46d927092d62423", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a0280f-de", "ovs_interfaceid": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:19:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Releasing lock "refresh_cache-5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:19:40 user nova-compute[74189]: DEBUG os_brick.utils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:19:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:40 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[86aaebb5-9419-4361-84e0-3ddc5abeb2ca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:40 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb805433-cd0b-4784-8382-f51f5a2afb26]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:40 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd9c75e-9d74-4bf9-b783-aa16be498b15]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:40 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0722fea4-5cec-43f6-9566-b1170753b52f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:19:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:19:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:19:40 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:19:40 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2035a1ce-e345-4082-b106-cfcb8486d770]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:19:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:19:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:19:40 user nova-compute[74189]: DEBUG os_brick.utils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:19:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-986de0b7-3869-4adf-9d07-7868562a5ebc tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Acquiring lock "e1272f33-ef5e-48e6-912f-e0beae6dde11" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-986de0b7-3869-4adf-9d07-7868562a5ebc tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Lock "e1272f33-ef5e-48e6-912f-e0beae6dde11" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-986de0b7-3869-4adf-9d07-7868562a5ebc tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Acquiring lock "e1272f33-ef5e-48e6-912f-e0beae6dde11-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-986de0b7-3869-4adf-9d07-7868562a5ebc tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Lock "e1272f33-ef5e-48e6-912f-e0beae6dde11-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-986de0b7-3869-4adf-9d07-7868562a5ebc tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Lock "e1272f33-ef5e-48e6-912f-e0beae6dde11-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:42 user nova-compute[74189]: INFO nova.compute.manager [None req-986de0b7-3869-4adf-9d07-7868562a5ebc tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Terminating instance
Oct 25 21:19:42 user nova-compute[74189]: DEBUG nova.compute.manager [None req-986de0b7-3869-4adf-9d07-7868562a5ebc tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:19:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:43 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f52fc510-3640-468a-8a9c-b716b9d17a01 is timed out.
Oct 25 21:19:43 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Successfully detached device vdb from instance f52fc510-3640-468a-8a9c-b716b9d17a01 from the live domain config.
Oct 25 21:19:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ykUomIYH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': 'e07f2603-8906-4cb9-975e-5ac25a051963'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:19:43 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:19:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03e825a-b0f7-402a-bc2b-ac1333b93243]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:19:43 user nova-compute[74189]: No targets found.
Oct 25 21:19:43 user nova-compute[74189]: iSNS:
Oct 25 21:19:43 user nova-compute[74189]: No targets found.
Oct 25 21:19:43 user nova-compute[74189]: STATIC:
Oct 25 21:19:43 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963
Oct 25 21:19:43 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:19:43 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:19:43 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e
Oct 25 21:19:43 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:19:43 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:19:43 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c
Oct 25 21:19:43 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:19:43 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:19:43 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff
Oct 25 21:19:43 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:19:43 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:19:43 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8
Oct 25 21:19:43 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:19:43 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:19:43 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:19:43 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:19:43 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:19:43 user nova-compute[74189]: FIRMWARE:
Oct 25 21:19:43 user nova-compute[74189]: No targets found.
Oct 25 21:19:43 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:19:43 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:19:43 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[90501519-fea0-4687-aac0-543747706284]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[84280c97-ee1e-4e74-926b-ceae6efbb3f0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:19:43 user nova-compute[74189]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:19:43 user nova-compute[74189]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)
Oct 25 21:19:43 user nova-compute[74189]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)
Oct 25 21:19:43 user nova-compute[74189]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)
Oct 25 21:19:43 user nova-compute[74189]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:19:43 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:19:43 user nova-compute[74189]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 (non-flash)
Oct 25 21:19:43 user nova-compute[74189]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)
Oct 25 21:19:43 user nova-compute[74189]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)
Oct 25 21:19:43 user nova-compute[74189]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)
Oct 25 21:19:43 user nova-compute[74189]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:19:43 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3041920e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963'): ({'sde'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Removing single pathed devices sde {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76c2c36-e365-4741-9547-4ee64ce1b6a4]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG nova.compute.manager [req-31f228b4-9555-4f79-956b-ff6ef453d67c req-b7f882cd-584e-402c-ac3e-28be05b20ddf service nova] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Received event network-vif-unplugged-ad8e4120-613d-45c1-b25e-63ee1ed052d9 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-31f228b4-9555-4f79-956b-ff6ef453d67c req-b7f882cd-584e-402c-ac3e-28be05b20ddf service nova] Acquiring lock "e1272f33-ef5e-48e6-912f-e0beae6dde11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-31f228b4-9555-4f79-956b-ff6ef453d67c req-b7f882cd-584e-402c-ac3e-28be05b20ddf service nova] Lock "e1272f33-ef5e-48e6-912f-e0beae6dde11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-31f228b4-9555-4f79-956b-ff6ef453d67c req-b7f882cd-584e-402c-ac3e-28be05b20ddf service nova] Lock "e1272f33-ef5e-48e6-912f-e0beae6dde11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG nova.compute.manager [req-31f228b4-9555-4f79-956b-ff6ef453d67c req-b7f882cd-584e-402c-ac3e-28be05b20ddf service nova] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] No waiting events found dispatching network-vif-unplugged-ad8e4120-613d-45c1-b25e-63ee1ed052d9 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG nova.compute.manager [req-31f228b4-9555-4f79-956b-ff6ef453d67c req-b7f882cd-584e-402c-ac3e-28be05b20ddf service nova] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Received event network-vif-unplugged-ad8e4120-613d-45c1-b25e-63ee1ed052d9 for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.051s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15d454c-973b-403e-85a0-831fb109dc1a]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Flushing IO for device /dev/sde {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[54462080-9acd-4932-816a-adaba47c80d5]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[219fddeb-4b72-40b4-89d8-09c8ec34c1e0]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] SCSI volumes sde have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e66b466-0405-47d1-98d2-ec3efb3d4b17]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --logout" returned: 0 in 0.167s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[56014c4c-a5b7-4ef1-ae8d-cfafdb84485f]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963, portal: 172.16.0.220,3260]
Oct 25 21:19:43 user nova-compute[74189]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963, portal: 172.16.0.220,3260] successful.
Oct 25 21:19:43 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07f2603-8906-4cb9-975e-5ac25a051963 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98a6754-b569-45f6-8f56-46e009593f15]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.539s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] <== disconnect_volume: return (540ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:19:43 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Instance destroyed successfully.
Oct 25 21:19:43 user nova-compute[74189]: DEBUG nova.objects.instance [None req-986de0b7-3869-4adf-9d07-7868562a5ebc tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Lazy-loading 'resources' on Instance uuid e1272f33-ef5e-48e6-912f-e0beae6dde11 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-986de0b7-3869-4adf-9d07-7868562a5ebc tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:15:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1234970439',display_name='tempest-VolumesAssistedSnapshotsTest-server-1234970439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1234970439',id=8,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSGIHoF/6n7L84xa+oreHnlIlSd/eZUSS35ohRf3ewDruld1xoPkfMt9xG3K3ZDOu7wP97HRATeRjig5gsLDP7M/e/UOp6/7xRTtBPUozRo/MHSvGY8NcW4dfW0SD183w==',key_name='tempest-keypair-42847081',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:15:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b22e5790c544d08ba63bf8f2eeb425b',ramdisk_id='',reservation_id='r-ms0915ec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-123079009',owner_user_name='tempest-VolumesAssistedSnapshotsTest-123079009-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:15:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6595fd7dc5c54e2d9e6ba26a38a03180',uuid=e1272f33-ef5e-48e6-912f-e0beae6dde11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad8e4120-613d-45c1-b25e-63ee1ed052d9", "address": "fa:16:3e:33:77:40", "network": {"id": "a4d0bc71-5f07-4a91-8ea3-627594c5f0d2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1082591514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b22e5790c544d08ba63bf8f2eeb425b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8e4120-61", "ovs_interfaceid": "ad8e4120-613d-45c1-b25e-63ee1ed052d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-986de0b7-3869-4adf-9d07-7868562a5ebc tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Converting VIF {"id": "ad8e4120-613d-45c1-b25e-63ee1ed052d9", "address": "fa:16:3e:33:77:40", "network": {"id": "a4d0bc71-5f07-4a91-8ea3-627594c5f0d2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1082591514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b22e5790c544d08ba63bf8f2eeb425b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8e4120-61", "ovs_interfaceid": "ad8e4120-613d-45c1-b25e-63ee1ed052d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-986de0b7-3869-4adf-9d07-7868562a5ebc tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:77:40,bridge_name='br-int',has_traffic_filtering=True,id=ad8e4120-613d-45c1-b25e-63ee1ed052d9,network=Network(a4d0bc71-5f07-4a91-8ea3-627594c5f0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad8e4120-61') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG os_vif [None req-986de0b7-3869-4adf-9d07-7868562a5ebc tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:77:40,bridge_name='br-int',has_traffic_filtering=True,id=ad8e4120-613d-45c1-b25e-63ee1ed052d9,network=Network(a4d0bc71-5f07-4a91-8ea3-627594c5f0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad8e4120-61') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad8e4120-61, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ec019caf-d574-4916-b868-bc2d4613c5f9) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:43 user nova-compute[74189]: INFO os_vif [None req-986de0b7-3869-4adf-9d07-7868562a5ebc tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:77:40,bridge_name='br-int',has_traffic_filtering=True,id=ad8e4120-613d-45c1-b25e-63ee1ed052d9,network=Network(a4d0bc71-5f07-4a91-8ea3-627594c5f0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad8e4120-61')
Oct 25 21:19:43 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-986de0b7-3869-4adf-9d07-7868562a5ebc tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Deleting instance files /opt/stack/data/nova/instances/e1272f33-ef5e-48e6-912f-e0beae6dde11_del
Oct 25 21:19:43 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-986de0b7-3869-4adf-9d07-7868562a5ebc tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Deletion of /opt/stack/data/nova/instances/e1272f33-ef5e-48e6-912f-e0beae6dde11_del complete
Oct 25 21:19:43 user nova-compute[74189]: INFO nova.compute.manager [None req-986de0b7-3869-4adf-9d07-7868562a5ebc tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Took 1.05 seconds to destroy the instance on the hypervisor.
Oct 25 21:19:43 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-986de0b7-3869-4adf-9d07-7868562a5ebc tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:19:43 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:19:44 user nova-compute[74189]: DEBUG nova.objects.instance [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Lazy-loading 'flavor' on Instance uuid f52fc510-3640-468a-8a9c-b716b9d17a01 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:19:44 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-29919a14-cd30-4572-ad4f-45e132d8aaa5 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Lock "f52fc510-3640-468a-8a9c-b716b9d17a01" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.277s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:45 user nova-compute[74189]: DEBUG nova.compute.manager [req-1c45e9e2-9859-49bd-b2f4-900e897506ad req-18064d76-ff83-45f0-bf8b-98cb8284e3b5 service nova] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Received event network-vif-plugged-ad8e4120-613d-45c1-b25e-63ee1ed052d9 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1c45e9e2-9859-49bd-b2f4-900e897506ad req-18064d76-ff83-45f0-bf8b-98cb8284e3b5 service nova] Acquiring lock "e1272f33-ef5e-48e6-912f-e0beae6dde11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1c45e9e2-9859-49bd-b2f4-900e897506ad req-18064d76-ff83-45f0-bf8b-98cb8284e3b5 service nova] Lock "e1272f33-ef5e-48e6-912f-e0beae6dde11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1c45e9e2-9859-49bd-b2f4-900e897506ad req-18064d76-ff83-45f0-bf8b-98cb8284e3b5 service nova] Lock "e1272f33-ef5e-48e6-912f-e0beae6dde11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:45 user nova-compute[74189]: DEBUG nova.compute.manager [req-1c45e9e2-9859-49bd-b2f4-900e897506ad req-18064d76-ff83-45f0-bf8b-98cb8284e3b5 service nova] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] No waiting events found dispatching network-vif-plugged-ad8e4120-613d-45c1-b25e-63ee1ed052d9 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:19:45 user nova-compute[74189]: WARNING nova.compute.manager [req-1c45e9e2-9859-49bd-b2f4-900e897506ad req-18064d76-ff83-45f0-bf8b-98cb8284e3b5 service nova] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Received unexpected event network-vif-plugged-ad8e4120-613d-45c1-b25e-63ee1ed052d9 for instance with vm_state active and task_state deleting.
Oct 25 21:19:45 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:19:45 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Took 1.59 seconds to deallocate network for instance.
Oct 25 21:19:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-986de0b7-3869-4adf-9d07-7868562a5ebc tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-986de0b7-3869-4adf-9d07-7868562a5ebc tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:45 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-986de0b7-3869-4adf-9d07-7868562a5ebc tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:19:45 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-986de0b7-3869-4adf-9d07-7868562a5ebc tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:19:46 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-986de0b7-3869-4adf-9d07-7868562a5ebc tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.485s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:46 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-986de0b7-3869-4adf-9d07-7868562a5ebc tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Deleted allocations for instance e1272f33-ef5e-48e6-912f-e0beae6dde11
Oct 25 21:19:46 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-986de0b7-3869-4adf-9d07-7868562a5ebc tempest-VolumesAssistedSnapshotsTest-123079009 tempest-VolumesAssistedSnapshotsTest-123079009-project-member] Lock "e1272f33-ef5e-48e6-912f-e0beae6dde11" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.365s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:47 user nova-compute[74189]: DEBUG nova.compute.manager [req-faed3564-55d5-45b7-b128-01423d8086fa req-67173625-0617-4c61-bae3-d83041dbd45d service nova] [instance: e1272f33-ef5e-48e6-912f-e0beae6dde11] Received event network-vif-deleted-ad8e4120-613d-45c1-b25e-63ee1ed052d9 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:52 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:53 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-699d2fda-4587-40c9-8854-4d28d659721d tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Acquiring lock "ea8d22c5-3868-43d1-b101-c6cff480dea6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-699d2fda-4587-40c9-8854-4d28d659721d tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lock "ea8d22c5-3868-43d1-b101-c6cff480dea6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-699d2fda-4587-40c9-8854-4d28d659721d tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Acquiring lock "ea8d22c5-3868-43d1-b101-c6cff480dea6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-699d2fda-4587-40c9-8854-4d28d659721d tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lock "ea8d22c5-3868-43d1-b101-c6cff480dea6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-699d2fda-4587-40c9-8854-4d28d659721d tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lock "ea8d22c5-3868-43d1-b101-c6cff480dea6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:55 user nova-compute[74189]: INFO nova.compute.manager [None req-699d2fda-4587-40c9-8854-4d28d659721d tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Terminating instance
Oct 25 21:19:55 user nova-compute[74189]: DEBUG nova.compute.manager [None req-699d2fda-4587-40c9-8854-4d28d659721d tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:19:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:55 user nova-compute[74189]: DEBUG nova.compute.manager [req-f87caa0e-6954-4a5d-b2de-64846a7f06ae req-18f1492c-41fa-40b7-bb6c-dd3a529d1dc5 service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Received event network-vif-unplugged-a151161f-1633-405f-ac74-9f379531d89a {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f87caa0e-6954-4a5d-b2de-64846a7f06ae req-18f1492c-41fa-40b7-bb6c-dd3a529d1dc5 service nova] Acquiring lock "ea8d22c5-3868-43d1-b101-c6cff480dea6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f87caa0e-6954-4a5d-b2de-64846a7f06ae req-18f1492c-41fa-40b7-bb6c-dd3a529d1dc5 service nova] Lock "ea8d22c5-3868-43d1-b101-c6cff480dea6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f87caa0e-6954-4a5d-b2de-64846a7f06ae req-18f1492c-41fa-40b7-bb6c-dd3a529d1dc5 service nova] Lock "ea8d22c5-3868-43d1-b101-c6cff480dea6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:55 user nova-compute[74189]: DEBUG nova.compute.manager [req-f87caa0e-6954-4a5d-b2de-64846a7f06ae req-18f1492c-41fa-40b7-bb6c-dd3a529d1dc5 service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] No waiting events found dispatching network-vif-unplugged-a151161f-1633-405f-ac74-9f379531d89a {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:19:55 user nova-compute[74189]: DEBUG nova.compute.manager [req-f87caa0e-6954-4a5d-b2de-64846a7f06ae req-18f1492c-41fa-40b7-bb6c-dd3a529d1dc5 service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Received event network-vif-unplugged-a151161f-1633-405f-ac74-9f379531d89a for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:19:56 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Instance destroyed successfully.
Oct 25 21:19:56 user nova-compute[74189]: DEBUG nova.objects.instance [None req-699d2fda-4587-40c9-8854-4d28d659721d tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lazy-loading 'resources' on Instance uuid ea8d22c5-3868-43d1-b101-c6cff480dea6 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:19:56 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-699d2fda-4587-40c9-8854-4d28d659721d tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-781387297',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-781387297',id=6,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHJgDbw7K7bwNJyj3WQeM4O7X1T/XxzeuPN+AM4eJ62yayGmYQQS1OGbI1fYrJusZqdcuogdpmdUBe6qoNmEvj36GKw2Ywp/JElU+pyp8QCNHY9uIrm3I9Zf5tuFbEg3Q==',key_name='tempest-keypair-159731972',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:15:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d6d05f10a0647e9a014e78f2a7dab78',ramdisk_id='',reservation_id='r-oi1337uc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1187636517',owner_user_name='tempest-TaggedAttachmentsTest-1187636517-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:15:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a147e32cb7fd45aaa1398a1332e6956a',uuid=ea8d22c5-3868-43d1-b101-c6cff480dea6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a151161f-1633-405f-ac74-9f379531d89a", "address": "fa:16:3e:63:71:94", "network": {"id": "62a86fdc-b28d-442a-9d62-0c3286ad0abb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1182690237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6d05f10a0647e9a014e78f2a7dab78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa151161f-16", "ovs_interfaceid": "a151161f-1633-405f-ac74-9f379531d89a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:19:56 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-699d2fda-4587-40c9-8854-4d28d659721d tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Converting VIF {"id": "a151161f-1633-405f-ac74-9f379531d89a", "address": "fa:16:3e:63:71:94", "network": {"id": "62a86fdc-b28d-442a-9d62-0c3286ad0abb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1182690237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6d05f10a0647e9a014e78f2a7dab78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa151161f-16", "ovs_interfaceid": "a151161f-1633-405f-ac74-9f379531d89a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:19:56 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-699d2fda-4587-40c9-8854-4d28d659721d tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:71:94,bridge_name='br-int',has_traffic_filtering=True,id=a151161f-1633-405f-ac74-9f379531d89a,network=Network(62a86fdc-b28d-442a-9d62-0c3286ad0abb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa151161f-16') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:19:56 user nova-compute[74189]: DEBUG os_vif [None req-699d2fda-4587-40c9-8854-4d28d659721d tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:71:94,bridge_name='br-int',has_traffic_filtering=True,id=a151161f-1633-405f-ac74-9f379531d89a,network=Network(62a86fdc-b28d-442a-9d62-0c3286ad0abb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa151161f-16') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:19:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa151161f-16, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:19:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d368cd3a-403e-41d4-982b-920332245cdd) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:19:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:19:56 user nova-compute[74189]: INFO os_vif [None req-699d2fda-4587-40c9-8854-4d28d659721d tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:71:94,bridge_name='br-int',has_traffic_filtering=True,id=a151161f-1633-405f-ac74-9f379531d89a,network=Network(62a86fdc-b28d-442a-9d62-0c3286ad0abb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa151161f-16')
Oct 25 21:19:56 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-699d2fda-4587-40c9-8854-4d28d659721d tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Deleting instance files /opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6_del
Oct 25 21:19:56 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-699d2fda-4587-40c9-8854-4d28d659721d tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Deletion of /opt/stack/data/nova/instances/ea8d22c5-3868-43d1-b101-c6cff480dea6_del complete
Oct 25 21:19:56 user nova-compute[74189]: INFO nova.compute.manager [None req-699d2fda-4587-40c9-8854-4d28d659721d tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 25 21:19:56 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-699d2fda-4587-40c9-8854-4d28d659721d tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:19:56 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:19:56 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:19:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:57 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:19:57 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Took 1.32 seconds to deallocate network for instance.
Oct 25 21:19:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-4a84bde5-52d1-42d1-a62a-49785d1b144f req-250d5009-2ce6-4a72-83c1-02ac1cfa1357 service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Received event network-vif-deleted-a151161f-1633-405f-ac74-9f379531d89a {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:57 user nova-compute[74189]: INFO nova.compute.manager [req-4a84bde5-52d1-42d1-a62a-49785d1b144f req-250d5009-2ce6-4a72-83c1-02ac1cfa1357 service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Neutron deleted interface a151161f-1633-405f-ac74-9f379531d89a; detaching it from the instance and deleting it from the info cache
Oct 25 21:19:57 user nova-compute[74189]: DEBUG nova.network.neutron [req-4a84bde5-52d1-42d1-a62a-49785d1b144f req-250d5009-2ce6-4a72-83c1-02ac1cfa1357 service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:19:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-4a84bde5-52d1-42d1-a62a-49785d1b144f req-250d5009-2ce6-4a72-83c1-02ac1cfa1357 service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Detach interface failed, port_id=a151161f-1633-405f-ac74-9f379531d89a, reason: Instance ea8d22c5-3868-43d1-b101-c6cff480dea6 could not be found. {{(pid=74189) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 21:19:58 user nova-compute[74189]: DEBUG nova.compute.manager [req-85c3df79-4e26-458b-aa7c-e2749621ad2e req-2b027bb7-629a-4087-9b47-285fa2da196b service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Received event network-vif-plugged-a151161f-1633-405f-ac74-9f379531d89a {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:19:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-85c3df79-4e26-458b-aa7c-e2749621ad2e req-2b027bb7-629a-4087-9b47-285fa2da196b service nova] Acquiring lock "ea8d22c5-3868-43d1-b101-c6cff480dea6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-85c3df79-4e26-458b-aa7c-e2749621ad2e req-2b027bb7-629a-4087-9b47-285fa2da196b service nova] Lock "ea8d22c5-3868-43d1-b101-c6cff480dea6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-85c3df79-4e26-458b-aa7c-e2749621ad2e req-2b027bb7-629a-4087-9b47-285fa2da196b service nova] Lock "ea8d22c5-3868-43d1-b101-c6cff480dea6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:58 user nova-compute[74189]: DEBUG nova.compute.manager [req-85c3df79-4e26-458b-aa7c-e2749621ad2e req-2b027bb7-629a-4087-9b47-285fa2da196b service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] No waiting events found dispatching network-vif-plugged-a151161f-1633-405f-ac74-9f379531d89a {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:19:58 user nova-compute[74189]: WARNING nova.compute.manager [req-85c3df79-4e26-458b-aa7c-e2749621ad2e req-2b027bb7-629a-4087-9b47-285fa2da196b service nova] [instance: ea8d22c5-3868-43d1-b101-c6cff480dea6] Received unexpected event network-vif-plugged-a151161f-1633-405f-ac74-9f379531d89a for instance with vm_state active and task_state deleting.
Oct 25 21:19:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-699d2fda-4587-40c9-8854-4d28d659721d tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-699d2fda-4587-40c9-8854-4d28d659721d tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:58 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-699d2fda-4587-40c9-8854-4d28d659721d tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:19:58 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-699d2fda-4587-40c9-8854-4d28d659721d tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:19:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-699d2fda-4587-40c9-8854-4d28d659721d tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.441s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:58 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-699d2fda-4587-40c9-8854-4d28d659721d tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Deleted allocations for instance ea8d22c5-3868-43d1-b101-c6cff480dea6
Oct 25 21:19:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-699d2fda-4587-40c9-8854-4d28d659721d tempest-TaggedAttachmentsTest-1187636517 tempest-TaggedAttachmentsTest-1187636517-project-member] Lock "ea8d22c5-3868-43d1-b101-c6cff480dea6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.964s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:59 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:19:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:19:59 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:19:59 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:19:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:19:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:19:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:19:59 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:20:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:20:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:20:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:20:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:20:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52fc510-3640-468a-8a9c-b716b9d17a01/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52fc510-3640-468a-8a9c-b716b9d17a01/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52fc510-3640-468a-8a9c-b716b9d17a01/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52fc510-3640-468a-8a9c-b716b9d17a01/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a5eb34-5e63-414b-81d9-12f2b41c699c/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a5eb34-5e63-414b-81d9-12f2b41c699c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a5eb34-5e63-414b-81d9-12f2b41c699c/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a5eb34-5e63-414b-81d9-12f2b41c699c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:02 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:20:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:02 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:20:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c05f317d-c6ea-4755-a9c7-42b90974ef1d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c05f317d-c6ea-4755-a9c7-42b90974ef1d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c05f317d-c6ea-4755-a9c7-42b90974ef1d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c05f317d-c6ea-4755-a9c7-42b90974ef1d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:03 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:20:03 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:20:03 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=7487MB free_disk=25.444259643554688GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:20:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:03 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Applying migration context for instance 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3 as it has an incoming, in-progress migration e69c91a9-6190-44b8-be8b-aa63f8edf28a. Migration status is post-migrating {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 25 21:20:03 user nova-compute[74189]: INFO nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Updating resource usage from migration e69c91a9-6190-44b8-be8b-aa63f8edf28a
Oct 25 21:20:03 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance d7c3a99a-ab38-4e88-896d-94ae51a09a48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:20:03 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance c69c0800-7a6c-4155-9f90-bbcd323276d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:20:03 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance f52fc510-3640-468a-8a9c-b716b9d17a01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:20:03 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance a05b75c0-c064-42c5-aca7-c4b07cfabcfb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:20:03 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 2486ac33-a881-4be1-a24e-2ff263e51818 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:20:03 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance af1d7b3c-9950-4b74-8f15-b31011ccfa24 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:20:03 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance c05f317d-c6ea-4755-a9c7-42b90974ef1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:20:03 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:20:03 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 28a5eb34-5e63-414b-81d9-12f2b41c699c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:20:03 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Migration e69c91a9-6190-44b8-be8b-aa63f8edf28a is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 25 21:20:03 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:20:03 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:20:03 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:20:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Starting finish_migration {{(pid=74189) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 25 21:20:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Instance directory exists: not creating {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 21:20:03 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Creating image(s)
Oct 25 21:20:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.593s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.181s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk. size=21474836480 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk 21474836480 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk 21474836480" returned: 0 in 0.050s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Did not create local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Ensure instance console log exists: /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Start _get_guest_xml network_info=[{"id": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "address": "fa:16:3e:92:dc:7e", "network": {"id": "197dd483-54ad-4b81-a0d0-26c633b3a101", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1141346509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1141346509-network", "vif_mac": "fa:16:3e:92:dc:7e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e426fbc4bb374115a46d927092d62423", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a0280f-de", "ovs_interfaceid": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDQlxprB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '5d21b93a-b312-4c1b-9e43-ffb4b729c7d3', 'attached_at': '2023-10-25T21:20:03.000000', 'detached_at': '', 'volume_id': 'baed35ad-5534-47eb-93f6-2393d45d9e78', 'serial': 'baed35ad-5534-47eb-93f6-2393d45d9e78'}, 'attachment_id': 'de8c5e02-a762-4023-a34b-f9c3373b1e41', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:20:04 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:20:04 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:20:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDQlxprB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:20:04 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:20:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:20:04 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:20:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:20:04 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5171e5c-eb67-4c71-9aad-7a8e3311a08f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:20:04 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[320f6532-fac0-48d3-bf18-2174df000ac6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78] added
Oct 25 21:20:04 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf7f9cb-b6ab-4d45-a758-f0f7c758b7c5]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d2c99c-5c06-4d6c-bd63-d0d94f0cd1e8]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CDQlxprB {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CDQlxprB" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36783b1-d974-43b0-8085-e9c33b524c5e]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CDQlxprB'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eec1681-3d71-4b1b-830b-b9ed1f114b32]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[14eab009-3642-45b8-81fa-579fcd722ab3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:20:04 user nova-compute[74189]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)
Oct 25 21:20:04 user nova-compute[74189]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)
Oct 25 21:20:04 user nova-compute[74189]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)
Oct 25 21:20:04 user nova-compute[74189]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:20:04 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:20:04 user nova-compute[74189]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)
Oct 25 21:20:04 user nova-compute[74189]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)
Oct 25 21:20:04 user nova-compute[74189]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)
Oct 25 21:20:04 user nova-compute[74189]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:20:04 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[30663cc6-ba24-4141-beea-6cccb9f82b8d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78, portal: 172.16.0.220,3260]
Oct 25 21:20:04 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78, portal: 172.16.0.220,3260] successful.
Oct 25 21:20:04 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d170971-c230-45ad-a3e9-b33d7048f2a0]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3e88d9-9c6c-4561-806a-1891f8b42be9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:20:04 user nova-compute[74189]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)
Oct 25 21:20:04 user nova-compute[74189]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)
Oct 25 21:20:04 user nova-compute[74189]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)
Oct 25 21:20:04 user nova-compute[74189]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:20:04 user nova-compute[74189]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:20:04 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:20:04 user nova-compute[74189]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)
Oct 25 21:20:04 user nova-compute[74189]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)
Oct 25 21:20:04 user nova-compute[74189]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)
Oct 25 21:20:04 user nova-compute[74189]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:20:04 user nova-compute[74189]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:20:04 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] HCTL ('36', '-', '-', 0) found on session 18 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a3e5eb-7d02-4d9b-8a11-6b7672326a55]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:20:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDQlxprB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-f52fc510-3640-468a-8a9c-b716b9d17a01" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-f52fc510-3640-468a-8a9c-b716b9d17a01" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Updating instance_info_cache with network_info: [{"id": "dd205313-c8a4-433d-8271-6abe9cf77ede", "address": "fa:16:3e:50:6e:57", "network": {"id": "10a55176-55d4-4629-890b-4de824ceda02", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1760980393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea3ea66cfd844c37bcc97a430f2eee69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd205313-c8", "ovs_interfaceid": "dd205313-c8a4-433d-8271-6abe9cf77ede", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-f52fc510-3640-468a-8a9c-b716b9d17a01" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '26332383433326233', 'path': '/dev/sde'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332383433326233', 'path': '/dev/sde'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:15:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2127723699',display_name='tempest-ServerActionsTestOtherB-server-2127723699',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2127723699',id=3,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjedofMSVtj00tqk1jqFMH5AZ5Pyw9+9WP37zpM0w2hcAIIw4fFannJXo68FjlEI0XSKwz6/AZjg4uhqhEM0AXh7nvdUT82CEMoJ2RGXuMes6AOS513uwlo8CUT17ABSg==',key_name='tempest-keypair-611941333',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:15:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e426fbc4bb374115a46d927092d62423',ramdisk_id='',reservation_id='r-q0q32lk1',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-40176194',owner_user_name='tempest-ServerActionsTestOtherB-40176194-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:19:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e81aaad00624abdafe04f6c8de4c5c0',uuid=5d21b93a-b312-4c1b-9e43-ffb4b729c7d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "address": "fa:16:3e:92:dc:7e", "network": {"id": "197dd483-54ad-4b81-a0d0-26c633b3a101", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1141346509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1141346509-network", "vif_mac": "fa:16:3e:92:dc:7e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e426fbc4bb374115a46d927092d62423", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a0280f-de", "ovs_interfaceid": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Converting VIF {"id": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "address": "fa:16:3e:92:dc:7e", "network": {"id": "197dd483-54ad-4b81-a0d0-26c633b3a101", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1141346509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1141346509-network", "vif_mac": "fa:16:3e:92:dc:7e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e426fbc4bb374115a46d927092d62423", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a0280f-de", "ovs_interfaceid": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:dc:7e,bridge_name='br-int',has_traffic_filtering=True,id=c6a0280f-def7-4677-910c-7a3a3c6b57df,network=Network(197dd483-54ad-4b81-a0d0-26c633b3a101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6a0280f-de') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:20:05 user nova-compute[74189]:   <uuid>5d21b93a-b312-4c1b-9e43-ffb4b729c7d3</uuid>
Oct 25 21:20:05 user nova-compute[74189]:   <name>instance-00000003</name>
Oct 25 21:20:05 user nova-compute[74189]:   <memory>2097152</memory>
Oct 25 21:20:05 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:20:05 user nova-compute[74189]:   <metadata>
Oct 25 21:20:05 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:20:05 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:20:05 user nova-compute[74189]:       <nova:name>tempest-ServerActionsTestOtherB-server-2127723699</nova:name>
Oct 25 21:20:05 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:20:04</nova:creationTime>
Oct 25 21:20:05 user nova-compute[74189]:       <nova:flavor name="m1.small">
Oct 25 21:20:05 user nova-compute[74189]:         <nova:memory>2048</nova:memory>
Oct 25 21:20:05 user nova-compute[74189]:         <nova:disk>20</nova:disk>
Oct 25 21:20:05 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:20:05 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:20:05 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:20:05 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:20:05 user nova-compute[74189]:       <nova:owner>
Oct 25 21:20:05 user nova-compute[74189]:         <nova:user uuid="7e81aaad00624abdafe04f6c8de4c5c0">tempest-ServerActionsTestOtherB-40176194-project-member</nova:user>
Oct 25 21:20:05 user nova-compute[74189]:         <nova:project uuid="e426fbc4bb374115a46d927092d62423">tempest-ServerActionsTestOtherB-40176194</nova:project>
Oct 25 21:20:05 user nova-compute[74189]:       </nova:owner>
Oct 25 21:20:05 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:20:05 user nova-compute[74189]:       <nova:ports>
Oct 25 21:20:05 user nova-compute[74189]:         <nova:port uuid="c6a0280f-def7-4677-910c-7a3a3c6b57df">
Oct 25 21:20:05 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 25 21:20:05 user nova-compute[74189]:         </nova:port>
Oct 25 21:20:05 user nova-compute[74189]:       </nova:ports>
Oct 25 21:20:05 user nova-compute[74189]:     </nova:instance>
Oct 25 21:20:05 user nova-compute[74189]:   </metadata>
Oct 25 21:20:05 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:20:05 user nova-compute[74189]:     <system>
Oct 25 21:20:05 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:20:05 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:20:05 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:20:05 user nova-compute[74189]:       <entry name="serial">5d21b93a-b312-4c1b-9e43-ffb4b729c7d3</entry>
Oct 25 21:20:05 user nova-compute[74189]:       <entry name="uuid">5d21b93a-b312-4c1b-9e43-ffb4b729c7d3</entry>
Oct 25 21:20:05 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:20:05 user nova-compute[74189]:     </system>
Oct 25 21:20:05 user nova-compute[74189]:   </sysinfo>
Oct 25 21:20:05 user nova-compute[74189]:   <os>
Oct 25 21:20:05 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:20:05 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:20:05 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:20:05 user nova-compute[74189]:   </os>
Oct 25 21:20:05 user nova-compute[74189]:   <features>
Oct 25 21:20:05 user nova-compute[74189]:     <acpi/>
Oct 25 21:20:05 user nova-compute[74189]:     <apic/>
Oct 25 21:20:05 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:20:05 user nova-compute[74189]:   </features>
Oct 25 21:20:05 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:20:05 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:20:05 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:20:05 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:20:05 user nova-compute[74189]:   </clock>
Oct 25 21:20:05 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:20:05 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:20:05 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:20:05 user nova-compute[74189]:   </cpu>
Oct 25 21:20:05 user nova-compute[74189]:   <devices>
Oct 25 21:20:05 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:20:05 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:20:05 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk"/>
Oct 25 21:20:05 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:20:05 user nova-compute[74189]:     </disk>
Oct 25 21:20:05 user nova-compute[74189]:     <disk type="block" device="disk">
Oct 25 21:20:05 user nova-compute[74189]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:20:05 user nova-compute[74189]:       <source dev="/dev/sde"/>
Oct 25 21:20:05 user nova-compute[74189]:       <target dev="vdb" bus="virtio"/>
Oct 25 21:20:05 user nova-compute[74189]:       <serial>baed35ad-5534-47eb-93f6-2393d45d9e78</serial>
Oct 25 21:20:05 user nova-compute[74189]:     </disk>
Oct 25 21:20:05 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:20:05 user nova-compute[74189]:       <mac address="fa:16:3e:92:dc:7e"/>
Oct 25 21:20:05 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:20:05 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:20:05 user nova-compute[74189]:       <target dev="tapc6a0280f-de"/>
Oct 25 21:20:05 user nova-compute[74189]:     </interface>
Oct 25 21:20:05 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:20:05 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/console.log" append="off"/>
Oct 25 21:20:05 user nova-compute[74189]:     </serial>
Oct 25 21:20:05 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:20:05 user nova-compute[74189]:     <video>
Oct 25 21:20:05 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:20:05 user nova-compute[74189]:     </video>
Oct 25 21:20:05 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:20:05 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:20:05 user nova-compute[74189]:     </rng>
Oct 25 21:20:05 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:20:05 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:20:05 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:20:05 user nova-compute[74189]:     </memballoon>
Oct 25 21:20:05 user nova-compute[74189]:   </devices>
Oct 25 21:20:05 user nova-compute[74189]: </domain>
Oct 25 21:20:05 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:15:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2127723699',display_name='tempest-ServerActionsTestOtherB-server-2127723699',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2127723699',id=3,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjedofMSVtj00tqk1jqFMH5AZ5Pyw9+9WP37zpM0w2hcAIIw4fFannJXo68FjlEI0XSKwz6/AZjg4uhqhEM0AXh7nvdUT82CEMoJ2RGXuMes6AOS513uwlo8CUT17ABSg==',key_name='tempest-keypair-611941333',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:15:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e426fbc4bb374115a46d927092d62423',ramdisk_id='',reservation_id='r-q0q32lk1',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-40176194',owner_user_name='tempest-ServerActionsTestOtherB-40176194-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:19:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e81aaad00624abdafe04f6c8de4c5c0',uuid=5d21b93a-b312-4c1b-9e43-ffb4b729c7d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "address": "fa:16:3e:92:dc:7e", "network": {"id": "197dd483-54ad-4b81-a0d0-26c633b3a101", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1141346509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1141346509-network", "vif_mac": "fa:16:3e:92:dc:7e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e426fbc4bb374115a46d927092d62423", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a0280f-de", "ovs_interfaceid": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Converting VIF {"id": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "address": "fa:16:3e:92:dc:7e", "network": {"id": "197dd483-54ad-4b81-a0d0-26c633b3a101", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1141346509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1141346509-network", "vif_mac": "fa:16:3e:92:dc:7e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e426fbc4bb374115a46d927092d62423", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a0280f-de", "ovs_interfaceid": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:dc:7e,bridge_name='br-int',has_traffic_filtering=True,id=c6a0280f-def7-4677-910c-7a3a3c6b57df,network=Network(197dd483-54ad-4b81-a0d0-26c633b3a101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6a0280f-de') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG os_vif [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:dc:7e,bridge_name='br-int',has_traffic_filtering=True,id=c6a0280f-def7-4677-910c-7a3a3c6b57df,network=Network(197dd483-54ad-4b81-a0d0-26c633b3a101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6a0280f-de') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0a599051-42c4-58ad-af42-6ca12a2e31cb', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6a0280f-de, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc6a0280f-de, col_values=(('qos', UUID('48e94c73-8799-4c72-8f75-8f19d93fbfe4')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc6a0280f-de, col_values=(('external_ids', {'iface-id': 'c6a0280f-def7-4677-910c-7a3a3c6b57df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:dc:7e', 'vm-uuid': '5d21b93a-b312-4c1b-9e43-ffb4b729c7d3'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:05 user nova-compute[74189]: INFO os_vif [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:dc:7e,bridge_name='br-int',has_traffic_filtering=True,id=c6a0280f-def7-4677-910c-7a3a3c6b57df,network=Network(197dd483-54ad-4b81-a0d0-26c633b3a101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6a0280f-de')
Oct 25 21:20:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:20:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] No VIF found with MAC fa:16:3e:92:dc:7e, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:20:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:07 user nova-compute[74189]: DEBUG nova.compute.manager [req-b2954520-15be-44b5-9772-7ac35d7efbd6 req-90fe6a1b-cf18-45cd-b32d-665e0e38580b service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Received event network-vif-plugged-c6a0280f-def7-4677-910c-7a3a3c6b57df {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:20:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b2954520-15be-44b5-9772-7ac35d7efbd6 req-90fe6a1b-cf18-45cd-b32d-665e0e38580b service nova] Acquiring lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b2954520-15be-44b5-9772-7ac35d7efbd6 req-90fe6a1b-cf18-45cd-b32d-665e0e38580b service nova] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b2954520-15be-44b5-9772-7ac35d7efbd6 req-90fe6a1b-cf18-45cd-b32d-665e0e38580b service nova] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:07 user nova-compute[74189]: DEBUG nova.compute.manager [req-b2954520-15be-44b5-9772-7ac35d7efbd6 req-90fe6a1b-cf18-45cd-b32d-665e0e38580b service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] No waiting events found dispatching network-vif-plugged-c6a0280f-def7-4677-910c-7a3a3c6b57df {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:20:07 user nova-compute[74189]: WARNING nova.compute.manager [req-b2954520-15be-44b5-9772-7ac35d7efbd6 req-90fe6a1b-cf18-45cd-b32d-665e0e38580b service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Received unexpected event network-vif-plugged-c6a0280f-def7-4677-910c-7a3a3c6b57df for instance with vm_state active and task_state resize_finish.
Oct 25 21:20:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:09 user nova-compute[74189]: DEBUG nova.compute.manager [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:20:09 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Instance running successfully.
Oct 25 21:20:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Failed to set time: agent not configured {{(pid=74189) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 25 21:20:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b664339b-56a9-4749-bed4-148305235d6c tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] finish_migration finished successfully. {{(pid=74189) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 25 21:20:10 user nova-compute[74189]: DEBUG nova.compute.manager [req-27d9bde9-9075-441c-a0d9-88fb1aefaa45 req-0899215e-e815-43df-abf0-091602c4161e service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Received event network-vif-plugged-c6a0280f-def7-4677-910c-7a3a3c6b57df {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:20:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-27d9bde9-9075-441c-a0d9-88fb1aefaa45 req-0899215e-e815-43df-abf0-091602c4161e service nova] Acquiring lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-27d9bde9-9075-441c-a0d9-88fb1aefaa45 req-0899215e-e815-43df-abf0-091602c4161e service nova] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-27d9bde9-9075-441c-a0d9-88fb1aefaa45 req-0899215e-e815-43df-abf0-091602c4161e service nova] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:10 user nova-compute[74189]: DEBUG nova.compute.manager [req-27d9bde9-9075-441c-a0d9-88fb1aefaa45 req-0899215e-e815-43df-abf0-091602c4161e service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] No waiting events found dispatching network-vif-plugged-c6a0280f-def7-4677-910c-7a3a3c6b57df {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:20:10 user nova-compute[74189]: WARNING nova.compute.manager [req-27d9bde9-9075-441c-a0d9-88fb1aefaa45 req-0899215e-e815-43df-abf0-091602c4161e service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Received unexpected event network-vif-plugged-c6a0280f-def7-4677-910c-7a3a3c6b57df for instance with vm_state resized and task_state None.
Oct 25 21:20:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-597b6a9c-0e72-45e2-9604-53f67e287175 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Acquiring lock "c05f317d-c6ea-4755-a9c7-42b90974ef1d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-597b6a9c-0e72-45e2-9604-53f67e287175 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Lock "c05f317d-c6ea-4755-a9c7-42b90974ef1d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-597b6a9c-0e72-45e2-9604-53f67e287175 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Acquiring lock "c05f317d-c6ea-4755-a9c7-42b90974ef1d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-597b6a9c-0e72-45e2-9604-53f67e287175 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Lock "c05f317d-c6ea-4755-a9c7-42b90974ef1d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-597b6a9c-0e72-45e2-9604-53f67e287175 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Lock "c05f317d-c6ea-4755-a9c7-42b90974ef1d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:10 user nova-compute[74189]: INFO nova.compute.manager [None req-597b6a9c-0e72-45e2-9604-53f67e287175 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Terminating instance
Oct 25 21:20:10 user nova-compute[74189]: DEBUG nova.compute.manager [None req-597b6a9c-0e72-45e2-9604-53f67e287175 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:20:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:10 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Instance destroyed successfully.
Oct 25 21:20:10 user nova-compute[74189]: DEBUG nova.objects.instance [None req-597b6a9c-0e72-45e2-9604-53f67e287175 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Lazy-loading 'resources' on Instance uuid c05f317d-c6ea-4755-a9c7-42b90974ef1d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:20:10 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-597b6a9c-0e72-45e2-9604-53f67e287175 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:18:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-695191242',display_name='tempest-VolumesNegativeTest-instance-695191242',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-695191242',id=12,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:18:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aba3914bbc7448199c13a60b8752df35',ramdisk_id='',reservation_id='r-e6ukz923',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-219077880',owner_user_name='tempest-VolumesNegativeTest-219077880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:18:27Z,user_data=None,user_id='9225bf1b5edd4f5bb0eb377f845f6a75',uuid=c05f317d-c6ea-4755-a9c7-42b90974ef1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec91d2a1-8aac-414c-8a69-9d6013830336", "address": "fa:16:3e:db:f1:61", "network": {"id": "ecc9706f-95eb-4da4-8fda-55d21e03627d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1714f2820764423b9f4461ac8cbd9965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec91d2a1-8a", "ovs_interfaceid": "ec91d2a1-8aac-414c-8a69-9d6013830336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:20:10 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-597b6a9c-0e72-45e2-9604-53f67e287175 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Converting VIF {"id": "ec91d2a1-8aac-414c-8a69-9d6013830336", "address": "fa:16:3e:db:f1:61", "network": {"id": "ecc9706f-95eb-4da4-8fda-55d21e03627d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1714f2820764423b9f4461ac8cbd9965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec91d2a1-8a", "ovs_interfaceid": "ec91d2a1-8aac-414c-8a69-9d6013830336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:20:10 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-597b6a9c-0e72-45e2-9604-53f67e287175 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:f1:61,bridge_name='br-int',has_traffic_filtering=True,id=ec91d2a1-8aac-414c-8a69-9d6013830336,network=Network(ecc9706f-95eb-4da4-8fda-55d21e03627d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec91d2a1-8a') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:20:10 user nova-compute[74189]: DEBUG os_vif [None req-597b6a9c-0e72-45e2-9604-53f67e287175 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:f1:61,bridge_name='br-int',has_traffic_filtering=True,id=ec91d2a1-8aac-414c-8a69-9d6013830336,network=Network(ecc9706f-95eb-4da4-8fda-55d21e03627d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec91d2a1-8a') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:20:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec91d2a1-8a, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:20:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:20:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=161fc9f8-6243-4c40-94f3-654535eb4268) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:20:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:20:10 user nova-compute[74189]: INFO os_vif [None req-597b6a9c-0e72-45e2-9604-53f67e287175 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:f1:61,bridge_name='br-int',has_traffic_filtering=True,id=ec91d2a1-8aac-414c-8a69-9d6013830336,network=Network(ecc9706f-95eb-4da4-8fda-55d21e03627d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec91d2a1-8a')
Oct 25 21:20:10 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-597b6a9c-0e72-45e2-9604-53f67e287175 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Deleting instance files /opt/stack/data/nova/instances/c05f317d-c6ea-4755-a9c7-42b90974ef1d_del
Oct 25 21:20:10 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-597b6a9c-0e72-45e2-9604-53f67e287175 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Deletion of /opt/stack/data/nova/instances/c05f317d-c6ea-4755-a9c7-42b90974ef1d_del complete
Oct 25 21:20:11 user nova-compute[74189]: INFO nova.compute.manager [None req-597b6a9c-0e72-45e2-9604-53f67e287175 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 25 21:20:11 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-597b6a9c-0e72-45e2-9604-53f67e287175 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:20:11 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:20:11 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:20:11 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:20:11 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Took 0.43 seconds to deallocate network for instance.
Oct 25 21:20:11 user nova-compute[74189]: DEBUG nova.compute.manager [req-2e998a0a-28c6-4822-a34c-8719b08c64a2 req-7c181617-474b-4d36-8f7d-96a104d89838 service nova] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Received event network-vif-deleted-ec91d2a1-8aac-414c-8a69-9d6013830336 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:20:11 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-597b6a9c-0e72-45e2-9604-53f67e287175 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:11 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-597b6a9c-0e72-45e2-9604-53f67e287175 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:11 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-597b6a9c-0e72-45e2-9604-53f67e287175 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:20:11 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-597b6a9c-0e72-45e2-9604-53f67e287175 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:20:11 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-597b6a9c-0e72-45e2-9604-53f67e287175 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.406s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:11 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-597b6a9c-0e72-45e2-9604-53f67e287175 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Deleted allocations for instance c05f317d-c6ea-4755-a9c7-42b90974ef1d
Oct 25 21:20:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-597b6a9c-0e72-45e2-9604-53f67e287175 tempest-VolumesNegativeTest-219077880 tempest-VolumesNegativeTest-219077880-project-member] Lock "c05f317d-c6ea-4755-a9c7-42b90974ef1d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.986s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:12 user nova-compute[74189]: DEBUG nova.compute.manager [req-30202052-ef66-41d7-b6f9-56dfb3c29dd4 req-81573f95-c529-4644-9b35-11f189ce30d9 service nova] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Received event network-vif-unplugged-ec91d2a1-8aac-414c-8a69-9d6013830336 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:20:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-30202052-ef66-41d7-b6f9-56dfb3c29dd4 req-81573f95-c529-4644-9b35-11f189ce30d9 service nova] Acquiring lock "c05f317d-c6ea-4755-a9c7-42b90974ef1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-30202052-ef66-41d7-b6f9-56dfb3c29dd4 req-81573f95-c529-4644-9b35-11f189ce30d9 service nova] Lock "c05f317d-c6ea-4755-a9c7-42b90974ef1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-30202052-ef66-41d7-b6f9-56dfb3c29dd4 req-81573f95-c529-4644-9b35-11f189ce30d9 service nova] Lock "c05f317d-c6ea-4755-a9c7-42b90974ef1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:12 user nova-compute[74189]: DEBUG nova.compute.manager [req-30202052-ef66-41d7-b6f9-56dfb3c29dd4 req-81573f95-c529-4644-9b35-11f189ce30d9 service nova] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] No waiting events found dispatching network-vif-unplugged-ec91d2a1-8aac-414c-8a69-9d6013830336 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:20:12 user nova-compute[74189]: WARNING nova.compute.manager [req-30202052-ef66-41d7-b6f9-56dfb3c29dd4 req-81573f95-c529-4644-9b35-11f189ce30d9 service nova] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Received unexpected event network-vif-unplugged-ec91d2a1-8aac-414c-8a69-9d6013830336 for instance with vm_state deleted and task_state None.
Oct 25 21:20:12 user nova-compute[74189]: DEBUG nova.compute.manager [req-30202052-ef66-41d7-b6f9-56dfb3c29dd4 req-81573f95-c529-4644-9b35-11f189ce30d9 service nova] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Received event network-vif-plugged-ec91d2a1-8aac-414c-8a69-9d6013830336 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:20:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-30202052-ef66-41d7-b6f9-56dfb3c29dd4 req-81573f95-c529-4644-9b35-11f189ce30d9 service nova] Acquiring lock "c05f317d-c6ea-4755-a9c7-42b90974ef1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-30202052-ef66-41d7-b6f9-56dfb3c29dd4 req-81573f95-c529-4644-9b35-11f189ce30d9 service nova] Lock "c05f317d-c6ea-4755-a9c7-42b90974ef1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-30202052-ef66-41d7-b6f9-56dfb3c29dd4 req-81573f95-c529-4644-9b35-11f189ce30d9 service nova] Lock "c05f317d-c6ea-4755-a9c7-42b90974ef1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:12 user nova-compute[74189]: DEBUG nova.compute.manager [req-30202052-ef66-41d7-b6f9-56dfb3c29dd4 req-81573f95-c529-4644-9b35-11f189ce30d9 service nova] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] No waiting events found dispatching network-vif-plugged-ec91d2a1-8aac-414c-8a69-9d6013830336 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:20:12 user nova-compute[74189]: WARNING nova.compute.manager [req-30202052-ef66-41d7-b6f9-56dfb3c29dd4 req-81573f95-c529-4644-9b35-11f189ce30d9 service nova] [instance: c05f317d-c6ea-4755-a9c7-42b90974ef1d] Received unexpected event network-vif-plugged-ec91d2a1-8aac-414c-8a69-9d6013830336 for instance with vm_state deleted and task_state None.
Oct 25 21:20:12 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-35c58e03-b4e9-450c-b334-f643f020d878 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Acquiring lock "f52fc510-3640-468a-8a9c-b716b9d17a01" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-35c58e03-b4e9-450c-b334-f643f020d878 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Lock "f52fc510-3640-468a-8a9c-b716b9d17a01" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-35c58e03-b4e9-450c-b334-f643f020d878 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Acquiring lock "f52fc510-3640-468a-8a9c-b716b9d17a01-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-35c58e03-b4e9-450c-b334-f643f020d878 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Lock "f52fc510-3640-468a-8a9c-b716b9d17a01-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-35c58e03-b4e9-450c-b334-f643f020d878 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Lock "f52fc510-3640-468a-8a9c-b716b9d17a01-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:12 user nova-compute[74189]: INFO nova.compute.manager [None req-35c58e03-b4e9-450c-b334-f643f020d878 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Terminating instance
Oct 25 21:20:12 user nova-compute[74189]: DEBUG nova.compute.manager [None req-35c58e03-b4e9-450c-b334-f643f020d878 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:20:12 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:12 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:12 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:12 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:12 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:13 user nova-compute[74189]: DEBUG nova.compute.manager [req-1ef0a9d5-a08d-4279-8dbc-3106a3c50efd req-703e342f-4301-4d22-83c6-986d0d37d469 service nova] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Received event network-vif-unplugged-dd205313-c8a4-433d-8271-6abe9cf77ede {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:20:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1ef0a9d5-a08d-4279-8dbc-3106a3c50efd req-703e342f-4301-4d22-83c6-986d0d37d469 service nova] Acquiring lock "f52fc510-3640-468a-8a9c-b716b9d17a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1ef0a9d5-a08d-4279-8dbc-3106a3c50efd req-703e342f-4301-4d22-83c6-986d0d37d469 service nova] Lock "f52fc510-3640-468a-8a9c-b716b9d17a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1ef0a9d5-a08d-4279-8dbc-3106a3c50efd req-703e342f-4301-4d22-83c6-986d0d37d469 service nova] Lock "f52fc510-3640-468a-8a9c-b716b9d17a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:13 user nova-compute[74189]: DEBUG nova.compute.manager [req-1ef0a9d5-a08d-4279-8dbc-3106a3c50efd req-703e342f-4301-4d22-83c6-986d0d37d469 service nova] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] No waiting events found dispatching network-vif-unplugged-dd205313-c8a4-433d-8271-6abe9cf77ede {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:20:13 user nova-compute[74189]: DEBUG nova.compute.manager [req-1ef0a9d5-a08d-4279-8dbc-3106a3c50efd req-703e342f-4301-4d22-83c6-986d0d37d469 service nova] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Received event network-vif-unplugged-dd205313-c8a4-433d-8271-6abe9cf77ede for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:20:13 user nova-compute[74189]: DEBUG nova.compute.manager [req-1ef0a9d5-a08d-4279-8dbc-3106a3c50efd req-703e342f-4301-4d22-83c6-986d0d37d469 service nova] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Received event network-vif-plugged-dd205313-c8a4-433d-8271-6abe9cf77ede {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:20:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1ef0a9d5-a08d-4279-8dbc-3106a3c50efd req-703e342f-4301-4d22-83c6-986d0d37d469 service nova] Acquiring lock "f52fc510-3640-468a-8a9c-b716b9d17a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1ef0a9d5-a08d-4279-8dbc-3106a3c50efd req-703e342f-4301-4d22-83c6-986d0d37d469 service nova] Lock "f52fc510-3640-468a-8a9c-b716b9d17a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1ef0a9d5-a08d-4279-8dbc-3106a3c50efd req-703e342f-4301-4d22-83c6-986d0d37d469 service nova] Lock "f52fc510-3640-468a-8a9c-b716b9d17a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:13 user nova-compute[74189]: DEBUG nova.compute.manager [req-1ef0a9d5-a08d-4279-8dbc-3106a3c50efd req-703e342f-4301-4d22-83c6-986d0d37d469 service nova] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] No waiting events found dispatching network-vif-plugged-dd205313-c8a4-433d-8271-6abe9cf77ede {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:20:13 user nova-compute[74189]: WARNING nova.compute.manager [req-1ef0a9d5-a08d-4279-8dbc-3106a3c50efd req-703e342f-4301-4d22-83c6-986d0d37d469 service nova] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Received unexpected event network-vif-plugged-dd205313-c8a4-433d-8271-6abe9cf77ede for instance with vm_state active and task_state deleting.
Oct 25 21:20:13 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Instance destroyed successfully.
Oct 25 21:20:13 user nova-compute[74189]: DEBUG nova.objects.instance [None req-35c58e03-b4e9-450c-b334-f643f020d878 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Lazy-loading 'resources' on Instance uuid f52fc510-3640-468a-8a9c-b716b9d17a01 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:20:13 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-35c58e03-b4e9-450c-b334-f643f020d878 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:15:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-515576057',display_name='tempest-TestVolumeSwap-server-515576057',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-515576057',id=7,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADlB+TJ3G77Yn+fbANsqvygKinLXdlQlhX6bggrE6U3tpQR5Pkwny+l0DCwd/hW0KV0mr8acwyGoiJim0gNZTxQFCrigJ4O44ymmtim5N7f/NBIsJ6NafADKCrOstGvXA==',key_name='tempest-keypair-1168601867',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:15:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea3ea66cfd844c37bcc97a430f2eee69',ramdisk_id='',reservation_id='r-husynio0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1625296795',owner_user_name='tempest-TestVolumeSwap-1625296795-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:15:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09d355b05b7b4e669602aa766ff8f7fa',uuid=f52fc510-3640-468a-8a9c-b716b9d17a01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd205313-c8a4-433d-8271-6abe9cf77ede", "address": "fa:16:3e:50:6e:57", "network": {"id": "10a55176-55d4-4629-890b-4de824ceda02", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1760980393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea3ea66cfd844c37bcc97a430f2eee69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd205313-c8", "ovs_interfaceid": "dd205313-c8a4-433d-8271-6abe9cf77ede", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:20:13 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-35c58e03-b4e9-450c-b334-f643f020d878 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Converting VIF {"id": "dd205313-c8a4-433d-8271-6abe9cf77ede", "address": "fa:16:3e:50:6e:57", "network": {"id": "10a55176-55d4-4629-890b-4de824ceda02", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1760980393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea3ea66cfd844c37bcc97a430f2eee69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd205313-c8", "ovs_interfaceid": "dd205313-c8a4-433d-8271-6abe9cf77ede", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:20:13 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-35c58e03-b4e9-450c-b334-f643f020d878 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:6e:57,bridge_name='br-int',has_traffic_filtering=True,id=dd205313-c8a4-433d-8271-6abe9cf77ede,network=Network(10a55176-55d4-4629-890b-4de824ceda02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd205313-c8') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:20:13 user nova-compute[74189]: DEBUG os_vif [None req-35c58e03-b4e9-450c-b334-f643f020d878 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:6e:57,bridge_name='br-int',has_traffic_filtering=True,id=dd205313-c8a4-433d-8271-6abe9cf77ede,network=Network(10a55176-55d4-4629-890b-4de824ceda02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd205313-c8') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:20:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd205313-c8, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:20:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b69ae6b-84d3-47c4-b6f5-c8f3d466458a) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:20:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:13 user nova-compute[74189]: INFO os_vif [None req-35c58e03-b4e9-450c-b334-f643f020d878 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:6e:57,bridge_name='br-int',has_traffic_filtering=True,id=dd205313-c8a4-433d-8271-6abe9cf77ede,network=Network(10a55176-55d4-4629-890b-4de824ceda02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd205313-c8')
Oct 25 21:20:13 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-35c58e03-b4e9-450c-b334-f643f020d878 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Deleting instance files /opt/stack/data/nova/instances/f52fc510-3640-468a-8a9c-b716b9d17a01_del
Oct 25 21:20:13 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-35c58e03-b4e9-450c-b334-f643f020d878 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Deletion of /opt/stack/data/nova/instances/f52fc510-3640-468a-8a9c-b716b9d17a01_del complete
Oct 25 21:20:13 user nova-compute[74189]: INFO nova.compute.manager [None req-35c58e03-b4e9-450c-b334-f643f020d878 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 25 21:20:13 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-35c58e03-b4e9-450c-b334-f643f020d878 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:20:13 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:20:13 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:20:14 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:20:14 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Took 0.83 seconds to deallocate network for instance.
Oct 25 21:20:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-35c58e03-b4e9-450c-b334-f643f020d878 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-35c58e03-b4e9-450c-b334-f643f020d878 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:14 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-35c58e03-b4e9-450c-b334-f643f020d878 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:20:14 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-35c58e03-b4e9-450c-b334-f643f020d878 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:20:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-35c58e03-b4e9-450c-b334-f643f020d878 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:14 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-35c58e03-b4e9-450c-b334-f643f020d878 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Deleted allocations for instance f52fc510-3640-468a-8a9c-b716b9d17a01
Oct 25 21:20:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-35c58e03-b4e9-450c-b334-f643f020d878 tempest-TestVolumeSwap-1625296795 tempest-TestVolumeSwap-1625296795-project-member] Lock "f52fc510-3640-468a-8a9c-b716b9d17a01" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.316s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:15 user nova-compute[74189]: DEBUG nova.compute.manager [req-1745ce54-ad2b-43b4-8b6a-29a6149bd6bd req-35b020bc-e387-4985-b3a3-5d2313723fbc service nova] [instance: f52fc510-3640-468a-8a9c-b716b9d17a01] Received event network-vif-deleted-dd205313-c8a4-433d-8271-6abe9cf77ede {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:20:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Acquiring lock "46ffb192-ad11-416e-9094-c8e080b5414e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Lock "46ffb192-ad11-416e-9094-c8e080b5414e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:42 user nova-compute[74189]: DEBUG nova.compute.manager [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:20:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:42 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:20:42 user nova-compute[74189]: INFO nova.compute.claims [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Claim successful on node user
Oct 25 21:20:42 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:20:42 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:20:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:42 user nova-compute[74189]: DEBUG nova.compute.manager [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:20:42 user nova-compute[74189]: DEBUG nova.compute.manager [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:20:42 user nova-compute[74189]: DEBUG nova.network.neutron [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:20:42 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:20:42 user nova-compute[74189]: DEBUG nova.compute.manager [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:20:42 user nova-compute[74189]: INFO nova.virt.block_device [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Booting with volume a545b3af-6d77-4506-b9c1-7c6d0320efee at /dev/vda
Oct 25 21:20:43 user nova-compute[74189]: DEBUG os_brick.utils [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:20:43 user nova-compute[74189]: DEBUG nova.policy [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '03ccd825e31941ce9a876d85b607e02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78ddc9861f9455aa58a9a532548023a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:20:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:43 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[114609ed-8b29-4fd9-ba95-81758226999c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:43 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ef1ef0-3405-479c-9713-7c5cfed7bbd3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:43 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa72820-7659-487c-a870-4103a12c26f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:43 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa79e47-465b-41de-a2fd-5468634c7cb8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:20:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:20:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:20:43 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:20:43 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6ce97b-6063-4da2-a88e-037457f2606c]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:20:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:20:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:20:43 user nova-compute[74189]: DEBUG os_brick.utils [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:20:43 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Updating existing volume attachment record: 1f5198cb-4ede-4047-b357-f529129b249b {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:20:43 user nova-compute[74189]: DEBUG nova.network.neutron [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Successfully created port: 35311a59-a404-4759-8125-ac222750d5fa {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:20:43 user nova-compute[74189]: INFO nova.compute.manager [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Rescuing
Oct 25 21:20:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "refresh_cache-af1d7b3c-9950-4b74-8f15-b31011ccfa24" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:20:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquired lock "refresh_cache-af1d7b3c-9950-4b74-8f15-b31011ccfa24" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:20:43 user nova-compute[74189]: DEBUG nova.network.neutron [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:20:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:44 user nova-compute[74189]: DEBUG nova.network.neutron [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Successfully created port: 5f18e575-80eb-41e8-8615-bcbbe00ff9de {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:20:44 user nova-compute[74189]: DEBUG nova.network.neutron [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Updating instance_info_cache with network_info: [{"id": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "address": "fa:16:3e:03:8e:2f", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4cdb73-9d", "ovs_interfaceid": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:20:44 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Releasing lock "refresh_cache-af1d7b3c-9950-4b74-8f15-b31011ccfa24" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:20:44 user nova-compute[74189]: DEBUG nova.network.neutron [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Successfully created port: 4caa88c4-c581-41eb-b8f8-a291aaef3ad4 {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:20:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:45 user nova-compute[74189]: DEBUG nova.compute.manager [req-5384ec65-3ab8-45fa-ae8b-9c42b37e1cbe req-0dba34a5-47f5-4e62-a957-63c59b25c133 service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Received event network-vif-unplugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:20:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-5384ec65-3ab8-45fa-ae8b-9c42b37e1cbe req-0dba34a5-47f5-4e62-a957-63c59b25c133 service nova] Acquiring lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-5384ec65-3ab8-45fa-ae8b-9c42b37e1cbe req-0dba34a5-47f5-4e62-a957-63c59b25c133 service nova] Lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-5384ec65-3ab8-45fa-ae8b-9c42b37e1cbe req-0dba34a5-47f5-4e62-a957-63c59b25c133 service nova] Lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:45 user nova-compute[74189]: DEBUG nova.compute.manager [req-5384ec65-3ab8-45fa-ae8b-9c42b37e1cbe req-0dba34a5-47f5-4e62-a957-63c59b25c133 service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] No waiting events found dispatching network-vif-unplugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:20:45 user nova-compute[74189]: WARNING nova.compute.manager [req-5384ec65-3ab8-45fa-ae8b-9c42b37e1cbe req-0dba34a5-47f5-4e62-a957-63c59b25c133 service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Received unexpected event network-vif-unplugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b for instance with vm_state active and task_state rescuing.
Oct 25 21:20:45 user nova-compute[74189]: DEBUG nova.network.neutron [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Successfully created port: b60a817a-3478-48d7-b117-bee088bc7e86 {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:20:45 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Instance destroyed successfully.
Oct 25 21:20:45 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Attempting a stable device rescue
Oct 25 21:20:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74189) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 25 21:20:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Instance directory exists: not creating {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 21:20:45 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Creating image(s)
Oct 25 21:20:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "/opt/stack/data/nova/instances/af1d7b3c-9950-4b74-8f15-b31011ccfa24/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "/opt/stack/data/nova/instances/af1d7b3c-9950-4b74-8f15-b31011ccfa24/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "/opt/stack/data/nova/instances/af1d7b3c-9950-4b74-8f15-b31011ccfa24/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:45 user nova-compute[74189]: DEBUG nova.objects.instance [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lazy-loading 'trusted_certs' on Instance uuid af1d7b3c-9950-4b74-8f15-b31011ccfa24 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:20:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "cc877fb24144c79b92511ca92088df21297e3344" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "cc877fb24144c79b92511ca92088df21297e3344" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cc877fb24144c79b92511ca92088df21297e3344.part --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:46 user nova-compute[74189]: DEBUG nova.network.neutron [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Successfully created port: 94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56 {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:20:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cc877fb24144c79b92511ca92088df21297e3344.part --force-share --output=json" returned: 0 in 0.191s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:46 user nova-compute[74189]: DEBUG nova.virt.images [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] 8f04f415-82e1-47c3-8a9e-e1fc003164ec was qcow2, converting to raw {{(pid=74189) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 21:20:46 user nova-compute[74189]: DEBUG nova.privsep.utils [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74189) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 21:20:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cc877fb24144c79b92511ca92088df21297e3344.part /opt/stack/data/nova/instances/_base/cc877fb24144c79b92511ca92088df21297e3344.converted {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cc877fb24144c79b92511ca92088df21297e3344.part /opt/stack/data/nova/instances/_base/cc877fb24144c79b92511ca92088df21297e3344.converted" returned: 0 in 0.377s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cc877fb24144c79b92511ca92088df21297e3344.converted --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG nova.compute.manager [req-61f690e2-3abb-4d0f-b8ef-e214e355cb37 req-2f0b38fa-e530-47ba-abbe-d9020eb74948 service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Received event network-vif-plugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-61f690e2-3abb-4d0f-b8ef-e214e355cb37 req-2f0b38fa-e530-47ba-abbe-d9020eb74948 service nova] Acquiring lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-61f690e2-3abb-4d0f-b8ef-e214e355cb37 req-2f0b38fa-e530-47ba-abbe-d9020eb74948 service nova] Lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-61f690e2-3abb-4d0f-b8ef-e214e355cb37 req-2f0b38fa-e530-47ba-abbe-d9020eb74948 service nova] Lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG nova.compute.manager [req-61f690e2-3abb-4d0f-b8ef-e214e355cb37 req-2f0b38fa-e530-47ba-abbe-d9020eb74948 service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] No waiting events found dispatching network-vif-plugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:20:47 user nova-compute[74189]: WARNING nova.compute.manager [req-61f690e2-3abb-4d0f-b8ef-e214e355cb37 req-2f0b38fa-e530-47ba-abbe-d9020eb74948 service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Received unexpected event network-vif-plugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b for instance with vm_state active and task_state rescuing.
Oct 25 21:20:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cc877fb24144c79b92511ca92088df21297e3344.converted --force-share --output=json" returned: 0 in 0.249s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "cc877fb24144c79b92511ca92088df21297e3344" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.748s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "cc877fb24144c79b92511ca92088df21297e3344" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "cc877fb24144c79b92511ca92088df21297e3344" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cc877fb24144c79b92511ca92088df21297e3344 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG nova.network.neutron [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Successfully updated port: 35311a59-a404-4759-8125-ac222750d5fa {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cc877fb24144c79b92511ca92088df21297e3344 --force-share --output=json" returned: 0 in 0.242s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cc877fb24144c79b92511ca92088df21297e3344,backing_fmt=raw /opt/stack/data/nova/instances/af1d7b3c-9950-4b74-8f15-b31011ccfa24/disk.rescue {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cc877fb24144c79b92511ca92088df21297e3344,backing_fmt=raw /opt/stack/data/nova/instances/af1d7b3c-9950-4b74-8f15-b31011ccfa24/disk.rescue" returned: 0 in 0.062s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "cc877fb24144c79b92511ca92088df21297e3344" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.311s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG nova.objects.instance [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lazy-loading 'migration_context' on Instance uuid af1d7b3c-9950-4b74-8f15-b31011ccfa24 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG nova.objects.base [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Object Instance<af1d7b3c-9950-4b74-8f15-b31011ccfa24> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Start _get_guest_xml network_info=[{"id": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "address": "fa:16:3e:03:8e:2f", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "vif_mac": "fa:16:3e:03:8e:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4cdb73-9d", "ovs_interfaceid": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8f04f415-82e1-47c3-8a9e-e1fc003164ec', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tUkwnqOm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'af1d7b3c-9950-4b74-8f15-b31011ccfa24', 'attached_at': '', 'detached_at': '', 'volume_id': '2f820341-4749-4ef8-8947-7512bc272c90', 'serial': '2f820341-4749-4ef8-8947-7512bc272c90'}, 'attachment_id': '12781d70-7865-4eca-a41a-d93c04235083', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG nova.objects.instance [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lazy-loading 'resources' on Instance uuid af1d7b3c-9950-4b74-8f15-b31011ccfa24 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG nova.objects.base [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Object Instance<af1d7b3c-9950-4b74-8f15-b31011ccfa24> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG nova.objects.instance [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lazy-loading 'numa_topology' on Instance uuid af1d7b3c-9950-4b74-8f15-b31011ccfa24 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG nova.objects.base [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Object Instance<af1d7b3c-9950-4b74-8f15-b31011ccfa24> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:20:47 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:20:47 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:20:47 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:20:47 user nova-compute[74189]: DEBUG nova.objects.instance [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lazy-loading 'vcpu_model' on Instance uuid af1d7b3c-9950-4b74-8f15-b31011ccfa24 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG nova.objects.base [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Object Instance<af1d7b3c-9950-4b74-8f15-b31011ccfa24> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tUkwnqOm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:20:48 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:20:48 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:20:48 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:20:48 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:20:48 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:20:48 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 -p 172.16.0.220:3260" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[82781811-5abc-43f0-a816-4557bbe7c77e]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = tUkwnqOm\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 25 21:20:48 user nova-compute[74189]: node.name = iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:20:48 user nova-compute[74189]: node.tpgt = -1
Oct 25 21:20:48 user nova-compute[74189]: node.startup = automatic
Oct 25 21:20:48 user nova-compute[74189]: node.leading_login = No
Oct 25 21:20:48 user nova-compute[74189]: iface.iscsi_ifacename = default
Oct 25 21:20:48 user nova-compute[74189]: iface.net_ifacename = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.ipaddress = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.prefix_len = 0
Oct 25 21:20:48 user nova-compute[74189]: iface.hwaddress = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.transport_name = tcp
Oct 25 21:20:48 user nova-compute[74189]: iface.initiatorname = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.state = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.vlan_id = 0
Oct 25 21:20:48 user nova-compute[74189]: iface.vlan_priority = 0
Oct 25 21:20:48 user nova-compute[74189]: iface.vlan_state = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.iface_num = 0
Oct 25 21:20:48 user nova-compute[74189]: iface.mtu = 0
Oct 25 21:20:48 user nova-compute[74189]: iface.port = 0
Oct 25 21:20:48 user nova-compute[74189]: iface.bootproto = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.subnet_mask = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.gateway = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.dhcp_alt_client_id_state = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.dhcp_alt_client_id = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.dhcp_dns = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.dhcp_learn_iqn = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.dhcp_req_vendor_id_state = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.dhcp_vendor_id_state = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.dhcp_vendor_id = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.dhcp_slp_da = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.fragmentation = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.gratuitous_arp = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.incoming_forwarding = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.tos_state = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.tos = 0
Oct 25 21:20:48 user nova-compute[74189]: iface.ttl = 0
Oct 25 21:20:48 user nova-compute[74189]: iface.delayed_ack = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.tcp_nagle = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.tcp_wsf_state = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.tcp_wsf = 0
Oct 25 21:20:48 user nova-compute[74189]: iface.tcp_timer_scale = 0
Oct 25 21:20:48 user nova-compute[74189]: iface.tcp_timestamp = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.redirect = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.def_task_mgmt_timeout = 0
Oct 25 21:20:48 user nova-compute[74189]: iface.header_digest = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.data_digest = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.immediate_data = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.initial_r2t = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.data_seq_inorder = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.data_pdu_inorder = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.erl = 0
Oct 25 21:20:48 user nova-compute[74189]: iface.max_receive_data_len = 0
Oct 25 21:20:48 user nova-compute[74189]: iface.first_burst_len = 0
Oct 25 21:20:48 user nova-compute[74189]: iface.max_outstanding_r2t = 0
Oct 25 21:20:48 user nova-compute[74189]: iface.max_burst_len = 0
Oct 25 21:20:48 user nova-compute[74189]: iface.chap_auth = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.bidi_chap = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.strict_login_compliance = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.discovery_auth = <empty>
Oct 25 21:20:48 user nova-compute[74189]: iface.discovery_logout = <empty>
Oct 25 21:20:48 user nova-compute[74189]: node.discovery_address = <empty>
Oct 25 21:20:48 user nova-compute[74189]: node.discovery_port = 0
Oct 25 21:20:48 user nova-compute[74189]: node.discovery_type = static
Oct 25 21:20:48 user nova-compute[74189]: node.session.initial_cmdsn = 0
Oct 25 21:20:48 user nova-compute[74189]: node.session.initial_login_retry_max = 8
Oct 25 21:20:48 user nova-compute[74189]: node.session.xmit_thread_priority = -20
Oct 25 21:20:48 user nova-compute[74189]: node.session.cmds_max = 128
Oct 25 21:20:48 user nova-compute[74189]: node.session.queue_depth = 32
Oct 25 21:20:48 user nova-compute[74189]: node.session.nr_sessions = 1
Oct 25 21:20:48 user nova-compute[74189]: node.session.auth.authmethod = CHAP
Oct 25 21:20:48 user nova-compute[74189]: node.session.auth.username = tUkwnqOm
Oct 25 21:20:48 user nova-compute[74189]: node.session.auth.password = ***
Oct 25 21:20:48 user nova-compute[74189]: node.session.auth.username_in = <empty>
Oct 25 21:20:48 user nova-compute[74189]: node.session.auth.password_in = <empty>
Oct 25 21:20:48 user nova-compute[74189]: node.session.auth.chap_algs = MD5
Oct 25 21:20:48 user nova-compute[74189]: node.session.timeo.replacement_timeout = 120
Oct 25 21:20:48 user nova-compute[74189]: node.session.err_timeo.abort_timeout = 15
Oct 25 21:20:48 user nova-compute[74189]: node.session.err_timeo.lu_reset_timeout = 30
Oct 25 21:20:48 user nova-compute[74189]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 25 21:20:48 user nova-compute[74189]: node.session.err_timeo.host_reset_timeout = 60
Oct 25 21:20:48 user nova-compute[74189]: node.session.iscsi.FastAbort = Yes
Oct 25 21:20:48 user nova-compute[74189]: node.session.iscsi.InitialR2T = No
Oct 25 21:20:48 user nova-compute[74189]: node.session.iscsi.ImmediateData = Yes
Oct 25 21:20:48 user nova-compute[74189]: node.session.iscsi.FirstBurstLength = 262144
Oct 25 21:20:48 user nova-compute[74189]: node.session.iscsi.MaxBurstLength = 16776192
Oct 25 21:20:48 user nova-compute[74189]: node.session.iscsi.DefaultTime2Retain = 0
Oct 25 21:20:48 user nova-compute[74189]: node.session.iscsi.DefaultTime2Wait = 2
Oct 25 21:20:48 user nova-compute[74189]: node.session.iscsi.MaxConnections = 1
Oct 25 21:20:48 user nova-compute[74189]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 25 21:20:48 user nova-compute[74189]: node.session.iscsi.ERL = 0
Oct 25 21:20:48 user nova-compute[74189]: node.session.scan = manual
Oct 25 21:20:48 user nova-compute[74189]: node.session.reopen_max = 0
Oct 25 21:20:48 user nova-compute[74189]: node.conn[0].address = 172.16.0.220
Oct 25 21:20:48 user nova-compute[74189]: node.conn[0].port = 3260
Oct 25 21:20:48 user nova-compute[74189]: node.conn[0].startup = manual
Oct 25 21:20:48 user nova-compute[74189]: node.conn[0].tcp.window_size = 524288
Oct 25 21:20:48 user nova-compute[74189]: node.conn[0].tcp.type_of_service = 0
Oct 25 21:20:48 user nova-compute[74189]: node.conn[0].timeo.logout_timeout = 15
Oct 25 21:20:48 user nova-compute[74189]: node.conn[0].timeo.login_timeout = 15
Oct 25 21:20:48 user nova-compute[74189]: node.conn[0].timeo.auth_timeout = 45
Oct 25 21:20:48 user nova-compute[74189]: node.conn[0].timeo.noop_out_interval = 5
Oct 25 21:20:48 user nova-compute[74189]: node.conn[0].timeo.noop_out_timeout = 5
Oct 25 21:20:48 user nova-compute[74189]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 25 21:20:48 user nova-compute[74189]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 25 21:20:48 user nova-compute[74189]: node.conn[0].iscsi.HeaderDigest = None
Oct 25 21:20:48 user nova-compute[74189]: node.conn[0].iscsi.DataDigest = None
Oct 25 21:20:48 user nova-compute[74189]: node.conn[0].iscsi.IFMarker = No
Oct 25 21:20:48 user nova-compute[74189]: node.conn[0].iscsi.OFMarker = No
Oct 25 21:20:48 user nova-compute[74189]: # END RECORD
Oct 25 21:20:48 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2370ed1c-4e11-44db-9b81-00bc3ca371f2]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd50a3a-af85-4806-a346-07ce698a7488]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tUkwnqOm {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tUkwnqOm" returned: 0 in 0.026s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0cde9c-0467-42c4-a474-eefea6c25d4a]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tUkwnqOm'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7dd224-cc7a-4f09-ae45-acc404eafa28]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3944789-7de2-413e-9c9d-e53f5dc551a5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:20:48 user nova-compute[74189]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)
Oct 25 21:20:48 user nova-compute[74189]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)
Oct 25 21:20:48 user nova-compute[74189]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)
Oct 25 21:20:48 user nova-compute[74189]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:20:48 user nova-compute[74189]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:20:48 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:20:48 user nova-compute[74189]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)
Oct 25 21:20:48 user nova-compute[74189]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)
Oct 25 21:20:48 user nova-compute[74189]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)
Oct 25 21:20:48 user nova-compute[74189]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:20:48 user nova-compute[74189]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:20:48 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.206s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] HCTL ('33', '0', '0', 0) found on session 10 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa68a03e-8597-4402-afc5-289e6ad76a85]: (4, ('0 0 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Searching for a device in session 10 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tUkwnqOm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.235s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] <== connect_volume: return (238ms) {'type': 'block', 'scsi_wwn': '23835663435313262', 'path': '/dev/sdb'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835663435313262', 'path': '/dev/sdb'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:18:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1510065369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1510065369',id=11,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:19:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='acbb4f93936848a8949477ad124bf98e',ramdisk_id='',reservation_id='r-prbdlvvi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-571481303',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:19:03Z,user_data=None,user_id='fc377c1beaab443683a6d776f2f734ff',uuid=af1d7b3c-9950-4b74-8f15-b31011ccfa24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "address": "fa:16:3e:03:8e:2f", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "vif_mac": "fa:16:3e:03:8e:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4cdb73-9d", "ovs_interfaceid": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Converting VIF {"id": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "address": "fa:16:3e:03:8e:2f", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "vif_mac": "fa:16:3e:03:8e:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4cdb73-9d", "ovs_interfaceid": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:8e:2f,bridge_name='br-int',has_traffic_filtering=True,id=8f4cdb73-9d83-4bde-82a4-7198b06b904b,network=Network(f202171f-dfd8-4a19-9321-788318413ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f4cdb73-9d') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG nova.objects.instance [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lazy-loading 'pci_devices' on Instance uuid af1d7b3c-9950-4b74-8f15-b31011ccfa24 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG nova.objects.base [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Object Instance<af1d7b3c-9950-4b74-8f15-b31011ccfa24> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:20:48 user nova-compute[74189]:   <uuid>af1d7b3c-9950-4b74-8f15-b31011ccfa24</uuid>
Oct 25 21:20:48 user nova-compute[74189]:   <name>instance-0000000b</name>
Oct 25 21:20:48 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:20:48 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:20:48 user nova-compute[74189]:   <metadata>
Oct 25 21:20:48 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:20:48 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:20:48 user nova-compute[74189]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1510065369</nova:name>
Oct 25 21:20:48 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:20:47</nova:creationTime>
Oct 25 21:20:48 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:20:48 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:20:48 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:20:48 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:20:48 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:20:48 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:20:48 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:20:48 user nova-compute[74189]:       <nova:owner>
Oct 25 21:20:48 user nova-compute[74189]:         <nova:user uuid="fc377c1beaab443683a6d776f2f734ff">tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member</nova:user>
Oct 25 21:20:48 user nova-compute[74189]:         <nova:project uuid="acbb4f93936848a8949477ad124bf98e">tempest-ServerBootFromVolumeStableRescueTest-571481303</nova:project>
Oct 25 21:20:48 user nova-compute[74189]:       </nova:owner>
Oct 25 21:20:48 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:20:48 user nova-compute[74189]:       <nova:ports>
Oct 25 21:20:48 user nova-compute[74189]:         <nova:port uuid="8f4cdb73-9d83-4bde-82a4-7198b06b904b">
Oct 25 21:20:48 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 25 21:20:48 user nova-compute[74189]:         </nova:port>
Oct 25 21:20:48 user nova-compute[74189]:       </nova:ports>
Oct 25 21:20:48 user nova-compute[74189]:     </nova:instance>
Oct 25 21:20:48 user nova-compute[74189]:   </metadata>
Oct 25 21:20:48 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:20:48 user nova-compute[74189]:     <system>
Oct 25 21:20:48 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:20:48 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:20:48 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:20:48 user nova-compute[74189]:       <entry name="serial">af1d7b3c-9950-4b74-8f15-b31011ccfa24</entry>
Oct 25 21:20:48 user nova-compute[74189]:       <entry name="uuid">af1d7b3c-9950-4b74-8f15-b31011ccfa24</entry>
Oct 25 21:20:48 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:20:48 user nova-compute[74189]:     </system>
Oct 25 21:20:48 user nova-compute[74189]:   </sysinfo>
Oct 25 21:20:48 user nova-compute[74189]:   <os>
Oct 25 21:20:48 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:20:48 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:20:48 user nova-compute[74189]:   </os>
Oct 25 21:20:48 user nova-compute[74189]:   <features>
Oct 25 21:20:48 user nova-compute[74189]:     <acpi/>
Oct 25 21:20:48 user nova-compute[74189]:     <apic/>
Oct 25 21:20:48 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:20:48 user nova-compute[74189]:   </features>
Oct 25 21:20:48 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:20:48 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:20:48 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:20:48 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:20:48 user nova-compute[74189]:   </clock>
Oct 25 21:20:48 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:20:48 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:20:48 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:20:48 user nova-compute[74189]:   </cpu>
Oct 25 21:20:48 user nova-compute[74189]:   <devices>
Oct 25 21:20:48 user nova-compute[74189]:     <disk type="block" device="disk">
Oct 25 21:20:48 user nova-compute[74189]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:20:48 user nova-compute[74189]:       <source dev="/dev/sdb"/>
Oct 25 21:20:48 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:20:48 user nova-compute[74189]:       <serial>2f820341-4749-4ef8-8947-7512bc272c90</serial>
Oct 25 21:20:48 user nova-compute[74189]:     </disk>
Oct 25 21:20:48 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:20:48 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:20:48 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/af1d7b3c-9950-4b74-8f15-b31011ccfa24/disk.rescue"/>
Oct 25 21:20:48 user nova-compute[74189]:       <target dev="vdb" bus="virtio"/>
Oct 25 21:20:48 user nova-compute[74189]:       <boot order="1"/>
Oct 25 21:20:48 user nova-compute[74189]:     </disk>
Oct 25 21:20:48 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:20:48 user nova-compute[74189]:       <mac address="fa:16:3e:03:8e:2f"/>
Oct 25 21:20:48 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:20:48 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:20:48 user nova-compute[74189]:       <target dev="tap8f4cdb73-9d"/>
Oct 25 21:20:48 user nova-compute[74189]:     </interface>
Oct 25 21:20:48 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:20:48 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/af1d7b3c-9950-4b74-8f15-b31011ccfa24/console.log" append="off"/>
Oct 25 21:20:48 user nova-compute[74189]:     </serial>
Oct 25 21:20:48 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:20:48 user nova-compute[74189]:     <video>
Oct 25 21:20:48 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:20:48 user nova-compute[74189]:     </video>
Oct 25 21:20:48 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:20:48 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:20:48 user nova-compute[74189]:     </rng>
Oct 25 21:20:48 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:20:48 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:20:48 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:20:48 user nova-compute[74189]:     </memballoon>
Oct 25 21:20:48 user nova-compute[74189]:   </devices>
Oct 25 21:20:48 user nova-compute[74189]: </domain>
Oct 25 21:20:48 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:20:48 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Instance destroyed successfully.
Oct 25 21:20:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:20:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] No VIF found with MAC fa:16:3e:03:8e:2f, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:20:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:49 user nova-compute[74189]: DEBUG nova.network.neutron [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Successfully updated port: bf1d7d42-01d4-4d66-814b-00a055fd82a5 {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:20:49 user nova-compute[74189]: DEBUG nova.compute.manager [req-9541470b-6b0d-439e-aee9-ca7b3884e90d req-551aef47-a744-4d9b-a6a7-a0a63ebcbe92 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-changed-35311a59-a404-4759-8125-ac222750d5fa {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:20:49 user nova-compute[74189]: DEBUG nova.compute.manager [req-9541470b-6b0d-439e-aee9-ca7b3884e90d req-551aef47-a744-4d9b-a6a7-a0a63ebcbe92 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Refreshing instance network info cache due to event network-changed-35311a59-a404-4759-8125-ac222750d5fa. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:20:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9541470b-6b0d-439e-aee9-ca7b3884e90d req-551aef47-a744-4d9b-a6a7-a0a63ebcbe92 service nova] Acquiring lock "refresh_cache-46ffb192-ad11-416e-9094-c8e080b5414e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:20:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9541470b-6b0d-439e-aee9-ca7b3884e90d req-551aef47-a744-4d9b-a6a7-a0a63ebcbe92 service nova] Acquired lock "refresh_cache-46ffb192-ad11-416e-9094-c8e080b5414e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:20:49 user nova-compute[74189]: DEBUG nova.network.neutron [req-9541470b-6b0d-439e-aee9-ca7b3884e90d req-551aef47-a744-4d9b-a6a7-a0a63ebcbe92 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Refreshing network info cache for port 35311a59-a404-4759-8125-ac222750d5fa {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:20:49 user nova-compute[74189]: DEBUG nova.network.neutron [req-9541470b-6b0d-439e-aee9-ca7b3884e90d req-551aef47-a744-4d9b-a6a7-a0a63ebcbe92 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:20:49 user nova-compute[74189]: DEBUG nova.network.neutron [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Successfully updated port: f967dd2c-da19-4645-b52e-2d79f61baabe {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:20:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:50 user nova-compute[74189]: DEBUG nova.network.neutron [req-9541470b-6b0d-439e-aee9-ca7b3884e90d req-551aef47-a744-4d9b-a6a7-a0a63ebcbe92 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:20:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9541470b-6b0d-439e-aee9-ca7b3884e90d req-551aef47-a744-4d9b-a6a7-a0a63ebcbe92 service nova] Releasing lock "refresh_cache-46ffb192-ad11-416e-9094-c8e080b5414e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:20:50 user nova-compute[74189]: DEBUG nova.compute.manager [req-9541470b-6b0d-439e-aee9-ca7b3884e90d req-551aef47-a744-4d9b-a6a7-a0a63ebcbe92 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-changed-bf1d7d42-01d4-4d66-814b-00a055fd82a5 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:20:50 user nova-compute[74189]: DEBUG nova.compute.manager [req-9541470b-6b0d-439e-aee9-ca7b3884e90d req-551aef47-a744-4d9b-a6a7-a0a63ebcbe92 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Refreshing instance network info cache due to event network-changed-bf1d7d42-01d4-4d66-814b-00a055fd82a5. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:20:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9541470b-6b0d-439e-aee9-ca7b3884e90d req-551aef47-a744-4d9b-a6a7-a0a63ebcbe92 service nova] Acquiring lock "refresh_cache-46ffb192-ad11-416e-9094-c8e080b5414e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:20:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9541470b-6b0d-439e-aee9-ca7b3884e90d req-551aef47-a744-4d9b-a6a7-a0a63ebcbe92 service nova] Acquired lock "refresh_cache-46ffb192-ad11-416e-9094-c8e080b5414e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:20:50 user nova-compute[74189]: DEBUG nova.network.neutron [req-9541470b-6b0d-439e-aee9-ca7b3884e90d req-551aef47-a744-4d9b-a6a7-a0a63ebcbe92 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Refreshing network info cache for port bf1d7d42-01d4-4d66-814b-00a055fd82a5 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:20:50 user nova-compute[74189]: DEBUG nova.network.neutron [req-9541470b-6b0d-439e-aee9-ca7b3884e90d req-551aef47-a744-4d9b-a6a7-a0a63ebcbe92 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:20:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:50 user nova-compute[74189]: DEBUG nova.network.neutron [req-9541470b-6b0d-439e-aee9-ca7b3884e90d req-551aef47-a744-4d9b-a6a7-a0a63ebcbe92 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:20:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9541470b-6b0d-439e-aee9-ca7b3884e90d req-551aef47-a744-4d9b-a6a7-a0a63ebcbe92 service nova] Releasing lock "refresh_cache-46ffb192-ad11-416e-9094-c8e080b5414e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:20:50 user nova-compute[74189]: DEBUG nova.network.neutron [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Successfully updated port: 5f18e575-80eb-41e8-8615-bcbbe00ff9de {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:20:51 user nova-compute[74189]: DEBUG nova.compute.manager [req-5cb599dc-e6b9-49ae-b4a8-424da06673c9 req-a4b22c4b-4d40-4c17-99d5-fa340b2d7c00 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-changed-a334be31-0990-4647-b215-2553698e0050 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:20:51 user nova-compute[74189]: DEBUG nova.compute.manager [req-5cb599dc-e6b9-49ae-b4a8-424da06673c9 req-a4b22c4b-4d40-4c17-99d5-fa340b2d7c00 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Refreshing instance network info cache due to event network-changed-a334be31-0990-4647-b215-2553698e0050. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:20:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-5cb599dc-e6b9-49ae-b4a8-424da06673c9 req-a4b22c4b-4d40-4c17-99d5-fa340b2d7c00 service nova] Acquiring lock "refresh_cache-2486ac33-a881-4be1-a24e-2ff263e51818" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:20:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-5cb599dc-e6b9-49ae-b4a8-424da06673c9 req-a4b22c4b-4d40-4c17-99d5-fa340b2d7c00 service nova] Acquired lock "refresh_cache-2486ac33-a881-4be1-a24e-2ff263e51818" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:20:51 user nova-compute[74189]: DEBUG nova.network.neutron [req-5cb599dc-e6b9-49ae-b4a8-424da06673c9 req-a4b22c4b-4d40-4c17-99d5-fa340b2d7c00 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Refreshing network info cache for port a334be31-0990-4647-b215-2553698e0050 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:20:51 user nova-compute[74189]: DEBUG nova.compute.manager [req-022873a4-efe9-4ba1-ae34-0d04ec890520 req-d6bb7d82-e6b3-486f-8268-6870c6ed9fe2 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-changed-f967dd2c-da19-4645-b52e-2d79f61baabe {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:20:51 user nova-compute[74189]: DEBUG nova.compute.manager [req-022873a4-efe9-4ba1-ae34-0d04ec890520 req-d6bb7d82-e6b3-486f-8268-6870c6ed9fe2 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Refreshing instance network info cache due to event network-changed-f967dd2c-da19-4645-b52e-2d79f61baabe. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:20:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-022873a4-efe9-4ba1-ae34-0d04ec890520 req-d6bb7d82-e6b3-486f-8268-6870c6ed9fe2 service nova] Acquiring lock "refresh_cache-46ffb192-ad11-416e-9094-c8e080b5414e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:20:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-022873a4-efe9-4ba1-ae34-0d04ec890520 req-d6bb7d82-e6b3-486f-8268-6870c6ed9fe2 service nova] Acquired lock "refresh_cache-46ffb192-ad11-416e-9094-c8e080b5414e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:20:51 user nova-compute[74189]: DEBUG nova.network.neutron [req-022873a4-efe9-4ba1-ae34-0d04ec890520 req-d6bb7d82-e6b3-486f-8268-6870c6ed9fe2 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Refreshing network info cache for port f967dd2c-da19-4645-b52e-2d79f61baabe {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:20:51 user nova-compute[74189]: DEBUG nova.network.neutron [req-022873a4-efe9-4ba1-ae34-0d04ec890520 req-d6bb7d82-e6b3-486f-8268-6870c6ed9fe2 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:20:51 user nova-compute[74189]: DEBUG nova.network.neutron [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Successfully updated port: 4caa88c4-c581-41eb-b8f8-a291aaef3ad4 {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:20:51 user nova-compute[74189]: DEBUG nova.network.neutron [req-022873a4-efe9-4ba1-ae34-0d04ec890520 req-d6bb7d82-e6b3-486f-8268-6870c6ed9fe2 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:20:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-022873a4-efe9-4ba1-ae34-0d04ec890520 req-d6bb7d82-e6b3-486f-8268-6870c6ed9fe2 service nova] Releasing lock "refresh_cache-46ffb192-ad11-416e-9094-c8e080b5414e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:20:51 user nova-compute[74189]: DEBUG nova.compute.manager [req-022873a4-efe9-4ba1-ae34-0d04ec890520 req-d6bb7d82-e6b3-486f-8268-6870c6ed9fe2 service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Received event network-vif-plugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:20:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-022873a4-efe9-4ba1-ae34-0d04ec890520 req-d6bb7d82-e6b3-486f-8268-6870c6ed9fe2 service nova] Acquiring lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-022873a4-efe9-4ba1-ae34-0d04ec890520 req-d6bb7d82-e6b3-486f-8268-6870c6ed9fe2 service nova] Lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-022873a4-efe9-4ba1-ae34-0d04ec890520 req-d6bb7d82-e6b3-486f-8268-6870c6ed9fe2 service nova] Lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:51 user nova-compute[74189]: DEBUG nova.compute.manager [req-022873a4-efe9-4ba1-ae34-0d04ec890520 req-d6bb7d82-e6b3-486f-8268-6870c6ed9fe2 service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] No waiting events found dispatching network-vif-plugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:20:51 user nova-compute[74189]: WARNING nova.compute.manager [req-022873a4-efe9-4ba1-ae34-0d04ec890520 req-d6bb7d82-e6b3-486f-8268-6870c6ed9fe2 service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Received unexpected event network-vif-plugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b for instance with vm_state active and task_state rescuing.
Oct 25 21:20:51 user nova-compute[74189]: DEBUG nova.compute.manager [req-022873a4-efe9-4ba1-ae34-0d04ec890520 req-d6bb7d82-e6b3-486f-8268-6870c6ed9fe2 service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Received event network-vif-plugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:20:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-022873a4-efe9-4ba1-ae34-0d04ec890520 req-d6bb7d82-e6b3-486f-8268-6870c6ed9fe2 service nova] Acquiring lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-022873a4-efe9-4ba1-ae34-0d04ec890520 req-d6bb7d82-e6b3-486f-8268-6870c6ed9fe2 service nova] Lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-022873a4-efe9-4ba1-ae34-0d04ec890520 req-d6bb7d82-e6b3-486f-8268-6870c6ed9fe2 service nova] Lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:51 user nova-compute[74189]: DEBUG nova.compute.manager [req-022873a4-efe9-4ba1-ae34-0d04ec890520 req-d6bb7d82-e6b3-486f-8268-6870c6ed9fe2 service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] No waiting events found dispatching network-vif-plugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:20:51 user nova-compute[74189]: WARNING nova.compute.manager [req-022873a4-efe9-4ba1-ae34-0d04ec890520 req-d6bb7d82-e6b3-486f-8268-6870c6ed9fe2 service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Received unexpected event network-vif-plugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b for instance with vm_state active and task_state rescuing.
Oct 25 21:20:51 user nova-compute[74189]: DEBUG nova.compute.manager [req-022873a4-efe9-4ba1-ae34-0d04ec890520 req-d6bb7d82-e6b3-486f-8268-6870c6ed9fe2 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-changed-5f18e575-80eb-41e8-8615-bcbbe00ff9de {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:20:51 user nova-compute[74189]: DEBUG nova.compute.manager [req-022873a4-efe9-4ba1-ae34-0d04ec890520 req-d6bb7d82-e6b3-486f-8268-6870c6ed9fe2 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Refreshing instance network info cache due to event network-changed-5f18e575-80eb-41e8-8615-bcbbe00ff9de. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:20:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-022873a4-efe9-4ba1-ae34-0d04ec890520 req-d6bb7d82-e6b3-486f-8268-6870c6ed9fe2 service nova] Acquiring lock "refresh_cache-46ffb192-ad11-416e-9094-c8e080b5414e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:20:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-022873a4-efe9-4ba1-ae34-0d04ec890520 req-d6bb7d82-e6b3-486f-8268-6870c6ed9fe2 service nova] Acquired lock "refresh_cache-46ffb192-ad11-416e-9094-c8e080b5414e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:20:51 user nova-compute[74189]: DEBUG nova.network.neutron [req-022873a4-efe9-4ba1-ae34-0d04ec890520 req-d6bb7d82-e6b3-486f-8268-6870c6ed9fe2 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Refreshing network info cache for port 5f18e575-80eb-41e8-8615-bcbbe00ff9de {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:20:51 user nova-compute[74189]: DEBUG nova.network.neutron [req-022873a4-efe9-4ba1-ae34-0d04ec890520 req-d6bb7d82-e6b3-486f-8268-6870c6ed9fe2 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:20:52 user nova-compute[74189]: DEBUG nova.network.neutron [req-5cb599dc-e6b9-49ae-b4a8-424da06673c9 req-a4b22c4b-4d40-4c17-99d5-fa340b2d7c00 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Updated VIF entry in instance network info cache for port a334be31-0990-4647-b215-2553698e0050. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:20:52 user nova-compute[74189]: DEBUG nova.network.neutron [req-5cb599dc-e6b9-49ae-b4a8-424da06673c9 req-a4b22c4b-4d40-4c17-99d5-fa340b2d7c00 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Updating instance_info_cache with network_info: [{"id": "a334be31-0990-4647-b215-2553698e0050", "address": "fa:16:3e:86:f6:dc", "network": {"id": "6a880bb8-1359-4925-bb7c-f3383d6fd955", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1357582936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa334be31-09", "ovs_interfaceid": "a334be31-0990-4647-b215-2553698e0050", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a96d3bd5-5996-4171-87ef-082bfe44bb78", "address": "fa:16:3e:2e:ed:e9", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa96d3bd5-59", "ovs_interfaceid": "a96d3bd5-5996-4171-87ef-082bfe44bb78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f10bc396-91ea-4493-8521-69881612dd9f", "address": "fa:16:3e:95:bf:3c", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10bc396-91", "ovs_interfaceid": "f10bc396-91ea-4493-8521-69881612dd9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "81b93608-6fb4-4753-8328-df418f6d3ffe", "address": "fa:16:3e:46:4d:a5", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b93608-6f", "ovs_interfaceid": "81b93608-6fb4-4753-8328-df418f6d3ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fad83a5-d1c9-43d7-9dbd-16970bbb93b3", "address": "fa:16:3e:50:46:46", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fad83a5-d1", "ovs_interfaceid": "3fad83a5-d1c9-43d7-9dbd-16970bbb93b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "532714b6-a025-43e3-bf7b-87f8159ed408", "address": "fa:16:3e:f2:73:ca", "network": {"id": "6223be01-32f0-4db7-8b26-8ad195bbe7f3", "bridge": "br-int", "label": "tempest-device-tagging-net2-127651341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532714b6-a0", "ovs_interfaceid": "532714b6-a025-43e3-bf7b-87f8159ed408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a918de57-be1e-4ddd-b593-533130578da6", "address": "fa:16:3e:07:3c:e2", "network": {"id": "6223be01-32f0-4db7-8b26-8ad195bbe7f3", "bridge": "br-int", "label": "tempest-device-tagging-net2-127651341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa918de57-be", "ovs_interfaceid": "a918de57-be1e-4ddd-b593-533130578da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:20:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-5cb599dc-e6b9-49ae-b4a8-424da06673c9 req-a4b22c4b-4d40-4c17-99d5-fa340b2d7c00 service nova] Releasing lock "refresh_cache-2486ac33-a881-4be1-a24e-2ff263e51818" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:20:52 user nova-compute[74189]: DEBUG nova.network.neutron [req-022873a4-efe9-4ba1-ae34-0d04ec890520 req-d6bb7d82-e6b3-486f-8268-6870c6ed9fe2 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:20:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-022873a4-efe9-4ba1-ae34-0d04ec890520 req-d6bb7d82-e6b3-486f-8268-6870c6ed9fe2 service nova] Releasing lock "refresh_cache-46ffb192-ad11-416e-9094-c8e080b5414e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:20:52 user nova-compute[74189]: DEBUG nova.compute.manager [None req-10aaf08e-fc91-479d-94ad-beedf6af2df8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:20:52 user nova-compute[74189]: DEBUG nova.network.neutron [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Successfully updated port: b60a817a-3478-48d7-b117-bee088bc7e86 {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:20:52 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:53 user nova-compute[74189]: DEBUG nova.network.neutron [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Successfully updated port: 94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56 {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:20:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Acquiring lock "refresh_cache-46ffb192-ad11-416e-9094-c8e080b5414e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:20:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Acquired lock "refresh_cache-46ffb192-ad11-416e-9094-c8e080b5414e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:20:53 user nova-compute[74189]: DEBUG nova.network.neutron [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:20:53 user nova-compute[74189]: DEBUG nova.compute.manager [req-45422742-6e13-4f98-96f0-ba58bd55d3b9 req-b8e56c89-ba5a-4ddd-b7c4-2e52ac8d33e0 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-changed-4caa88c4-c581-41eb-b8f8-a291aaef3ad4 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:20:53 user nova-compute[74189]: DEBUG nova.compute.manager [req-45422742-6e13-4f98-96f0-ba58bd55d3b9 req-b8e56c89-ba5a-4ddd-b7c4-2e52ac8d33e0 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Refreshing instance network info cache due to event network-changed-4caa88c4-c581-41eb-b8f8-a291aaef3ad4. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:20:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-45422742-6e13-4f98-96f0-ba58bd55d3b9 req-b8e56c89-ba5a-4ddd-b7c4-2e52ac8d33e0 service nova] Acquiring lock "refresh_cache-46ffb192-ad11-416e-9094-c8e080b5414e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:20:53 user nova-compute[74189]: DEBUG nova.network.neutron [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:20:53 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Acquiring lock "2486ac33-a881-4be1-a24e-2ff263e51818" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Lock "2486ac33-a881-4be1-a24e-2ff263e51818" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Acquiring lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:54 user nova-compute[74189]: INFO nova.compute.manager [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Terminating instance
Oct 25 21:20:54 user nova-compute[74189]: DEBUG nova.compute.manager [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:20:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:55 user nova-compute[74189]: DEBUG nova.compute.manager [req-c976a3ac-5f16-4ce4-8f8f-5bfeb05194f7 req-98a30fa9-903a-415b-9614-20379be87cbf service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-unplugged-a96d3bd5-5996-4171-87ef-082bfe44bb78 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:20:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c976a3ac-5f16-4ce4-8f8f-5bfeb05194f7 req-98a30fa9-903a-415b-9614-20379be87cbf service nova] Acquiring lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c976a3ac-5f16-4ce4-8f8f-5bfeb05194f7 req-98a30fa9-903a-415b-9614-20379be87cbf service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c976a3ac-5f16-4ce4-8f8f-5bfeb05194f7 req-98a30fa9-903a-415b-9614-20379be87cbf service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.028s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:55 user nova-compute[74189]: DEBUG nova.compute.manager [req-c976a3ac-5f16-4ce4-8f8f-5bfeb05194f7 req-98a30fa9-903a-415b-9614-20379be87cbf service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] No waiting events found dispatching network-vif-unplugged-a96d3bd5-5996-4171-87ef-082bfe44bb78 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:20:55 user nova-compute[74189]: DEBUG nova.compute.manager [req-c976a3ac-5f16-4ce4-8f8f-5bfeb05194f7 req-98a30fa9-903a-415b-9614-20379be87cbf service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-unplugged-a96d3bd5-5996-4171-87ef-082bfe44bb78 for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:20:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:55 user nova-compute[74189]: DEBUG nova.compute.manager [req-0de2704b-cefb-4893-8dcc-c9e7bfc08ece req-7ff7f437-de43-4b95-9912-676f2712894d service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-unplugged-a334be31-0990-4647-b215-2553698e0050 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:20:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0de2704b-cefb-4893-8dcc-c9e7bfc08ece req-7ff7f437-de43-4b95-9912-676f2712894d service nova] Acquiring lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0de2704b-cefb-4893-8dcc-c9e7bfc08ece req-7ff7f437-de43-4b95-9912-676f2712894d service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0de2704b-cefb-4893-8dcc-c9e7bfc08ece req-7ff7f437-de43-4b95-9912-676f2712894d service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:55 user nova-compute[74189]: DEBUG nova.compute.manager [req-0de2704b-cefb-4893-8dcc-c9e7bfc08ece req-7ff7f437-de43-4b95-9912-676f2712894d service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] No waiting events found dispatching network-vif-unplugged-a334be31-0990-4647-b215-2553698e0050 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:20:55 user nova-compute[74189]: DEBUG nova.compute.manager [req-0de2704b-cefb-4893-8dcc-c9e7bfc08ece req-7ff7f437-de43-4b95-9912-676f2712894d service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-unplugged-a334be31-0990-4647-b215-2553698e0050 for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:20:55 user nova-compute[74189]: DEBUG nova.compute.manager [req-0de2704b-cefb-4893-8dcc-c9e7bfc08ece req-7ff7f437-de43-4b95-9912-676f2712894d service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-plugged-a334be31-0990-4647-b215-2553698e0050 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:20:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0de2704b-cefb-4893-8dcc-c9e7bfc08ece req-7ff7f437-de43-4b95-9912-676f2712894d service nova] Acquiring lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0de2704b-cefb-4893-8dcc-c9e7bfc08ece req-7ff7f437-de43-4b95-9912-676f2712894d service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0de2704b-cefb-4893-8dcc-c9e7bfc08ece req-7ff7f437-de43-4b95-9912-676f2712894d service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:55 user nova-compute[74189]: DEBUG nova.compute.manager [req-0de2704b-cefb-4893-8dcc-c9e7bfc08ece req-7ff7f437-de43-4b95-9912-676f2712894d service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] No waiting events found dispatching network-vif-plugged-a334be31-0990-4647-b215-2553698e0050 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:20:55 user nova-compute[74189]: WARNING nova.compute.manager [req-0de2704b-cefb-4893-8dcc-c9e7bfc08ece req-7ff7f437-de43-4b95-9912-676f2712894d service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received unexpected event network-vif-plugged-a334be31-0990-4647-b215-2553698e0050 for instance with vm_state active and task_state deleting.
Oct 25 21:20:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:55 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:20:56 user nova-compute[74189]: DEBUG nova.network.neutron [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Updating instance_info_cache with network_info: [{"id": "35311a59-a404-4759-8125-ac222750d5fa", "address": "fa:16:3e:b5:8d:bc", "network": {"id": "477a555b-610a-4b4f-8e0e-efd52c856097", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1102892168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35311a59-a4", "ovs_interfaceid": "35311a59-a404-4759-8125-ac222750d5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "address": "fa:16:3e:b2:20:8d", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1d7d42-01", "ovs_interfaceid": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f967dd2c-da19-4645-b52e-2d79f61baabe", "address": "fa:16:3e:d1:88:5b", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf967dd2c-da", "ovs_interfaceid": "f967dd2c-da19-4645-b52e-2d79f61baabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f18e575-80eb-41e8-8615-bcbbe00ff9de", "address": "fa:16:3e:c2:d7:0b", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f18e575-80", "ovs_interfaceid": "5f18e575-80eb-41e8-8615-bcbbe00ff9de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4caa88c4-c581-41eb-b8f8-a291aaef3ad4", "address": "fa:16:3e:24:e8:88", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4caa88c4-c5", "ovs_interfaceid": "4caa88c4-c581-41eb-b8f8-a291aaef3ad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b60a817a-3478-48d7-b117-bee088bc7e86", "address": "fa:16:3e:0f:4d:3e", "network": {"id": "68ea97b8-852c-464a-9ccb-b2dc55c63e47", "bridge": "br-int", "label": "tempest-device-tagging-net2-670429054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60a817a-34", "ovs_interfaceid": "b60a817a-3478-48d7-b117-bee088bc7e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56", "address": "fa:16:3e:b0:f9:54", "network": {"id": "68ea97b8-852c-464a-9ccb-b2dc55c63e47", "bridge": "br-int", "label": "tempest-device-tagging-net2-670429054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e0f5a2-44", "ovs_interfaceid": "94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:20:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Releasing lock "refresh_cache-46ffb192-ad11-416e-9094-c8e080b5414e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:20:56 user nova-compute[74189]: DEBUG nova.compute.manager [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Instance network_info: |[{"id": "35311a59-a404-4759-8125-ac222750d5fa", "address": "fa:16:3e:b5:8d:bc", "network": {"id": "477a555b-610a-4b4f-8e0e-efd52c856097", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1102892168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35311a59-a4", "ovs_interfaceid": "35311a59-a404-4759-8125-ac222750d5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "address": "fa:16:3e:b2:20:8d", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1d7d42-01", "ovs_interfaceid": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f967dd2c-da19-4645-b52e-2d79f61baabe", "address": "fa:16:3e:d1:88:5b", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf967dd2c-da", "ovs_interfaceid": "f967dd2c-da19-4645-b52e-2d79f61baabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f18e575-80eb-41e8-8615-bcbbe00ff9de", "address": "fa:16:3e:c2:d7:0b", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f18e575-80", "ovs_interfaceid": "5f18e575-80eb-41e8-8615-bcbbe00ff9de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4caa88c4-c581-41eb-b8f8-a291aaef3ad4", "address": "fa:16:3e:24:e8:88", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4caa88c4-c5", "ovs_interfaceid": "4caa88c4-c581-41eb-b8f8-a291aaef3ad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b60a817a-3478-48d7-b117-bee088bc7e86", "address": "fa:16:3e:0f:4d:3e", "network": {"id": "68ea97b8-852c-464a-9ccb-b2dc55c63e47", "bridge": "br-int", "label": "tempest-device-tagging-net2-670429054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60a817a-34", "ovs_interfaceid": "b60a817a-3478-48d7-b117-bee088bc7e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56", "address": "fa:16:3e:b0:f9:54", "network": {"id": "68ea97b8-852c-464a-9ccb-b2dc55c63e47", "bridge": "br-int", "label": "tempest-device-tagging-net2-670429054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e0f5a2-44", "ovs_interfaceid": "94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:20:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-45422742-6e13-4f98-96f0-ba58bd55d3b9 req-b8e56c89-ba5a-4ddd-b7c4-2e52ac8d33e0 service nova] Acquired lock "refresh_cache-46ffb192-ad11-416e-9094-c8e080b5414e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:20:56 user nova-compute[74189]: DEBUG nova.network.neutron [req-45422742-6e13-4f98-96f0-ba58bd55d3b9 req-b8e56c89-ba5a-4ddd-b7c4-2e52ac8d33e0 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Refreshing network info cache for port 4caa88c4-c581-41eb-b8f8-a291aaef3ad4 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:20:56 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Instance destroyed successfully.
Oct 25 21:20:56 user nova-compute[74189]: DEBUG nova.objects.instance [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Lazy-loading 'resources' on Instance uuid 2486ac33-a881-4be1-a24e-2ff263e51818 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:20:56 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1375118738',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1375118738',id=10,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPXivyD9PSCcBKcZvZh+k/yCFLPwJDEHuTOrNIVdvP9lTOpM/GpVs9+5TWjtEAGNXhI6qiMmJF2Y4WoaXuTzGmcToOKXmvFHYsEcrZJHlJVAiOlqP8yruVD1x6U2Zor9g==',key_name='tempest-keypair-1590854806',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:19:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e30ef76a7fd4aa39509e875017185d8',ramdisk_id='',reservation_id='r-0trr2ecy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-195465062',owner_user_name='tempest-TaggedBootDevicesTest-195465062-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:19:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81350af1f40549588189c612bf5ec551',uuid=2486ac33-a881-4be1-a24e-2ff263e51818,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a334be31-0990-4647-b215-2553698e0050", "address": "fa:16:3e:86:f6:dc", "network": {"id": "6a880bb8-1359-4925-bb7c-f3383d6fd955", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1357582936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa334be31-09", "ovs_interfaceid": "a334be31-0990-4647-b215-2553698e0050", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:20:56 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converting VIF {"id": "a334be31-0990-4647-b215-2553698e0050", "address": "fa:16:3e:86:f6:dc", "network": {"id": "6a880bb8-1359-4925-bb7c-f3383d6fd955", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1357582936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa334be31-09", "ovs_interfaceid": "a334be31-0990-4647-b215-2553698e0050", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:20:56 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:f6:dc,bridge_name='br-int',has_traffic_filtering=True,id=a334be31-0990-4647-b215-2553698e0050,network=Network(6a880bb8-1359-4925-bb7c-f3383d6fd955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa334be31-09') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:20:56 user nova-compute[74189]: DEBUG os_vif [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:f6:dc,bridge_name='br-int',has_traffic_filtering=True,id=a334be31-0990-4647-b215-2553698e0050,network=Network(6a880bb8-1359-4925-bb7c-f3383d6fd955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa334be31-09') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:20:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa334be31-09, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:20:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:20:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8db046f6-ad7f-4c55-a787-ad9aa16d5732) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:20:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:20:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:56 user nova-compute[74189]: INFO os_vif [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:f6:dc,bridge_name='br-int',has_traffic_filtering=True,id=a334be31-0990-4647-b215-2553698e0050,network=Network(6a880bb8-1359-4925-bb7c-f3383d6fd955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa334be31-09')
Oct 25 21:20:56 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1375118738',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1375118738',id=10,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPXivyD9PSCcBKcZvZh+k/yCFLPwJDEHuTOrNIVdvP9lTOpM/GpVs9+5TWjtEAGNXhI6qiMmJF2Y4WoaXuTzGmcToOKXmvFHYsEcrZJHlJVAiOlqP8yruVD1x6U2Zor9g==',key_name='tempest-keypair-1590854806',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:19:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e30ef76a7fd4aa39509e875017185d8',ramdisk_id='',reservation_id='r-0trr2ecy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-195465062',owner_user_name='tempest-TaggedBootDevicesTest-195465062-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:19:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81350af1f40549588189c612bf5ec551',uuid=2486ac33-a881-4be1-a24e-2ff263e51818,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a96d3bd5-5996-4171-87ef-082bfe44bb78", "address": "fa:16:3e:2e:ed:e9", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa96d3bd5-59", "ovs_interfaceid": "a96d3bd5-5996-4171-87ef-082bfe44bb78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:20:56 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converting VIF {"id": "a96d3bd5-5996-4171-87ef-082bfe44bb78", "address": "fa:16:3e:2e:ed:e9", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa96d3bd5-59", "ovs_interfaceid": "a96d3bd5-5996-4171-87ef-082bfe44bb78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:20:56 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ed:e9,bridge_name='br-int',has_traffic_filtering=True,id=a96d3bd5-5996-4171-87ef-082bfe44bb78,network=Network(b51c9c50-8f73-46eb-8974-8391028d0300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa96d3bd5-59') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:20:56 user nova-compute[74189]: DEBUG os_vif [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ed:e9,bridge_name='br-int',has_traffic_filtering=True,id=a96d3bd5-5996-4171-87ef-082bfe44bb78,network=Network(b51c9c50-8f73-46eb-8974-8391028d0300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa96d3bd5-59') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:20:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa96d3bd5-59, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:20:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:20:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eada5708-7ced-4505-8cad-672bf92f0a60) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:20:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:57 user nova-compute[74189]: INFO os_vif [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ed:e9,bridge_name='br-int',has_traffic_filtering=True,id=a96d3bd5-5996-4171-87ef-082bfe44bb78,network=Network(b51c9c50-8f73-46eb-8974-8391028d0300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa96d3bd5-59')
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1375118738',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1375118738',id=10,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPXivyD9PSCcBKcZvZh+k/yCFLPwJDEHuTOrNIVdvP9lTOpM/GpVs9+5TWjtEAGNXhI6qiMmJF2Y4WoaXuTzGmcToOKXmvFHYsEcrZJHlJVAiOlqP8yruVD1x6U2Zor9g==',key_name='tempest-keypair-1590854806',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:19:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e30ef76a7fd4aa39509e875017185d8',ramdisk_id='',reservation_id='r-0trr2ecy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-195465062',owner_user_name='tempest-TaggedBootDevicesTest-195465062-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:19:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81350af1f40549588189c612bf5ec551',uuid=2486ac33-a881-4be1-a24e-2ff263e51818,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f10bc396-91ea-4493-8521-69881612dd9f", "address": "fa:16:3e:95:bf:3c", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10bc396-91", "ovs_interfaceid": "f10bc396-91ea-4493-8521-69881612dd9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converting VIF {"id": "f10bc396-91ea-4493-8521-69881612dd9f", "address": "fa:16:3e:95:bf:3c", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10bc396-91", "ovs_interfaceid": "f10bc396-91ea-4493-8521-69881612dd9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:bf:3c,bridge_name='br-int',has_traffic_filtering=True,id=f10bc396-91ea-4493-8521-69881612dd9f,network=Network(b51c9c50-8f73-46eb-8974-8391028d0300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf10bc396-91') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_vif [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:bf:3c,bridge_name='br-int',has_traffic_filtering=True,id=f10bc396-91ea-4493-8521-69881612dd9f,network=Network(b51c9c50-8f73-46eb-8974-8391028d0300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf10bc396-91') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf10bc396-91, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=909a3928-d844-4476-a7ef-e218ac7c0575) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:57 user nova-compute[74189]: INFO os_vif [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:bf:3c,bridge_name='br-int',has_traffic_filtering=True,id=f10bc396-91ea-4493-8521-69881612dd9f,network=Network(b51c9c50-8f73-46eb-8974-8391028d0300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf10bc396-91')
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1375118738',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1375118738',id=10,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPXivyD9PSCcBKcZvZh+k/yCFLPwJDEHuTOrNIVdvP9lTOpM/GpVs9+5TWjtEAGNXhI6qiMmJF2Y4WoaXuTzGmcToOKXmvFHYsEcrZJHlJVAiOlqP8yruVD1x6U2Zor9g==',key_name='tempest-keypair-1590854806',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:19:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e30ef76a7fd4aa39509e875017185d8',ramdisk_id='',reservation_id='r-0trr2ecy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-195465062',owner_user_name='tempest-TaggedBootDevicesTest-195465062-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:19:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81350af1f40549588189c612bf5ec551',uuid=2486ac33-a881-4be1-a24e-2ff263e51818,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81b93608-6fb4-4753-8328-df418f6d3ffe", "address": "fa:16:3e:46:4d:a5", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b93608-6f", "ovs_interfaceid": "81b93608-6fb4-4753-8328-df418f6d3ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converting VIF {"id": "81b93608-6fb4-4753-8328-df418f6d3ffe", "address": "fa:16:3e:46:4d:a5", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b93608-6f", "ovs_interfaceid": "81b93608-6fb4-4753-8328-df418f6d3ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:4d:a5,bridge_name='br-int',has_traffic_filtering=True,id=81b93608-6fb4-4753-8328-df418f6d3ffe,network=Network(b51c9c50-8f73-46eb-8974-8391028d0300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b93608-6f') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_vif [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:4d:a5,bridge_name='br-int',has_traffic_filtering=True,id=81b93608-6fb4-4753-8328-df418f6d3ffe,network=Network(b51c9c50-8f73-46eb-8974-8391028d0300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b93608-6f') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81b93608-6f, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2815f373-23f2-4231-8084-a562931060e2) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:57 user nova-compute[74189]: INFO os_vif [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:4d:a5,bridge_name='br-int',has_traffic_filtering=True,id=81b93608-6fb4-4753-8328-df418f6d3ffe,network=Network(b51c9c50-8f73-46eb-8974-8391028d0300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b93608-6f')
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1375118738',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1375118738',id=10,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPXivyD9PSCcBKcZvZh+k/yCFLPwJDEHuTOrNIVdvP9lTOpM/GpVs9+5TWjtEAGNXhI6qiMmJF2Y4WoaXuTzGmcToOKXmvFHYsEcrZJHlJVAiOlqP8yruVD1x6U2Zor9g==',key_name='tempest-keypair-1590854806',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:19:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e30ef76a7fd4aa39509e875017185d8',ramdisk_id='',reservation_id='r-0trr2ecy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-195465062',owner_user_name='tempest-TaggedBootDevicesTest-195465062-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:19:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81350af1f40549588189c612bf5ec551',uuid=2486ac33-a881-4be1-a24e-2ff263e51818,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3fad83a5-d1c9-43d7-9dbd-16970bbb93b3", "address": "fa:16:3e:50:46:46", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fad83a5-d1", "ovs_interfaceid": "3fad83a5-d1c9-43d7-9dbd-16970bbb93b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converting VIF {"id": "3fad83a5-d1c9-43d7-9dbd-16970bbb93b3", "address": "fa:16:3e:50:46:46", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fad83a5-d1", "ovs_interfaceid": "3fad83a5-d1c9-43d7-9dbd-16970bbb93b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:46:46,bridge_name='br-int',has_traffic_filtering=True,id=3fad83a5-d1c9-43d7-9dbd-16970bbb93b3,network=Network(b51c9c50-8f73-46eb-8974-8391028d0300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fad83a5-d1') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_vif [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:46:46,bridge_name='br-int',has_traffic_filtering=True,id=3fad83a5-d1c9-43d7-9dbd-16970bbb93b3,network=Network(b51c9c50-8f73-46eb-8974-8391028d0300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fad83a5-d1') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3fad83a5-d1, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97e77755-e6ac-4463-8677-bc8fea51b06e) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-7fba3880-a306-473f-a71c-c3c59e5108a9 req-b7a1fbc8-3a12-42bb-bbb7-f6b0887611ed service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-unplugged-81b93608-6fb4-4753-8328-df418f6d3ffe {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7fba3880-a306-473f-a71c-c3c59e5108a9 req-b7a1fbc8-3a12-42bb-bbb7-f6b0887611ed service nova] Acquiring lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7fba3880-a306-473f-a71c-c3c59e5108a9 req-b7a1fbc8-3a12-42bb-bbb7-f6b0887611ed service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7fba3880-a306-473f-a71c-c3c59e5108a9 req-b7a1fbc8-3a12-42bb-bbb7-f6b0887611ed service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-7fba3880-a306-473f-a71c-c3c59e5108a9 req-b7a1fbc8-3a12-42bb-bbb7-f6b0887611ed service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] No waiting events found dispatching network-vif-unplugged-81b93608-6fb4-4753-8328-df418f6d3ffe {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-7fba3880-a306-473f-a71c-c3c59e5108a9 req-b7a1fbc8-3a12-42bb-bbb7-f6b0887611ed service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-unplugged-81b93608-6fb4-4753-8328-df418f6d3ffe for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:57 user nova-compute[74189]: INFO os_vif [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:46:46,bridge_name='br-int',has_traffic_filtering=True,id=3fad83a5-d1c9-43d7-9dbd-16970bbb93b3,network=Network(b51c9c50-8f73-46eb-8974-8391028d0300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fad83a5-d1')
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1375118738',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1375118738',id=10,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPXivyD9PSCcBKcZvZh+k/yCFLPwJDEHuTOrNIVdvP9lTOpM/GpVs9+5TWjtEAGNXhI6qiMmJF2Y4WoaXuTzGmcToOKXmvFHYsEcrZJHlJVAiOlqP8yruVD1x6U2Zor9g==',key_name='tempest-keypair-1590854806',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:19:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e30ef76a7fd4aa39509e875017185d8',ramdisk_id='',reservation_id='r-0trr2ecy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-195465062',owner_user_name='tempest-TaggedBootDevicesTest-195465062-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:19:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81350af1f40549588189c612bf5ec551',uuid=2486ac33-a881-4be1-a24e-2ff263e51818,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "532714b6-a025-43e3-bf7b-87f8159ed408", "address": "fa:16:3e:f2:73:ca", "network": {"id": "6223be01-32f0-4db7-8b26-8ad195bbe7f3", "bridge": "br-int", "label": "tempest-device-tagging-net2-127651341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532714b6-a0", "ovs_interfaceid": "532714b6-a025-43e3-bf7b-87f8159ed408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converting VIF {"id": "532714b6-a025-43e3-bf7b-87f8159ed408", "address": "fa:16:3e:f2:73:ca", "network": {"id": "6223be01-32f0-4db7-8b26-8ad195bbe7f3", "bridge": "br-int", "label": "tempest-device-tagging-net2-127651341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532714b6-a0", "ovs_interfaceid": "532714b6-a025-43e3-bf7b-87f8159ed408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:73:ca,bridge_name='br-int',has_traffic_filtering=True,id=532714b6-a025-43e3-bf7b-87f8159ed408,network=Network(6223be01-32f0-4db7-8b26-8ad195bbe7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532714b6-a0') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_vif [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:73:ca,bridge_name='br-int',has_traffic_filtering=True,id=532714b6-a025-43e3-bf7b-87f8159ed408,network=Network(6223be01-32f0-4db7-8b26-8ad195bbe7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532714b6-a0') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap532714b6-a0, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f6697380-266e-4c4e-9217-e7fcb5e15b02) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:57 user nova-compute[74189]: INFO os_vif [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:73:ca,bridge_name='br-int',has_traffic_filtering=True,id=532714b6-a025-43e3-bf7b-87f8159ed408,network=Network(6223be01-32f0-4db7-8b26-8ad195bbe7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532714b6-a0')
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1375118738',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1375118738',id=10,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPXivyD9PSCcBKcZvZh+k/yCFLPwJDEHuTOrNIVdvP9lTOpM/GpVs9+5TWjtEAGNXhI6qiMmJF2Y4WoaXuTzGmcToOKXmvFHYsEcrZJHlJVAiOlqP8yruVD1x6U2Zor9g==',key_name='tempest-keypair-1590854806',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:19:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e30ef76a7fd4aa39509e875017185d8',ramdisk_id='',reservation_id='r-0trr2ecy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-195465062',owner_user_name='tempest-TaggedBootDevicesTest-195465062-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:19:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81350af1f40549588189c612bf5ec551',uuid=2486ac33-a881-4be1-a24e-2ff263e51818,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a918de57-be1e-4ddd-b593-533130578da6", "address": "fa:16:3e:07:3c:e2", "network": {"id": "6223be01-32f0-4db7-8b26-8ad195bbe7f3", "bridge": "br-int", "label": "tempest-device-tagging-net2-127651341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa918de57-be", "ovs_interfaceid": "a918de57-be1e-4ddd-b593-533130578da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converting VIF {"id": "a918de57-be1e-4ddd-b593-533130578da6", "address": "fa:16:3e:07:3c:e2", "network": {"id": "6223be01-32f0-4db7-8b26-8ad195bbe7f3", "bridge": "br-int", "label": "tempest-device-tagging-net2-127651341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa918de57-be", "ovs_interfaceid": "a918de57-be1e-4ddd-b593-533130578da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:3c:e2,bridge_name='br-int',has_traffic_filtering=True,id=a918de57-be1e-4ddd-b593-533130578da6,network=Network(6223be01-32f0-4db7-8b26-8ad195bbe7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa918de57-be') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_vif [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:3c:e2,bridge_name='br-int',has_traffic_filtering=True,id=a918de57-be1e-4ddd-b593-533130578da6,network=Network(6223be01-32f0-4db7-8b26-8ad195bbe7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa918de57-be') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa918de57-be, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ffc65608-5533-4b99-a22a-36396a6e60b5) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:57 user nova-compute[74189]: INFO os_vif [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:3c:e2,bridge_name='br-int',has_traffic_filtering=True,id=a918de57-be1e-4ddd-b593-533130578da6,network=Network(6223be01-32f0-4db7-8b26-8ad195bbe7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa918de57-be')
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQtrdIRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:20:57 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec84b49-4c08-4c69-9a2f-2c4f5388f5bd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:20:57 user nova-compute[74189]: No targets found.
Oct 25 21:20:57 user nova-compute[74189]: iSNS:
Oct 25 21:20:57 user nova-compute[74189]: No targets found.
Oct 25 21:20:57 user nova-compute[74189]: STATIC:
Oct 25 21:20:57 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e
Oct 25 21:20:57 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:20:57 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:20:57 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78
Oct 25 21:20:57 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:20:57 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:20:57 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c
Oct 25 21:20:57 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:20:57 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:20:57 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff
Oct 25 21:20:57 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:20:57 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:20:57 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8
Oct 25 21:20:57 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:20:57 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:20:57 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:20:57 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:20:57 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:20:57 user nova-compute[74189]: FIRMWARE:
Oct 25 21:20:57 user nova-compute[74189]: No targets found.
Oct 25 21:20:57 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:20:57 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:20:57 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cfa982-1315-4ae5-a13e-d3a189a6cd48]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-39cbc2c9-5377-4411-95ec-44a9d6e7e9d2 req-d3a67995-e814-4b9a-9701-52495727412e service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-plugged-a96d3bd5-5996-4171-87ef-082bfe44bb78 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-39cbc2c9-5377-4411-95ec-44a9d6e7e9d2 req-d3a67995-e814-4b9a-9701-52495727412e service nova] Acquiring lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-39cbc2c9-5377-4411-95ec-44a9d6e7e9d2 req-d3a67995-e814-4b9a-9701-52495727412e service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-39cbc2c9-5377-4411-95ec-44a9d6e7e9d2 req-d3a67995-e814-4b9a-9701-52495727412e service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-39cbc2c9-5377-4411-95ec-44a9d6e7e9d2 req-d3a67995-e814-4b9a-9701-52495727412e service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] No waiting events found dispatching network-vif-plugged-a96d3bd5-5996-4171-87ef-082bfe44bb78 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:20:57 user nova-compute[74189]: WARNING nova.compute.manager [req-39cbc2c9-5377-4411-95ec-44a9d6e7e9d2 req-d3a67995-e814-4b9a-9701-52495727412e service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received unexpected event network-vif-plugged-a96d3bd5-5996-4171-87ef-082bfe44bb78 for instance with vm_state active and task_state deleting.
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-39cbc2c9-5377-4411-95ec-44a9d6e7e9d2 req-d3a67995-e814-4b9a-9701-52495727412e service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-unplugged-f10bc396-91ea-4493-8521-69881612dd9f {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-39cbc2c9-5377-4411-95ec-44a9d6e7e9d2 req-d3a67995-e814-4b9a-9701-52495727412e service nova] Acquiring lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-39cbc2c9-5377-4411-95ec-44a9d6e7e9d2 req-d3a67995-e814-4b9a-9701-52495727412e service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-39cbc2c9-5377-4411-95ec-44a9d6e7e9d2 req-d3a67995-e814-4b9a-9701-52495727412e service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-39cbc2c9-5377-4411-95ec-44a9d6e7e9d2 req-d3a67995-e814-4b9a-9701-52495727412e service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] No waiting events found dispatching network-vif-unplugged-f10bc396-91ea-4493-8521-69881612dd9f {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-39cbc2c9-5377-4411-95ec-44a9d6e7e9d2 req-d3a67995-e814-4b9a-9701-52495727412e service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-unplugged-f10bc396-91ea-4493-8521-69881612dd9f for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-39cbc2c9-5377-4411-95ec-44a9d6e7e9d2 req-d3a67995-e814-4b9a-9701-52495727412e service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-plugged-f10bc396-91ea-4493-8521-69881612dd9f {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-39cbc2c9-5377-4411-95ec-44a9d6e7e9d2 req-d3a67995-e814-4b9a-9701-52495727412e service nova] Acquiring lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-39cbc2c9-5377-4411-95ec-44a9d6e7e9d2 req-d3a67995-e814-4b9a-9701-52495727412e service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-39cbc2c9-5377-4411-95ec-44a9d6e7e9d2 req-d3a67995-e814-4b9a-9701-52495727412e service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-39cbc2c9-5377-4411-95ec-44a9d6e7e9d2 req-d3a67995-e814-4b9a-9701-52495727412e service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] No waiting events found dispatching network-vif-plugged-f10bc396-91ea-4493-8521-69881612dd9f {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:20:57 user nova-compute[74189]: WARNING nova.compute.manager [req-39cbc2c9-5377-4411-95ec-44a9d6e7e9d2 req-d3a67995-e814-4b9a-9701-52495727412e service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received unexpected event network-vif-plugged-f10bc396-91ea-4493-8521-69881612dd9f for instance with vm_state active and task_state deleting.
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-39cbc2c9-5377-4411-95ec-44a9d6e7e9d2 req-d3a67995-e814-4b9a-9701-52495727412e service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-unplugged-3fad83a5-d1c9-43d7-9dbd-16970bbb93b3 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-39cbc2c9-5377-4411-95ec-44a9d6e7e9d2 req-d3a67995-e814-4b9a-9701-52495727412e service nova] Acquiring lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-39cbc2c9-5377-4411-95ec-44a9d6e7e9d2 req-d3a67995-e814-4b9a-9701-52495727412e service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-39cbc2c9-5377-4411-95ec-44a9d6e7e9d2 req-d3a67995-e814-4b9a-9701-52495727412e service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-39cbc2c9-5377-4411-95ec-44a9d6e7e9d2 req-d3a67995-e814-4b9a-9701-52495727412e service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] No waiting events found dispatching network-vif-unplugged-3fad83a5-d1c9-43d7-9dbd-16970bbb93b3 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-39cbc2c9-5377-4411-95ec-44a9d6e7e9d2 req-d3a67995-e814-4b9a-9701-52495727412e service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-unplugged-3fad83a5-d1c9-43d7-9dbd-16970bbb93b3 for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-39cbc2c9-5377-4411-95ec-44a9d6e7e9d2 req-d3a67995-e814-4b9a-9701-52495727412e service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-plugged-3fad83a5-d1c9-43d7-9dbd-16970bbb93b3 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-39cbc2c9-5377-4411-95ec-44a9d6e7e9d2 req-d3a67995-e814-4b9a-9701-52495727412e service nova] Acquiring lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-39cbc2c9-5377-4411-95ec-44a9d6e7e9d2 req-d3a67995-e814-4b9a-9701-52495727412e service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-39cbc2c9-5377-4411-95ec-44a9d6e7e9d2 req-d3a67995-e814-4b9a-9701-52495727412e service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-39cbc2c9-5377-4411-95ec-44a9d6e7e9d2 req-d3a67995-e814-4b9a-9701-52495727412e service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] No waiting events found dispatching network-vif-plugged-3fad83a5-d1c9-43d7-9dbd-16970bbb93b3 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:20:57 user nova-compute[74189]: WARNING nova.compute.manager [req-39cbc2c9-5377-4411-95ec-44a9d6e7e9d2 req-d3a67995-e814-4b9a-9701-52495727412e service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received unexpected event network-vif-plugged-3fad83a5-d1c9-43d7-9dbd-16970bbb93b3 for instance with vm_state active and task_state deleting.
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfb4d93-733a-47c9-b271-ceec9c51a895]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:20:57 user nova-compute[74189]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)
Oct 25 21:20:57 user nova-compute[74189]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)
Oct 25 21:20:57 user nova-compute[74189]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)
Oct 25 21:20:57 user nova-compute[74189]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:20:57 user nova-compute[74189]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:20:57 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:20:57 user nova-compute[74189]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 (non-flash)
Oct 25 21:20:57 user nova-compute[74189]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)
Oct 25 21:20:57 user nova-compute[74189]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)
Oct 25 21:20:57 user nova-compute[74189]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:20:57 user nova-compute[74189]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:20:57 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2e4385a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8'): ({'sdc'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Removing single pathed devices sdc {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b4f221-df07-45c6-933d-cd60a55b2f13]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e013353f-904f-4d39-aa02-123e40361e1c]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Flushing IO for device /dev/sdc {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a97443-b899-4292-b6ca-b3c4877d3d99]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.068s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bd901e-c223-4660-86b0-c4e1c58f4f0f]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] SCSI volumes sdc have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedef098-7182-4a62-93be-f388dfcfde36]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[55495532-c7c0-4641-8761-065b7d834ff1]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8, portal: 172.16.0.220,3260]
Oct 25 21:20:57 user nova-compute[74189]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8, portal: 172.16.0.220,3260] successful.
Oct 25 21:20:57 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.network.neutron [req-45422742-6e13-4f98-96f0-ba58bd55d3b9 req-b8e56c89-ba5a-4ddd-b7c4-2e52ac8d33e0 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Updated VIF entry in instance network info cache for port 4caa88c4-c581-41eb-b8f8-a291aaef3ad4. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.network.neutron [req-45422742-6e13-4f98-96f0-ba58bd55d3b9 req-b8e56c89-ba5a-4ddd-b7c4-2e52ac8d33e0 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Updating instance_info_cache with network_info: [{"id": "35311a59-a404-4759-8125-ac222750d5fa", "address": "fa:16:3e:b5:8d:bc", "network": {"id": "477a555b-610a-4b4f-8e0e-efd52c856097", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1102892168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35311a59-a4", "ovs_interfaceid": "35311a59-a404-4759-8125-ac222750d5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "address": "fa:16:3e:b2:20:8d", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1d7d42-01", "ovs_interfaceid": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f967dd2c-da19-4645-b52e-2d79f61baabe", "address": "fa:16:3e:d1:88:5b", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf967dd2c-da", "ovs_interfaceid": "f967dd2c-da19-4645-b52e-2d79f61baabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f18e575-80eb-41e8-8615-bcbbe00ff9de", "address": "fa:16:3e:c2:d7:0b", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f18e575-80", "ovs_interfaceid": "5f18e575-80eb-41e8-8615-bcbbe00ff9de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4caa88c4-c581-41eb-b8f8-a291aaef3ad4", "address": "fa:16:3e:24:e8:88", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4caa88c4-c5", "ovs_interfaceid": "4caa88c4-c581-41eb-b8f8-a291aaef3ad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b60a817a-3478-48d7-b117-bee088bc7e86", "address": "fa:16:3e:0f:4d:3e", "network": {"id": "68ea97b8-852c-464a-9ccb-b2dc55c63e47", "bridge": "br-int", "label": "tempest-device-tagging-net2-670429054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60a817a-34", "ovs_interfaceid": "b60a817a-3478-48d7-b117-bee088bc7e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56", "address": "fa:16:3e:b0:f9:54", "network": {"id": "68ea97b8-852c-464a-9ccb-b2dc55c63e47", "bridge": "br-int", "label": "tempest-device-tagging-net2-670429054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e0f5a2-44", "ovs_interfaceid": "94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-45422742-6e13-4f98-96f0-ba58bd55d3b9 req-b8e56c89-ba5a-4ddd-b7c4-2e52ac8d33e0 service nova] Releasing lock "refresh_cache-46ffb192-ad11-416e-9094-c8e080b5414e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-45422742-6e13-4f98-96f0-ba58bd55d3b9 req-b8e56c89-ba5a-4ddd-b7c4-2e52ac8d33e0 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-changed-b60a817a-3478-48d7-b117-bee088bc7e86 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-45422742-6e13-4f98-96f0-ba58bd55d3b9 req-b8e56c89-ba5a-4ddd-b7c4-2e52ac8d33e0 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Refreshing instance network info cache due to event network-changed-b60a817a-3478-48d7-b117-bee088bc7e86. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-45422742-6e13-4f98-96f0-ba58bd55d3b9 req-b8e56c89-ba5a-4ddd-b7c4-2e52ac8d33e0 service nova] Acquiring lock "refresh_cache-46ffb192-ad11-416e-9094-c8e080b5414e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-45422742-6e13-4f98-96f0-ba58bd55d3b9 req-b8e56c89-ba5a-4ddd-b7c4-2e52ac8d33e0 service nova] Acquired lock "refresh_cache-46ffb192-ad11-416e-9094-c8e080b5414e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.network.neutron [req-45422742-6e13-4f98-96f0-ba58bd55d3b9 req-b8e56c89-ba5a-4ddd-b7c4-2e52ac8d33e0 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Refreshing network info cache for port b60a817a-3478-48d7-b117-bee088bc7e86 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41cfb2d8-fd5b-4ffd-bb8e-5765129db2e8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[855c08bc-36a6-4ead-a755-eec172188a4d]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.459s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] <== disconnect_volume: return (460ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDpKXYOd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:20:57 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad3d311-a4eb-4d55-b85a-913de1eafd18]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:20:57 user nova-compute[74189]: No targets found.
Oct 25 21:20:57 user nova-compute[74189]: iSNS:
Oct 25 21:20:57 user nova-compute[74189]: No targets found.
Oct 25 21:20:57 user nova-compute[74189]: STATIC:
Oct 25 21:20:57 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e
Oct 25 21:20:57 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:20:57 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:20:57 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78
Oct 25 21:20:57 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:20:57 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:20:57 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c
Oct 25 21:20:57 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:20:57 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:20:57 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff
Oct 25 21:20:57 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:20:57 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:20:57 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:20:57 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:20:57 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:20:57 user nova-compute[74189]: FIRMWARE:
Oct 25 21:20:57 user nova-compute[74189]: No targets found.
Oct 25 21:20:57 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:20:57 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:20:57 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0ecb7e-2be4-4d2d-8def-f963133260fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1706996f-c930-4403-8044-2c653941b059]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:20:57 user nova-compute[74189]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)
Oct 25 21:20:57 user nova-compute[74189]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)
Oct 25 21:20:57 user nova-compute[74189]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:20:57 user nova-compute[74189]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:20:57 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:20:57 user nova-compute[74189]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c (non-flash)
Oct 25 21:20:57 user nova-compute[74189]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)
Oct 25 21:20:57 user nova-compute[74189]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:20:57 user nova-compute[74189]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:20:57 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe304340790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c'): ({'sdd'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Removing single pathed devices sdd {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf93d64-fc1e-4be5-914c-49d39ee7b6a8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8e8a5c-2230-44eb-903a-fc1777eb9dde]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Flushing IO for device /dev/sdd {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39413de-922b-4c98-bf8c-c96acfaa18d7]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:20:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.062s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7da6d0-74da-4201-87eb-991cb7e1e224]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] SCSI volumes sdd have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b98543-26dd-49cc-81d7-47030e3ba783]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[81085115-03d6-4c26-b156-6134bbf0e56f]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c, portal: 172.16.0.220,3260]
Oct 25 21:20:58 user nova-compute[74189]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c, portal: 172.16.0.220,3260] successful.
Oct 25 21:20:58 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d138f037-f397-45e5-a79a-c3acfa6f679c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d774f22c-6bb4-4881-96e9-1824a04b1624]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] <== disconnect_volume: return (391ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MoGyPOsh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:20:58 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:20:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cd8554-828d-4838-b2ab-4dde1d565af9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:20:58 user nova-compute[74189]: No targets found.
Oct 25 21:20:58 user nova-compute[74189]: iSNS:
Oct 25 21:20:58 user nova-compute[74189]: No targets found.
Oct 25 21:20:58 user nova-compute[74189]: STATIC:
Oct 25 21:20:58 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e
Oct 25 21:20:58 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:20:58 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:20:58 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78
Oct 25 21:20:58 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:20:58 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:20:58 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff
Oct 25 21:20:58 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:20:58 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:20:58 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:20:58 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:20:58 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:20:58 user nova-compute[74189]: FIRMWARE:
Oct 25 21:20:58 user nova-compute[74189]: No targets found.
Oct 25 21:20:58 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:20:58 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:20:58 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[81eb1a29-3e9a-49db-9ffb-749d49d5f1e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa11b3ae-b8f5-48aa-8032-34337f8f48d7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:20:58 user nova-compute[74189]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)
Oct 25 21:20:58 user nova-compute[74189]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:20:58 user nova-compute[74189]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:20:58 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:20:58 user nova-compute[74189]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff (non-flash)
Oct 25 21:20:58 user nova-compute[74189]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:20:58 user nova-compute[74189]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:20:58 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe304340790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff'): ({'sdf'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Removing single pathed devices sdf {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[780e7599-8de0-4641-bb4b-39726086e2d8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a34813-6e0c-47b6-97bf-a36936672ce9]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Flushing IO for device /dev/sdf {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b462f95d-69b2-45ad-93b0-d160a4910fff]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.064s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b50cb6-9755-456a-92fe-0244473ca4a8]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] SCSI volumes sdf have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2fa5ac-1105-4e11-bdc1-45d227526476]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG nova.network.neutron [req-45422742-6e13-4f98-96f0-ba58bd55d3b9 req-b8e56c89-ba5a-4ddd-b7c4-2e52ac8d33e0 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Updated VIF entry in instance network info cache for port b60a817a-3478-48d7-b117-bee088bc7e86. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG nova.network.neutron [req-45422742-6e13-4f98-96f0-ba58bd55d3b9 req-b8e56c89-ba5a-4ddd-b7c4-2e52ac8d33e0 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Updating instance_info_cache with network_info: [{"id": "35311a59-a404-4759-8125-ac222750d5fa", "address": "fa:16:3e:b5:8d:bc", "network": {"id": "477a555b-610a-4b4f-8e0e-efd52c856097", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1102892168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35311a59-a4", "ovs_interfaceid": "35311a59-a404-4759-8125-ac222750d5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "address": "fa:16:3e:b2:20:8d", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1d7d42-01", "ovs_interfaceid": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f967dd2c-da19-4645-b52e-2d79f61baabe", "address": "fa:16:3e:d1:88:5b", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf967dd2c-da", "ovs_interfaceid": "f967dd2c-da19-4645-b52e-2d79f61baabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f18e575-80eb-41e8-8615-bcbbe00ff9de", "address": "fa:16:3e:c2:d7:0b", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f18e575-80", "ovs_interfaceid": "5f18e575-80eb-41e8-8615-bcbbe00ff9de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4caa88c4-c581-41eb-b8f8-a291aaef3ad4", "address": "fa:16:3e:24:e8:88", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4caa88c4-c5", "ovs_interfaceid": "4caa88c4-c581-41eb-b8f8-a291aaef3ad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b60a817a-3478-48d7-b117-bee088bc7e86", "address": "fa:16:3e:0f:4d:3e", "network": {"id": "68ea97b8-852c-464a-9ccb-b2dc55c63e47", "bridge": "br-int", "label": "tempest-device-tagging-net2-670429054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60a817a-34", "ovs_interfaceid": "b60a817a-3478-48d7-b117-bee088bc7e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56", "address": "fa:16:3e:b0:f9:54", "network": {"id": "68ea97b8-852c-464a-9ccb-b2dc55c63e47", "bridge": "br-int", "label": "tempest-device-tagging-net2-670429054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e0f5a2-44", "ovs_interfaceid": "94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-45422742-6e13-4f98-96f0-ba58bd55d3b9 req-b8e56c89-ba5a-4ddd-b7c4-2e52ac8d33e0 service nova] Releasing lock "refresh_cache-46ffb192-ad11-416e-9094-c8e080b5414e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG nova.compute.manager [req-45422742-6e13-4f98-96f0-ba58bd55d3b9 req-b8e56c89-ba5a-4ddd-b7c4-2e52ac8d33e0 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-changed-94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG nova.compute.manager [req-45422742-6e13-4f98-96f0-ba58bd55d3b9 req-b8e56c89-ba5a-4ddd-b7c4-2e52ac8d33e0 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Refreshing instance network info cache due to event network-changed-94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-45422742-6e13-4f98-96f0-ba58bd55d3b9 req-b8e56c89-ba5a-4ddd-b7c4-2e52ac8d33e0 service nova] Acquiring lock "refresh_cache-46ffb192-ad11-416e-9094-c8e080b5414e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-45422742-6e13-4f98-96f0-ba58bd55d3b9 req-b8e56c89-ba5a-4ddd-b7c4-2e52ac8d33e0 service nova] Acquired lock "refresh_cache-46ffb192-ad11-416e-9094-c8e080b5414e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG nova.network.neutron [req-45422742-6e13-4f98-96f0-ba58bd55d3b9 req-b8e56c89-ba5a-4ddd-b7c4-2e52ac8d33e0 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Refreshing network info cache for port 94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d0ba5a-36d0-4734-9bd9-1cb538ea4a6f]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff, portal: 172.16.0.220,3260]
Oct 25 21:20:58 user nova-compute[74189]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff, portal: 172.16.0.220,3260] successful.
Oct 25 21:20:58 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a290ce3-7c8b-460b-919d-a5e149720eff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9b0f24-389a-4b65-aeb9-8900e49fc72b]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] <== disconnect_volume: return (396ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:20:58 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Deleting instance files /opt/stack/data/nova/instances/2486ac33-a881-4be1-a24e-2ff263e51818_del
Oct 25 21:20:58 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Deletion of /opt/stack/data/nova/instances/2486ac33-a881-4be1-a24e-2ff263e51818_del complete
Oct 25 21:20:58 user nova-compute[74189]: INFO nova.compute.manager [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Took 4.35 seconds to destroy the instance on the hypervisor.
Oct 25 21:20:58 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:20:58 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:20:59 user nova-compute[74189]: DEBUG nova.network.neutron [req-45422742-6e13-4f98-96f0-ba58bd55d3b9 req-b8e56c89-ba5a-4ddd-b7c4-2e52ac8d33e0 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Updated VIF entry in instance network info cache for port 94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:20:59 user nova-compute[74189]: DEBUG nova.network.neutron [req-45422742-6e13-4f98-96f0-ba58bd55d3b9 req-b8e56c89-ba5a-4ddd-b7c4-2e52ac8d33e0 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Updating instance_info_cache with network_info: [{"id": "35311a59-a404-4759-8125-ac222750d5fa", "address": "fa:16:3e:b5:8d:bc", "network": {"id": "477a555b-610a-4b4f-8e0e-efd52c856097", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1102892168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35311a59-a4", "ovs_interfaceid": "35311a59-a404-4759-8125-ac222750d5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "address": "fa:16:3e:b2:20:8d", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1d7d42-01", "ovs_interfaceid": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f967dd2c-da19-4645-b52e-2d79f61baabe", "address": "fa:16:3e:d1:88:5b", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf967dd2c-da", "ovs_interfaceid": "f967dd2c-da19-4645-b52e-2d79f61baabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f18e575-80eb-41e8-8615-bcbbe00ff9de", "address": "fa:16:3e:c2:d7:0b", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f18e575-80", "ovs_interfaceid": "5f18e575-80eb-41e8-8615-bcbbe00ff9de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4caa88c4-c581-41eb-b8f8-a291aaef3ad4", "address": "fa:16:3e:24:e8:88", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4caa88c4-c5", "ovs_interfaceid": "4caa88c4-c581-41eb-b8f8-a291aaef3ad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b60a817a-3478-48d7-b117-bee088bc7e86", "address": "fa:16:3e:0f:4d:3e", "network": {"id": "68ea97b8-852c-464a-9ccb-b2dc55c63e47", "bridge": "br-int", "label": "tempest-device-tagging-net2-670429054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60a817a-34", "ovs_interfaceid": "b60a817a-3478-48d7-b117-bee088bc7e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56", "address": "fa:16:3e:b0:f9:54", "network": {"id": "68ea97b8-852c-464a-9ccb-b2dc55c63e47", "bridge": "br-int", "label": "tempest-device-tagging-net2-670429054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e0f5a2-44", "ovs_interfaceid": "94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:20:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-45422742-6e13-4f98-96f0-ba58bd55d3b9 req-b8e56c89-ba5a-4ddd-b7c4-2e52ac8d33e0 service nova] Releasing lock "refresh_cache-46ffb192-ad11-416e-9094-c8e080b5414e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:20:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-689b668a-49f0-4f68-8225-bdc31ea05e48 req-38d90d46-6bcf-4ba1-96dd-b5c6fd93e166 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-plugged-81b93608-6fb4-4753-8328-df418f6d3ffe {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:20:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-689b668a-49f0-4f68-8225-bdc31ea05e48 req-38d90d46-6bcf-4ba1-96dd-b5c6fd93e166 service nova] Acquiring lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-689b668a-49f0-4f68-8225-bdc31ea05e48 req-38d90d46-6bcf-4ba1-96dd-b5c6fd93e166 service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-689b668a-49f0-4f68-8225-bdc31ea05e48 req-38d90d46-6bcf-4ba1-96dd-b5c6fd93e166 service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-689b668a-49f0-4f68-8225-bdc31ea05e48 req-38d90d46-6bcf-4ba1-96dd-b5c6fd93e166 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] No waiting events found dispatching network-vif-plugged-81b93608-6fb4-4753-8328-df418f6d3ffe {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:20:59 user nova-compute[74189]: WARNING nova.compute.manager [req-689b668a-49f0-4f68-8225-bdc31ea05e48 req-38d90d46-6bcf-4ba1-96dd-b5c6fd93e166 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received unexpected event network-vif-plugged-81b93608-6fb4-4753-8328-df418f6d3ffe for instance with vm_state active and task_state deleting.
Oct 25 21:20:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-689b668a-49f0-4f68-8225-bdc31ea05e48 req-38d90d46-6bcf-4ba1-96dd-b5c6fd93e166 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-unplugged-532714b6-a025-43e3-bf7b-87f8159ed408 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:20:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-689b668a-49f0-4f68-8225-bdc31ea05e48 req-38d90d46-6bcf-4ba1-96dd-b5c6fd93e166 service nova] Acquiring lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-689b668a-49f0-4f68-8225-bdc31ea05e48 req-38d90d46-6bcf-4ba1-96dd-b5c6fd93e166 service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-689b668a-49f0-4f68-8225-bdc31ea05e48 req-38d90d46-6bcf-4ba1-96dd-b5c6fd93e166 service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-689b668a-49f0-4f68-8225-bdc31ea05e48 req-38d90d46-6bcf-4ba1-96dd-b5c6fd93e166 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] No waiting events found dispatching network-vif-unplugged-532714b6-a025-43e3-bf7b-87f8159ed408 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:20:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-689b668a-49f0-4f68-8225-bdc31ea05e48 req-38d90d46-6bcf-4ba1-96dd-b5c6fd93e166 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-unplugged-532714b6-a025-43e3-bf7b-87f8159ed408 for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:20:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-689b668a-49f0-4f68-8225-bdc31ea05e48 req-38d90d46-6bcf-4ba1-96dd-b5c6fd93e166 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-plugged-532714b6-a025-43e3-bf7b-87f8159ed408 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:20:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-689b668a-49f0-4f68-8225-bdc31ea05e48 req-38d90d46-6bcf-4ba1-96dd-b5c6fd93e166 service nova] Acquiring lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-689b668a-49f0-4f68-8225-bdc31ea05e48 req-38d90d46-6bcf-4ba1-96dd-b5c6fd93e166 service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-689b668a-49f0-4f68-8225-bdc31ea05e48 req-38d90d46-6bcf-4ba1-96dd-b5c6fd93e166 service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-689b668a-49f0-4f68-8225-bdc31ea05e48 req-38d90d46-6bcf-4ba1-96dd-b5c6fd93e166 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] No waiting events found dispatching network-vif-plugged-532714b6-a025-43e3-bf7b-87f8159ed408 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:20:59 user nova-compute[74189]: WARNING nova.compute.manager [req-689b668a-49f0-4f68-8225-bdc31ea05e48 req-38d90d46-6bcf-4ba1-96dd-b5c6fd93e166 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received unexpected event network-vif-plugged-532714b6-a025-43e3-bf7b-87f8159ed408 for instance with vm_state active and task_state deleting.
Oct 25 21:20:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-43e1fe61-47ea-419e-a049-c62163d71caa req-8b0dc004-08a0-4413-b518-d59298e3adf7 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-unplugged-a918de57-be1e-4ddd-b593-533130578da6 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:20:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-43e1fe61-47ea-419e-a049-c62163d71caa req-8b0dc004-08a0-4413-b518-d59298e3adf7 service nova] Acquiring lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-43e1fe61-47ea-419e-a049-c62163d71caa req-8b0dc004-08a0-4413-b518-d59298e3adf7 service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-43e1fe61-47ea-419e-a049-c62163d71caa req-8b0dc004-08a0-4413-b518-d59298e3adf7 service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-43e1fe61-47ea-419e-a049-c62163d71caa req-8b0dc004-08a0-4413-b518-d59298e3adf7 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] No waiting events found dispatching network-vif-unplugged-a918de57-be1e-4ddd-b593-533130578da6 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:20:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-43e1fe61-47ea-419e-a049-c62163d71caa req-8b0dc004-08a0-4413-b518-d59298e3adf7 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-unplugged-a918de57-be1e-4ddd-b593-533130578da6 for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:20:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-43e1fe61-47ea-419e-a049-c62163d71caa req-8b0dc004-08a0-4413-b518-d59298e3adf7 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-plugged-a918de57-be1e-4ddd-b593-533130578da6 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:20:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-43e1fe61-47ea-419e-a049-c62163d71caa req-8b0dc004-08a0-4413-b518-d59298e3adf7 service nova] Acquiring lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:20:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-43e1fe61-47ea-419e-a049-c62163d71caa req-8b0dc004-08a0-4413-b518-d59298e3adf7 service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:20:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-43e1fe61-47ea-419e-a049-c62163d71caa req-8b0dc004-08a0-4413-b518-d59298e3adf7 service nova] Lock "2486ac33-a881-4be1-a24e-2ff263e51818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:20:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-43e1fe61-47ea-419e-a049-c62163d71caa req-8b0dc004-08a0-4413-b518-d59298e3adf7 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] No waiting events found dispatching network-vif-plugged-a918de57-be1e-4ddd-b593-533130578da6 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:20:59 user nova-compute[74189]: WARNING nova.compute.manager [req-43e1fe61-47ea-419e-a049-c62163d71caa req-8b0dc004-08a0-4413-b518-d59298e3adf7 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received unexpected event network-vif-plugged-a918de57-be1e-4ddd-b593-533130578da6 for instance with vm_state active and task_state deleting.
Oct 25 21:20:59 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:21:00 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:21:00 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:21:00 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Didn't find any instances for network info cache update. {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 21:21:00 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:21:00 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:21:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:00 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:21:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:01 user nova-compute[74189]: DEBUG nova.compute.manager [req-7cee2448-8c1c-4c1b-8014-259b2e3c0846 req-a296f87e-e9df-4e57-8f04-83e84e339b5d service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-deleted-532714b6-a025-43e3-bf7b-87f8159ed408 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:21:01 user nova-compute[74189]: INFO nova.compute.manager [req-7cee2448-8c1c-4c1b-8014-259b2e3c0846 req-a296f87e-e9df-4e57-8f04-83e84e339b5d service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Neutron deleted interface 532714b6-a025-43e3-bf7b-87f8159ed408; detaching it from the instance and deleting it from the info cache
Oct 25 21:21:01 user nova-compute[74189]: DEBUG nova.network.neutron [req-7cee2448-8c1c-4c1b-8014-259b2e3c0846 req-a296f87e-e9df-4e57-8f04-83e84e339b5d service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Updating instance_info_cache with network_info: [{"id": "a334be31-0990-4647-b215-2553698e0050", "address": "fa:16:3e:86:f6:dc", "network": {"id": "6a880bb8-1359-4925-bb7c-f3383d6fd955", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1357582936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa334be31-09", "ovs_interfaceid": "a334be31-0990-4647-b215-2553698e0050", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a96d3bd5-5996-4171-87ef-082bfe44bb78", "address": "fa:16:3e:2e:ed:e9", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa96d3bd5-59", "ovs_interfaceid": "a96d3bd5-5996-4171-87ef-082bfe44bb78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f10bc396-91ea-4493-8521-69881612dd9f", "address": "fa:16:3e:95:bf:3c", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10bc396-91", "ovs_interfaceid": "f10bc396-91ea-4493-8521-69881612dd9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "81b93608-6fb4-4753-8328-df418f6d3ffe", "address": "fa:16:3e:46:4d:a5", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b93608-6f", "ovs_interfaceid": "81b93608-6fb4-4753-8328-df418f6d3ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fad83a5-d1c9-43d7-9dbd-16970bbb93b3", "address": "fa:16:3e:50:46:46", "network": {"id": "b51c9c50-8f73-46eb-8974-8391028d0300", "bridge": "br-int", "label": "tempest-device-tagging-net1-1963549750", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fad83a5-d1", "ovs_interfaceid": "3fad83a5-d1c9-43d7-9dbd-16970bbb93b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a918de57-be1e-4ddd-b593-533130578da6", "address": "fa:16:3e:07:3c:e2", "network": {"id": "6223be01-32f0-4db7-8b26-8ad195bbe7f3", "bridge": "br-int", "label": "tempest-device-tagging-net2-127651341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e30ef76a7fd4aa39509e875017185d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa918de57-be", "ovs_interfaceid": "a918de57-be1e-4ddd-b593-533130578da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:21:01 user nova-compute[74189]: DEBUG nova.compute.manager [req-7cee2448-8c1c-4c1b-8014-259b2e3c0846 req-a296f87e-e9df-4e57-8f04-83e84e339b5d service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Detach interface failed, port_id=532714b6-a025-43e3-bf7b-87f8159ed408, reason: Instance 2486ac33-a881-4be1-a24e-2ff263e51818 could not be found. {{(pid=74189) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 21:21:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "680e134e-5e0d-464f-9e30-460010348795" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "680e134e-5e0d-464f-9e30-460010348795" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:02 user nova-compute[74189]: DEBUG nova.compute.manager [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:21:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:02 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:21:02 user nova-compute[74189]: INFO nova.compute.claims [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Claim successful on node user
Oct 25 21:21:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:02 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:21:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a5eb34-5e63-414b-81d9-12f2b41c699c/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a5eb34-5e63-414b-81d9-12f2b41c699c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a5eb34-5e63-414b-81d9-12f2b41c699c/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:02 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:21:02 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:21:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a5eb34-5e63-414b-81d9-12f2b41c699c/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:21:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af1d7b3c-9950-4b74-8f15-b31011ccfa24/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.872s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:03 user nova-compute[74189]: DEBUG nova.compute.manager [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:21:03 user nova-compute[74189]: DEBUG nova.compute.manager [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:21:03 user nova-compute[74189]: DEBUG nova.network.neutron [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:21:03 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:21:03 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:21:03 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Took 4.58 seconds to deallocate network for instance.
Oct 25 21:21:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af1d7b3c-9950-4b74-8f15-b31011ccfa24/disk.rescue --force-share --output=json" returned: 0 in 0.286s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af1d7b3c-9950-4b74-8f15-b31011ccfa24/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:03 user nova-compute[74189]: DEBUG nova.compute.manager [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:21:03 user nova-compute[74189]: DEBUG nova.compute.manager [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:21:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:21:03 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Creating image(s)
Oct 25 21:21:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "/opt/stack/data/nova/instances/680e134e-5e0d-464f-9e30-460010348795/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "/opt/stack/data/nova/instances/680e134e-5e0d-464f-9e30-460010348795/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "/opt/stack/data/nova/instances/680e134e-5e0d-464f-9e30-460010348795/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af1d7b3c-9950-4b74-8f15-b31011ccfa24/disk.rescue --force-share --output=json" returned: 0 in 0.286s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.220s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.007s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-0a878b56-1baf-4d63-bd0a-0dfd4fd6f89e req-f0faac00-4f11-489e-96b0-c32971ef5808 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-deleted-a918de57-be1e-4ddd-b593-533130578da6 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:21:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-0a878b56-1baf-4d63-bd0a-0dfd4fd6f89e req-f0faac00-4f11-489e-96b0-c32971ef5808 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-deleted-81b93608-6fb4-4753-8328-df418f6d3ffe {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:21:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-0a878b56-1baf-4d63-bd0a-0dfd4fd6f89e req-f0faac00-4f11-489e-96b0-c32971ef5808 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-deleted-a334be31-0990-4647-b215-2553698e0050 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:21:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-0a878b56-1baf-4d63-bd0a-0dfd4fd6f89e req-f0faac00-4f11-489e-96b0-c32971ef5808 service nova] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Received event network-vif-deleted-3fad83a5-d1c9-43d7-9dbd-16970bbb93b3 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:21:03 user nova-compute[74189]: DEBUG nova.policy [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2f19a398fd9486fbef04eebad62a0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a555d708aa644d586d5edad7db837b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:21:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.249s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/680e134e-5e0d-464f-9e30-460010348795/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/680e134e-5e0d-464f-9e30-460010348795/disk 1073741824" returned: 0 in 0.081s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.337s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:21:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.620s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:04 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Checking if we can resize image /opt/stack/data/nova/instances/680e134e-5e0d-464f-9e30-460010348795/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:21:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/680e134e-5e0d-464f-9e30-460010348795/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:04 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:21:04 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:21:04 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=7749MB free_disk=25.39072036743164GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:21:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:04 user nova-compute[74189]: DEBUG nova.network.neutron [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Successfully created port: 41682423-a7e4-44c2-9936-24fe7a965bf9 {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:21:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/680e134e-5e0d-464f-9e30-460010348795/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:04 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Cannot resize image /opt/stack/data/nova/instances/680e134e-5e0d-464f-9e30-460010348795/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:21:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:21:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Ensure instance console log exists: /opt/stack/data/nova/instances/680e134e-5e0d-464f-9e30-460010348795/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:21:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:04 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Applying migration context for instance 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3 as it has an incoming, in-progress migration e69c91a9-6190-44b8-be8b-aa63f8edf28a. Migration status is finished {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 25 21:21:04 user nova-compute[74189]: INFO nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Updating resource usage from migration e69c91a9-6190-44b8-be8b-aa63f8edf28a
Oct 25 21:21:05 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance d7c3a99a-ab38-4e88-896d-94ae51a09a48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance c69c0800-7a6c-4155-9f90-bbcd323276d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance a05b75c0-c064-42c5-aca7-c4b07cfabcfb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 2486ac33-a881-4be1-a24e-2ff263e51818 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance af1d7b3c-9950-4b74-8f15-b31011ccfa24 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 28a5eb34-5e63-414b-81d9-12f2b41c699c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Migration e69c91a9-6190-44b8-be8b-aa63f8edf28a is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 46ffb192-ad11-416e-9094-c8e080b5414e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 680e134e-5e0d-464f-9e30-460010348795 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.696s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74189) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG nova.network.neutron [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Successfully updated port: 41682423-a7e4-44c2-9936-24fe7a965bf9 {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "refresh_cache-680e134e-5e0d-464f-9e30-460010348795" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquired lock "refresh_cache-680e134e-5e0d-464f-9e30-460010348795" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG nova.network.neutron [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:21:05 user nova-compute[74189]: INFO nova.virt.block_device [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Booting with volume 4460d0cc-0295-4c0b-9126-f84e0439c706 at /dev/vdb
Oct 25 21:21:05 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG nova.network.neutron [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Cleaning up deleted instances {{(pid=74189) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] There are 0 instances to clean {{(pid=74189) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG nova.compute.manager [req-2003beb5-6fc1-4f1b-8faa-3b794b538aa0 req-4418869b-6b4e-40f7-bda2-84807884f7ff service nova] [instance: 680e134e-5e0d-464f-9e30-460010348795] Received event network-changed-41682423-a7e4-44c2-9936-24fe7a965bf9 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG nova.compute.manager [req-2003beb5-6fc1-4f1b-8faa-3b794b538aa0 req-4418869b-6b4e-40f7-bda2-84807884f7ff service nova] [instance: 680e134e-5e0d-464f-9e30-460010348795] Refreshing instance network info cache due to event network-changed-41682423-a7e4-44c2-9936-24fe7a965bf9. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2003beb5-6fc1-4f1b-8faa-3b794b538aa0 req-4418869b-6b4e-40f7-bda2-84807884f7ff service nova] Acquiring lock "refresh_cache-680e134e-5e0d-464f-9e30-460010348795" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG os_brick.utils [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[86504ce5-dfd4-4894-80c5-459620f18391]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:05 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bca1584-5f1b-4856-930f-f16275775fc7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[583367a4-5db6-4f20-8c82-0bfba23ba979]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e978a5-1547-42ae-9743-c210714cbe32]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:21:06 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:21:06 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea90fd69-ac0b-4d34-ba1d-7a01bc8d3a87]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG os_brick.utils [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] <== get_connector_properties: return (180ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Updating existing volume attachment record: 324dd01c-c43f-44a4-8e4c-a6fd50bef12e {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG nova.network.neutron [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Updating instance_info_cache with network_info: [{"id": "41682423-a7e4-44c2-9936-24fe7a965bf9", "address": "fa:16:3e:a3:82:56", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41682423-a7", "ovs_interfaceid": "41682423-a7e4-44c2-9936-24fe7a965bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Releasing lock "refresh_cache-680e134e-5e0d-464f-9e30-460010348795" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG nova.compute.manager [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Instance network_info: |[{"id": "41682423-a7e4-44c2-9936-24fe7a965bf9", "address": "fa:16:3e:a3:82:56", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41682423-a7", "ovs_interfaceid": "41682423-a7e4-44c2-9936-24fe7a965bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2003beb5-6fc1-4f1b-8faa-3b794b538aa0 req-4418869b-6b4e-40f7-bda2-84807884f7ff service nova] Acquired lock "refresh_cache-680e134e-5e0d-464f-9e30-460010348795" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG nova.network.neutron [req-2003beb5-6fc1-4f1b-8faa-3b794b538aa0 req-4418869b-6b4e-40f7-bda2-84807884f7ff service nova] [instance: 680e134e-5e0d-464f-9e30-460010348795] Refreshing network info cache for port 41682423-a7e4-44c2-9936-24fe7a965bf9 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Start _get_guest_xml network_info=[{"id": "41682423-a7e4-44c2-9936-24fe7a965bf9", "address": "fa:16:3e:a3:82:56", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41682423-a7", "ovs_interfaceid": "41682423-a7e4-44c2-9936-24fe7a965bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:21:06 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:21:06 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:21:06 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:21:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1656701919',display_name='tempest-AttachVolumeNegativeTest-server-1656701919',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1656701919',id=16,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZADoVdjAPdniZ9l1cLdzDlzqU7uPibv2D8hZ950ZNhbevYe/TwT2kBxZJzDgqXzaQwRBq2gxzbSIRRpmP9G1//QYPdGcaaIEP+v5+OP4OH7E6GuC6Dxx+ydlAVXrRbbA==',key_name='tempest-keypair-1430001064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a555d708aa644d586d5edad7db837b4',ramdisk_id='',reservation_id='r-r0390wd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-979681322',owner_user_name='tempest-AttachVolumeNegativeTest-979681322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:21:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2f19a398fd9486fbef04eebad62a0cb',uuid=680e134e-5e0d-464f-9e30-460010348795,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41682423-a7e4-44c2-9936-24fe7a965bf9", "address": "fa:16:3e:a3:82:56", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41682423-a7", "ovs_interfaceid": "41682423-a7e4-44c2-9936-24fe7a965bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Converting VIF {"id": "41682423-a7e4-44c2-9936-24fe7a965bf9", "address": "fa:16:3e:a3:82:56", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41682423-a7", "ovs_interfaceid": "41682423-a7e4-44c2-9936-24fe7a965bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:82:56,bridge_name='br-int',has_traffic_filtering=True,id=41682423-a7e4-44c2-9936-24fe7a965bf9,network=Network(5029031b-e67b-4f60-bc17-781cbdc88b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41682423-a7') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG nova.objects.instance [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lazy-loading 'pci_devices' on Instance uuid 680e134e-5e0d-464f-9e30-460010348795 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:21:06 user nova-compute[74189]:   <uuid>680e134e-5e0d-464f-9e30-460010348795</uuid>
Oct 25 21:21:06 user nova-compute[74189]:   <name>instance-00000010</name>
Oct 25 21:21:06 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:21:06 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:21:06 user nova-compute[74189]:   <metadata>
Oct 25 21:21:06 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:21:06 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:21:06 user nova-compute[74189]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1656701919</nova:name>
Oct 25 21:21:06 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:21:06</nova:creationTime>
Oct 25 21:21:06 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:21:06 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:21:06 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:21:06 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:21:06 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:21:06 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:21:06 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:21:06 user nova-compute[74189]:       <nova:owner>
Oct 25 21:21:06 user nova-compute[74189]:         <nova:user uuid="a2f19a398fd9486fbef04eebad62a0cb">tempest-AttachVolumeNegativeTest-979681322-project-member</nova:user>
Oct 25 21:21:06 user nova-compute[74189]:         <nova:project uuid="4a555d708aa644d586d5edad7db837b4">tempest-AttachVolumeNegativeTest-979681322</nova:project>
Oct 25 21:21:06 user nova-compute[74189]:       </nova:owner>
Oct 25 21:21:06 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:21:06 user nova-compute[74189]:       <nova:ports>
Oct 25 21:21:06 user nova-compute[74189]:         <nova:port uuid="41682423-a7e4-44c2-9936-24fe7a965bf9">
Oct 25 21:21:06 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 25 21:21:06 user nova-compute[74189]:         </nova:port>
Oct 25 21:21:06 user nova-compute[74189]:       </nova:ports>
Oct 25 21:21:06 user nova-compute[74189]:     </nova:instance>
Oct 25 21:21:06 user nova-compute[74189]:   </metadata>
Oct 25 21:21:06 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:21:06 user nova-compute[74189]:     <system>
Oct 25 21:21:06 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:21:06 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:21:06 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:21:06 user nova-compute[74189]:       <entry name="serial">680e134e-5e0d-464f-9e30-460010348795</entry>
Oct 25 21:21:06 user nova-compute[74189]:       <entry name="uuid">680e134e-5e0d-464f-9e30-460010348795</entry>
Oct 25 21:21:06 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:21:06 user nova-compute[74189]:     </system>
Oct 25 21:21:06 user nova-compute[74189]:   </sysinfo>
Oct 25 21:21:06 user nova-compute[74189]:   <os>
Oct 25 21:21:06 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:21:06 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:21:06 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:21:06 user nova-compute[74189]:   </os>
Oct 25 21:21:06 user nova-compute[74189]:   <features>
Oct 25 21:21:06 user nova-compute[74189]:     <acpi/>
Oct 25 21:21:06 user nova-compute[74189]:     <apic/>
Oct 25 21:21:06 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:21:06 user nova-compute[74189]:   </features>
Oct 25 21:21:06 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:21:06 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:21:06 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:21:06 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:21:06 user nova-compute[74189]:   </clock>
Oct 25 21:21:06 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:21:06 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:21:06 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:21:06 user nova-compute[74189]:   </cpu>
Oct 25 21:21:06 user nova-compute[74189]:   <devices>
Oct 25 21:21:06 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:21:06 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:21:06 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/680e134e-5e0d-464f-9e30-460010348795/disk"/>
Oct 25 21:21:06 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:21:06 user nova-compute[74189]:     </disk>
Oct 25 21:21:06 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:21:06 user nova-compute[74189]:       <mac address="fa:16:3e:a3:82:56"/>
Oct 25 21:21:06 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:21:06 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:21:06 user nova-compute[74189]:       <target dev="tap41682423-a7"/>
Oct 25 21:21:06 user nova-compute[74189]:     </interface>
Oct 25 21:21:06 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:21:06 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/680e134e-5e0d-464f-9e30-460010348795/console.log" append="off"/>
Oct 25 21:21:06 user nova-compute[74189]:     </serial>
Oct 25 21:21:06 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:21:06 user nova-compute[74189]:     <video>
Oct 25 21:21:06 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:21:06 user nova-compute[74189]:     </video>
Oct 25 21:21:06 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:21:06 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:21:06 user nova-compute[74189]:     </rng>
Oct 25 21:21:06 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:21:06 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:21:06 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:21:06 user nova-compute[74189]:     </memballoon>
Oct 25 21:21:06 user nova-compute[74189]:   </devices>
Oct 25 21:21:06 user nova-compute[74189]: </domain>
Oct 25 21:21:06 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:21:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1656701919',display_name='tempest-AttachVolumeNegativeTest-server-1656701919',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1656701919',id=16,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZADoVdjAPdniZ9l1cLdzDlzqU7uPibv2D8hZ950ZNhbevYe/TwT2kBxZJzDgqXzaQwRBq2gxzbSIRRpmP9G1//QYPdGcaaIEP+v5+OP4OH7E6GuC6Dxx+ydlAVXrRbbA==',key_name='tempest-keypair-1430001064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a555d708aa644d586d5edad7db837b4',ramdisk_id='',reservation_id='r-r0390wd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-979681322',owner_user_name='tempest-AttachVolumeNegativeTest-979681322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:21:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2f19a398fd9486fbef04eebad62a0cb',uuid=680e134e-5e0d-464f-9e30-460010348795,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41682423-a7e4-44c2-9936-24fe7a965bf9", "address": "fa:16:3e:a3:82:56", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41682423-a7", "ovs_interfaceid": "41682423-a7e4-44c2-9936-24fe7a965bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Converting VIF {"id": "41682423-a7e4-44c2-9936-24fe7a965bf9", "address": "fa:16:3e:a3:82:56", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41682423-a7", "ovs_interfaceid": "41682423-a7e4-44c2-9936-24fe7a965bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:82:56,bridge_name='br-int',has_traffic_filtering=True,id=41682423-a7e4-44c2-9936-24fe7a965bf9,network=Network(5029031b-e67b-4f60-bc17-781cbdc88b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41682423-a7') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG os_vif [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:82:56,bridge_name='br-int',has_traffic_filtering=True,id=41682423-a7e4-44c2-9936-24fe7a965bf9,network=Network(5029031b-e67b-4f60-bc17-781cbdc88b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41682423-a7') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db552572-e88b-5016-99e3-a889e2ea4684', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41682423-a7, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap41682423-a7, col_values=(('qos', UUID('1267250b-42c9-4650-a6cd-2f594e73e514')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap41682423-a7, col_values=(('external_ids', {'iface-id': '41682423-a7e4-44c2-9936-24fe7a965bf9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:82:56', 'vm-uuid': '680e134e-5e0d-464f-9e30-460010348795'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:06 user nova-compute[74189]: INFO os_vif [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:82:56,bridge_name='br-int',has_traffic_filtering=True,id=41682423-a7e4-44c2-9936-24fe7a965bf9,network=Network(5029031b-e67b-4f60-bc17-781cbdc88b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41682423-a7')
Oct 25 21:21:06 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] No VIF found with MAC fa:16:3e:a3:82:56, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG nova.network.neutron [req-2003beb5-6fc1-4f1b-8faa-3b794b538aa0 req-4418869b-6b4e-40f7-bda2-84807884f7ff service nova] [instance: 680e134e-5e0d-464f-9e30-460010348795] Updated VIF entry in instance network info cache for port 41682423-a7e4-44c2-9936-24fe7a965bf9. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG nova.network.neutron [req-2003beb5-6fc1-4f1b-8faa-3b794b538aa0 req-4418869b-6b4e-40f7-bda2-84807884f7ff service nova] [instance: 680e134e-5e0d-464f-9e30-460010348795] Updating instance_info_cache with network_info: [{"id": "41682423-a7e4-44c2-9936-24fe7a965bf9", "address": "fa:16:3e:a3:82:56", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41682423-a7", "ovs_interfaceid": "41682423-a7e4-44c2-9936-24fe7a965bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:21:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2003beb5-6fc1-4f1b-8faa-3b794b538aa0 req-4418869b-6b4e-40f7-bda2-84807884f7ff service nova] Releasing lock "refresh_cache-680e134e-5e0d-464f-9e30-460010348795" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:21:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:08 user nova-compute[74189]: DEBUG nova.compute.manager [req-ac74ad2e-2dc4-4c94-b98e-e75b10c62b08 req-3bff956d-a5f7-4da8-aeba-0e435c2d6290 service nova] [instance: 680e134e-5e0d-464f-9e30-460010348795] Received event network-vif-plugged-41682423-a7e4-44c2-9936-24fe7a965bf9 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:21:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ac74ad2e-2dc4-4c94-b98e-e75b10c62b08 req-3bff956d-a5f7-4da8-aeba-0e435c2d6290 service nova] Acquiring lock "680e134e-5e0d-464f-9e30-460010348795-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ac74ad2e-2dc4-4c94-b98e-e75b10c62b08 req-3bff956d-a5f7-4da8-aeba-0e435c2d6290 service nova] Lock "680e134e-5e0d-464f-9e30-460010348795-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ac74ad2e-2dc4-4c94-b98e-e75b10c62b08 req-3bff956d-a5f7-4da8-aeba-0e435c2d6290 service nova] Lock "680e134e-5e0d-464f-9e30-460010348795-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:08 user nova-compute[74189]: DEBUG nova.compute.manager [req-ac74ad2e-2dc4-4c94-b98e-e75b10c62b08 req-3bff956d-a5f7-4da8-aeba-0e435c2d6290 service nova] [instance: 680e134e-5e0d-464f-9e30-460010348795] No waiting events found dispatching network-vif-plugged-41682423-a7e4-44c2-9936-24fe7a965bf9 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:21:08 user nova-compute[74189]: WARNING nova.compute.manager [req-ac74ad2e-2dc4-4c94-b98e-e75b10c62b08 req-3bff956d-a5f7-4da8-aeba-0e435c2d6290 service nova] [instance: 680e134e-5e0d-464f-9e30-460010348795] Received unexpected event network-vif-plugged-41682423-a7e4-44c2-9936-24fe7a965bf9 for instance with vm_state building and task_state spawning.
Oct 25 21:21:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:09 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:10 user nova-compute[74189]: DEBUG nova.compute.manager [req-402bfd31-b97c-478b-8bf6-ea03dff40f3b req-52247a62-e863-4838-b0e2-c953051fcfb6 service nova] [instance: 680e134e-5e0d-464f-9e30-460010348795] Received event network-vif-plugged-41682423-a7e4-44c2-9936-24fe7a965bf9 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:21:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-402bfd31-b97c-478b-8bf6-ea03dff40f3b req-52247a62-e863-4838-b0e2-c953051fcfb6 service nova] Acquiring lock "680e134e-5e0d-464f-9e30-460010348795-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-402bfd31-b97c-478b-8bf6-ea03dff40f3b req-52247a62-e863-4838-b0e2-c953051fcfb6 service nova] Lock "680e134e-5e0d-464f-9e30-460010348795-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-402bfd31-b97c-478b-8bf6-ea03dff40f3b req-52247a62-e863-4838-b0e2-c953051fcfb6 service nova] Lock "680e134e-5e0d-464f-9e30-460010348795-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:10 user nova-compute[74189]: DEBUG nova.compute.manager [req-402bfd31-b97c-478b-8bf6-ea03dff40f3b req-52247a62-e863-4838-b0e2-c953051fcfb6 service nova] [instance: 680e134e-5e0d-464f-9e30-460010348795] No waiting events found dispatching network-vif-plugged-41682423-a7e4-44c2-9936-24fe7a965bf9 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:21:10 user nova-compute[74189]: WARNING nova.compute.manager [req-402bfd31-b97c-478b-8bf6-ea03dff40f3b req-52247a62-e863-4838-b0e2-c953051fcfb6 service nova] [instance: 680e134e-5e0d-464f-9e30-460010348795] Received unexpected event network-vif-plugged-41682423-a7e4-44c2-9936-24fe7a965bf9 for instance with vm_state building and task_state spawning.
Oct 25 21:21:10 user nova-compute[74189]: DEBUG nova.compute.manager [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:21:10 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:21:10 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 680e134e-5e0d-464f-9e30-460010348795] Instance spawned successfully.
Oct 25 21:21:10 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:21:10 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:21:10 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:21:10 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:21:10 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:21:10 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:21:10 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:21:10 user nova-compute[74189]: INFO nova.compute.manager [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Took 7.18 seconds to spawn the instance on the hypervisor.
Oct 25 21:21:10 user nova-compute[74189]: DEBUG nova.compute.manager [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:21:10 user nova-compute[74189]: INFO nova.compute.manager [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Took 8.58 seconds to build instance.
Oct 25 21:21:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-39974cce-8071-4aa9-9616-259799aac8cc tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "680e134e-5e0d-464f-9e30-460010348795" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.808s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:11 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:12 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e793c65e-679e-4f02-8d9e-4ff4a9fe7a65 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Acquiring lock "4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e793c65e-679e-4f02-8d9e-4ff4a9fe7a65 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e793c65e-679e-4f02-8d9e-4ff4a9fe7a65 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Acquiring lock "4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e793c65e-679e-4f02-8d9e-4ff4a9fe7a65 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e793c65e-679e-4f02-8d9e-4ff4a9fe7a65 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:13 user nova-compute[74189]: INFO nova.compute.manager [None req-e793c65e-679e-4f02-8d9e-4ff4a9fe7a65 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Terminating instance
Oct 25 21:21:13 user nova-compute[74189]: DEBUG nova.compute.manager [None req-e793c65e-679e-4f02-8d9e-4ff4a9fe7a65 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:21:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:14 user nova-compute[74189]: DEBUG nova.compute.manager [req-460efb70-b1c6-403b-b017-76719fd195f2 req-ce7ff049-052f-4f40-83d1-0dedb536cd23 service nova] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Received event network-vif-unplugged-8df72a30-cfbf-4025-a343-f47fe0978c35 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:21:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-460efb70-b1c6-403b-b017-76719fd195f2 req-ce7ff049-052f-4f40-83d1-0dedb536cd23 service nova] Acquiring lock "4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-460efb70-b1c6-403b-b017-76719fd195f2 req-ce7ff049-052f-4f40-83d1-0dedb536cd23 service nova] Lock "4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-460efb70-b1c6-403b-b017-76719fd195f2 req-ce7ff049-052f-4f40-83d1-0dedb536cd23 service nova] Lock "4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:14 user nova-compute[74189]: DEBUG nova.compute.manager [req-460efb70-b1c6-403b-b017-76719fd195f2 req-ce7ff049-052f-4f40-83d1-0dedb536cd23 service nova] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] No waiting events found dispatching network-vif-unplugged-8df72a30-cfbf-4025-a343-f47fe0978c35 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:21:14 user nova-compute[74189]: DEBUG nova.compute.manager [req-460efb70-b1c6-403b-b017-76719fd195f2 req-ce7ff049-052f-4f40-83d1-0dedb536cd23 service nova] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Received event network-vif-unplugged-8df72a30-cfbf-4025-a343-f47fe0978c35 for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:21:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:14 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Instance destroyed successfully.
Oct 25 21:21:14 user nova-compute[74189]: DEBUG nova.objects.instance [None req-e793c65e-679e-4f02-8d9e-4ff4a9fe7a65 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lazy-loading 'resources' on Instance uuid 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:21:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-e793c65e-679e-4f02-8d9e-4ff4a9fe7a65 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:19:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-338936039',display_name='tempest-VolumesAdminNegativeTest-server-338936039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-338936039',id=13,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:19:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09c2027cbebd4ffd9989ba14156beeba',ramdisk_id='',reservation_id='r-ftlf6yfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-892271548',owner_user_name='tempest-VolumesAdminNegativeTest-892271548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:19:13Z,user_data=None,user_id='522bbceca0c6444cb16bb575f4186c5c',uuid=4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8df72a30-cfbf-4025-a343-f47fe0978c35", "address": "fa:16:3e:19:6d:f5", "network": {"id": "093e46a2-3a83-46b5-a13b-661868863db1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1577201171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09c2027cbebd4ffd9989ba14156beeba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df72a30-cf", "ovs_interfaceid": "8df72a30-cfbf-4025-a343-f47fe0978c35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:21:14 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-e793c65e-679e-4f02-8d9e-4ff4a9fe7a65 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Converting VIF {"id": "8df72a30-cfbf-4025-a343-f47fe0978c35", "address": "fa:16:3e:19:6d:f5", "network": {"id": "093e46a2-3a83-46b5-a13b-661868863db1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1577201171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09c2027cbebd4ffd9989ba14156beeba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df72a30-cf", "ovs_interfaceid": "8df72a30-cfbf-4025-a343-f47fe0978c35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:21:14 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-e793c65e-679e-4f02-8d9e-4ff4a9fe7a65 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:6d:f5,bridge_name='br-int',has_traffic_filtering=True,id=8df72a30-cfbf-4025-a343-f47fe0978c35,network=Network(093e46a2-3a83-46b5-a13b-661868863db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8df72a30-cf') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:21:14 user nova-compute[74189]: DEBUG os_vif [None req-e793c65e-679e-4f02-8d9e-4ff4a9fe7a65 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:6d:f5,bridge_name='br-int',has_traffic_filtering=True,id=8df72a30-cfbf-4025-a343-f47fe0978c35,network=Network(093e46a2-3a83-46b5-a13b-661868863db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8df72a30-cf') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:21:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8df72a30-cf, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:21:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d9be0601-e19a-41a8-8abe-9a322d148e92) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:14 user nova-compute[74189]: INFO os_vif [None req-e793c65e-679e-4f02-8d9e-4ff4a9fe7a65 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:6d:f5,bridge_name='br-int',has_traffic_filtering=True,id=8df72a30-cfbf-4025-a343-f47fe0978c35,network=Network(093e46a2-3a83-46b5-a13b-661868863db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8df72a30-cf')
Oct 25 21:21:14 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-e793c65e-679e-4f02-8d9e-4ff4a9fe7a65 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Deleting instance files /opt/stack/data/nova/instances/4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f_del
Oct 25 21:21:14 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-e793c65e-679e-4f02-8d9e-4ff4a9fe7a65 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Deletion of /opt/stack/data/nova/instances/4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f_del complete
Oct 25 21:21:14 user nova-compute[74189]: INFO nova.compute.manager [None req-e793c65e-679e-4f02-8d9e-4ff4a9fe7a65 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 25 21:21:14 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-e793c65e-679e-4f02-8d9e-4ff4a9fe7a65 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:21:14 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:21:14 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:21:15 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:21:15 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Took 0.56 seconds to deallocate network for instance.
Oct 25 21:21:15 user nova-compute[74189]: DEBUG nova.compute.manager [req-be50c866-baad-4c8b-a504-806505c20948 req-e3a3ce2f-f972-44a2-b6b1-9c8b2417cb5a service nova] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Received event network-vif-deleted-8df72a30-cfbf-4025-a343-f47fe0978c35 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:21:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Acquiring lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Acquiring lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:15 user nova-compute[74189]: INFO nova.compute.manager [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Terminating instance
Oct 25 21:21:15 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:21:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e793c65e-679e-4f02-8d9e-4ff4a9fe7a65 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e793c65e-679e-4f02-8d9e-4ff4a9fe7a65 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:15 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-e793c65e-679e-4f02-8d9e-4ff4a9fe7a65 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:21:15 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-e793c65e-679e-4f02-8d9e-4ff4a9fe7a65 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:21:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e793c65e-679e-4f02-8d9e-4ff4a9fe7a65 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.585s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:15 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-e793c65e-679e-4f02-8d9e-4ff4a9fe7a65 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Deleted allocations for instance 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f
Oct 25 21:21:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e793c65e-679e-4f02-8d9e-4ff4a9fe7a65 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.268s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:16 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Instance destroyed successfully.
Oct 25 21:21:16 user nova-compute[74189]: DEBUG nova.objects.instance [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lazy-loading 'resources' on Instance uuid a05b75c0-c064-42c5-aca7-c4b07cfabcfb {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T21:16:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1713435964',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1904014555',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVLWL/l3Vh79OaGgsN5D2te6r87t4qcVR5zA3W/Bg4mTE1zl7sJSoyjbQnhD3AeWV9gsQAwGKkMtvg9ZV6+YMk7vzNB4DgcV0PFaLz2rgjVpHTuxF9n1BWLqiTcunhiVw==',key_name='tempest-keypair-1447510267',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:19:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4aa384e522324f0fa297ca277820909f',ramdisk_id='',reservation_id='r-z4gtu1al',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1192138157',owner_user_name='tempest-ServerActionsV293TestJSON-1192138157-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:19:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df67ddee61b04820b0968636a2eddbed',uuid=a05b75c0-c064-42c5-aca7-c4b07cfabcfb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "address": "fa:16:3e:88:75:56", "network": {"id": "75c09903-d1c6-4197-bc70-cfe7f3e7a772", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1909568880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa384e522324f0fa297ca277820909f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd28e4203-5f", "ovs_interfaceid": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Converting VIF {"id": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "address": "fa:16:3e:88:75:56", "network": {"id": "75c09903-d1c6-4197-bc70-cfe7f3e7a772", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1909568880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa384e522324f0fa297ca277820909f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd28e4203-5f", "ovs_interfaceid": "d28e4203-5fff-4a0b-b360-fe29bfa131b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:75:56,bridge_name='br-int',has_traffic_filtering=True,id=d28e4203-5fff-4a0b-b360-fe29bfa131b8,network=Network(75c09903-d1c6-4197-bc70-cfe7f3e7a772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd28e4203-5f') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG os_vif [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:75:56,bridge_name='br-int',has_traffic_filtering=True,id=d28e4203-5fff-4a0b-b360-fe29bfa131b8,network=Network(75c09903-d1c6-4197-bc70-cfe7f3e7a772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd28e4203-5f') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd28e4203-5f, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=10eb36c2-e578-401d-a4f9-5aa309fb46de) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:16 user nova-compute[74189]: INFO os_vif [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:75:56,bridge_name='br-int',has_traffic_filtering=True,id=d28e4203-5fff-4a0b-b360-fe29bfa131b8,network=Network(75c09903-d1c6-4197-bc70-cfe7f3e7a772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd28e4203-5f')
Oct 25 21:21:16 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fKgarFiL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:21:16 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:21:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG nova.compute.manager [req-d93cc5b1-b2c2-4846-8e16-a3e75c77f236 req-d0c99f59-68e5-418b-8ca7-93ac1571dd7f service nova] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Received event network-vif-plugged-8df72a30-cfbf-4025-a343-f47fe0978c35 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d93cc5b1-b2c2-4846-8e16-a3e75c77f236 req-d0c99f59-68e5-418b-8ca7-93ac1571dd7f service nova] Acquiring lock "4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d93cc5b1-b2c2-4846-8e16-a3e75c77f236 req-d0c99f59-68e5-418b-8ca7-93ac1571dd7f service nova] Lock "4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d93cc5b1-b2c2-4846-8e16-a3e75c77f236 req-d0c99f59-68e5-418b-8ca7-93ac1571dd7f service nova] Lock "4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG nova.compute.manager [req-d93cc5b1-b2c2-4846-8e16-a3e75c77f236 req-d0c99f59-68e5-418b-8ca7-93ac1571dd7f service nova] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] No waiting events found dispatching network-vif-plugged-8df72a30-cfbf-4025-a343-f47fe0978c35 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:21:16 user nova-compute[74189]: WARNING nova.compute.manager [req-d93cc5b1-b2c2-4846-8e16-a3e75c77f236 req-d0c99f59-68e5-418b-8ca7-93ac1571dd7f service nova] [instance: 4bd2a1f8-1547-44d0-a3e3-9b519b6edd5f] Received unexpected event network-vif-plugged-8df72a30-cfbf-4025-a343-f47fe0978c35 for instance with vm_state deleted and task_state None.
Oct 25 21:21:16 user nova-compute[74189]: DEBUG nova.compute.manager [req-d93cc5b1-b2c2-4846-8e16-a3e75c77f236 req-d0c99f59-68e5-418b-8ca7-93ac1571dd7f service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Received event network-vif-unplugged-d28e4203-5fff-4a0b-b360-fe29bfa131b8 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d93cc5b1-b2c2-4846-8e16-a3e75c77f236 req-d0c99f59-68e5-418b-8ca7-93ac1571dd7f service nova] Acquiring lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d93cc5b1-b2c2-4846-8e16-a3e75c77f236 req-d0c99f59-68e5-418b-8ca7-93ac1571dd7f service nova] Lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d93cc5b1-b2c2-4846-8e16-a3e75c77f236 req-d0c99f59-68e5-418b-8ca7-93ac1571dd7f service nova] Lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG nova.compute.manager [req-d93cc5b1-b2c2-4846-8e16-a3e75c77f236 req-d0c99f59-68e5-418b-8ca7-93ac1571dd7f service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] No waiting events found dispatching network-vif-unplugged-d28e4203-5fff-4a0b-b360-fe29bfa131b8 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG nova.compute.manager [req-d93cc5b1-b2c2-4846-8e16-a3e75c77f236 req-d0c99f59-68e5-418b-8ca7-93ac1571dd7f service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Received event network-vif-unplugged-d28e4203-5fff-4a0b-b360-fe29bfa131b8 for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG nova.compute.manager [req-d93cc5b1-b2c2-4846-8e16-a3e75c77f236 req-d0c99f59-68e5-418b-8ca7-93ac1571dd7f service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Received event network-vif-plugged-d28e4203-5fff-4a0b-b360-fe29bfa131b8 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d93cc5b1-b2c2-4846-8e16-a3e75c77f236 req-d0c99f59-68e5-418b-8ca7-93ac1571dd7f service nova] Acquiring lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d93cc5b1-b2c2-4846-8e16-a3e75c77f236 req-d0c99f59-68e5-418b-8ca7-93ac1571dd7f service nova] Lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d93cc5b1-b2c2-4846-8e16-a3e75c77f236 req-d0c99f59-68e5-418b-8ca7-93ac1571dd7f service nova] Lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG nova.compute.manager [req-d93cc5b1-b2c2-4846-8e16-a3e75c77f236 req-d0c99f59-68e5-418b-8ca7-93ac1571dd7f service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] No waiting events found dispatching network-vif-plugged-d28e4203-5fff-4a0b-b360-fe29bfa131b8 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:21:16 user nova-compute[74189]: WARNING nova.compute.manager [req-d93cc5b1-b2c2-4846-8e16-a3e75c77f236 req-d0c99f59-68e5-418b-8ca7-93ac1571dd7f service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Received unexpected event network-vif-plugged-d28e4203-5fff-4a0b-b360-fe29bfa131b8 for instance with vm_state active and task_state deleting.
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc9eaf6-a85d-44ac-b611-c0c49ef12226]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:21:16 user nova-compute[74189]: No targets found.
Oct 25 21:21:16 user nova-compute[74189]: iSNS:
Oct 25 21:21:16 user nova-compute[74189]: No targets found.
Oct 25 21:21:16 user nova-compute[74189]: STATIC:
Oct 25 21:21:16 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e
Oct 25 21:21:16 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:21:16 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:21:16 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78
Oct 25 21:21:16 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:21:16 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:21:16 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:21:16 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:21:16 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:21:16 user nova-compute[74189]: FIRMWARE:
Oct 25 21:21:16 user nova-compute[74189]: No targets found.
Oct 25 21:21:16 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:21:16 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:21:16 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[151050eb-c3a6-446e-92fa-4c734696ef67]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3d2a29-eb14-4b7d-9ec6-0c0d8bab40d8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:21:16 user nova-compute[74189]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:21:16 user nova-compute[74189]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:21:16 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:21:16 user nova-compute[74189]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e (non-flash)
Oct 25 21:21:16 user nova-compute[74189]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:21:16 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe304383c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e'): ({'sdh'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Removing single pathed devices sdh {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[275bf5e0-f6fc-4ffc-accb-314bb1f816d8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54edee1-ad0a-4283-b3d1-9711b9bcf666]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Flushing IO for device /dev/sdh {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2117a2-b9b5-418f-8b52-32c1db36639c]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.050s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a87aca-7093-4d5a-98b9-5d20f6d54633]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] SCSI volumes sdh have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_5399b58a',) {{(pid=85079) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a8dbe9-525d-4435-8d47-473066afc979]: (4, None) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[68189763-e1ba-4559-a9a0-94bab6e0903c]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca052d7-b99d-4630-ae7a-65ee0d3c1d44]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e, portal: 172.16.0.220,3260]
Oct 25 21:21:16 user nova-compute[74189]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e, portal: 172.16.0.220,3260] successful.
Oct 25 21:21:16 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6efe932-902f-41f8-82f4-1773bc305e0e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e115aac-6745-4c0b-96f1-b19241919635]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] <== disconnect_volume: return (407ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:21:16 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Deleting instance files /opt/stack/data/nova/instances/a05b75c0-c064-42c5-aca7-c4b07cfabcfb_del
Oct 25 21:21:16 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Deletion of /opt/stack/data/nova/instances/a05b75c0-c064-42c5-aca7-c4b07cfabcfb_del complete
Oct 25 21:21:16 user nova-compute[74189]: INFO nova.compute.manager [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Took 1.44 seconds to destroy the instance on the hypervisor.
Oct 25 21:21:16 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:21:16 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:21:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:17 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:21:17 user nova-compute[74189]: DEBUG nova.compute.manager [req-82a6272d-a3d8-46ee-aceb-5a122d84308c req-ec3fe20f-8b05-4e1f-89ed-0926e9a48b15 service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Received event network-vif-deleted-d28e4203-5fff-4a0b-b360-fe29bfa131b8 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:21:17 user nova-compute[74189]: INFO nova.compute.manager [req-82a6272d-a3d8-46ee-aceb-5a122d84308c req-ec3fe20f-8b05-4e1f-89ed-0926e9a48b15 service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Neutron deleted interface d28e4203-5fff-4a0b-b360-fe29bfa131b8; detaching it from the instance and deleting it from the info cache
Oct 25 21:21:17 user nova-compute[74189]: DEBUG nova.network.neutron [req-82a6272d-a3d8-46ee-aceb-5a122d84308c req-ec3fe20f-8b05-4e1f-89ed-0926e9a48b15 service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:21:17 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Took 0.93 seconds to deallocate network for instance.
Oct 25 21:21:17 user nova-compute[74189]: DEBUG nova.compute.manager [req-82a6272d-a3d8-46ee-aceb-5a122d84308c req-ec3fe20f-8b05-4e1f-89ed-0926e9a48b15 service nova] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Detach interface failed, port_id=d28e4203-5fff-4a0b-b360-fe29bfa131b8, reason: Instance a05b75c0-c064-42c5-aca7-c4b07cfabcfb could not be found. {{(pid=74189) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 21:21:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:18 user nova-compute[74189]: INFO nova.compute.manager [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Took 0.99 seconds to detach 1 volumes for instance.
Oct 25 21:21:18 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] [instance: a05b75c0-c064-42c5-aca7-c4b07cfabcfb] Deleting volume: e6efe932-902f-41f8-82f4-1773bc305e0e {{(pid=74189) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 25 21:21:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:19 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:21:19 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:21:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.455s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:19 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Deleted allocations for instance a05b75c0-c064-42c5-aca7-c4b07cfabcfb
Oct 25 21:21:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5e97c7bb-2c1f-474e-9991-e1b3a701c6f1 tempest-ServerActionsV293TestJSON-1192138157 tempest-ServerActionsV293TestJSON-1192138157-project-member] Lock "a05b75c0-c064-42c5-aca7-c4b07cfabcfb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.309s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:19 user nova-compute[74189]: INFO nova.compute.manager [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] [instance: 2486ac33-a881-4be1-a24e-2ff263e51818] Took 16.55 seconds to detach 3 volumes for instance.
Oct 25 21:21:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:20 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:21:20 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:21:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:20 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Deleted allocations for instance 2486ac33-a881-4be1-a24e-2ff263e51818
Oct 25 21:21:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d5813cc7-aa35-4192-b271-b1ce1ba006a7 tempest-TaggedBootDevicesTest-195465062 tempest-TaggedBootDevicesTest-195465062-project-member] Lock "2486ac33-a881-4be1-a24e-2ff263e51818" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 26.169s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:23 user nova-compute[74189]: DEBUG nova.network.neutron [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Port c6a0280f-def7-4677-910c-7a3a3c6b57df binding to destination host user is already ACTIVE {{(pid=74189) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 25 21:21:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquiring lock "refresh_cache-5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:21:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquired lock "refresh_cache-5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:21:23 user nova-compute[74189]: DEBUG nova.network.neutron [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:21:24 user nova-compute[74189]: DEBUG nova.network.neutron [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Updating instance_info_cache with network_info: [{"id": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "address": "fa:16:3e:92:dc:7e", "network": {"id": "197dd483-54ad-4b81-a0d0-26c633b3a101", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1141346509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e426fbc4bb374115a46d927092d62423", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a0280f-de", "ovs_interfaceid": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:21:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Releasing lock "refresh_cache-5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:21:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Creating tmpfile /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/tmp323n8f68 to verify with other compute node that the instance is on the same shared storage. {{(pid=74189) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Oct 25 21:21:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:25 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Instance destroyed successfully.
Oct 25 21:21:25 user nova-compute[74189]: DEBUG nova.objects.instance [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lazy-loading 'resources' on Instance uuid 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:15:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2127723699',display_name='tempest-ServerActionsTestOtherB-server-2127723699',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2127723699',id=3,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjedofMSVtj00tqk1jqFMH5AZ5Pyw9+9WP37zpM0w2hcAIIw4fFannJXo68FjlEI0XSKwz6/AZjg4uhqhEM0AXh7nvdUT82CEMoJ2RGXuMes6AOS513uwlo8CUT17ABSg==',key_name='tempest-keypair-611941333',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:20:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e426fbc4bb374115a46d927092d62423',ramdisk_id='',reservation_id='r-q0q32lk1',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-40176194',owner_user_name='tempest-ServerActionsTestOtherB-40176194-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:20:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e81aaad00624abdafe04f6c8de4c5c0',uuid=5d21b93a-b312-4c1b-9e43-ffb4b729c7d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "address": "fa:16:3e:92:dc:7e", "network": {"id": "197dd483-54ad-4b81-a0d0-26c633b3a101", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1141346509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e426fbc4bb374115a46d927092d62423", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a0280f-de", "ovs_interfaceid": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Converting VIF {"id": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "address": "fa:16:3e:92:dc:7e", "network": {"id": "197dd483-54ad-4b81-a0d0-26c633b3a101", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1141346509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e426fbc4bb374115a46d927092d62423", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a0280f-de", "ovs_interfaceid": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:dc:7e,bridge_name='br-int',has_traffic_filtering=True,id=c6a0280f-def7-4677-910c-7a3a3c6b57df,network=Network(197dd483-54ad-4b81-a0d0-26c633b3a101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6a0280f-de') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG os_vif [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:dc:7e,bridge_name='br-int',has_traffic_filtering=True,id=c6a0280f-def7-4677-910c-7a3a3c6b57df,network=Network(197dd483-54ad-4b81-a0d0-26c633b3a101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6a0280f-de') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6a0280f-de, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=48e94c73-8799-4c72-8f75-8f19d93fbfe4) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:21:25 user nova-compute[74189]: INFO os_vif [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:dc:7e,bridge_name='br-int',has_traffic_filtering=True,id=c6a0280f-def7-4677-910c-7a3a3c6b57df,network=Network(197dd483-54ad-4b81-a0d0-26c633b3a101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6a0280f-de')
Oct 25 21:21:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDQlxprB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:21:25 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:21:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d78c2a6-0fc3-4678-b3df-ef2b04e5b18b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:21:25 user nova-compute[74189]: No targets found.
Oct 25 21:21:25 user nova-compute[74189]: iSNS:
Oct 25 21:21:25 user nova-compute[74189]: No targets found.
Oct 25 21:21:25 user nova-compute[74189]: STATIC:
Oct 25 21:21:25 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78
Oct 25 21:21:25 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:21:25 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:21:25 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:21:25 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:21:25 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:21:25 user nova-compute[74189]: FIRMWARE:
Oct 25 21:21:25 user nova-compute[74189]: No targets found.
Oct 25 21:21:25 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:21:25 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:21:25 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79127bc-a744-4922-a9f8-d9bdc512d41d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[679389b3-939c-4d61-a2ce-125fc4e47fe2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:21:25 user nova-compute[74189]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:21:25 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:21:25 user nova-compute[74189]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:21:25 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2e422e440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78'): ({'sde'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Removing single pathed devices sde {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e521fbc5-4c64-4e8a-bf9c-1ae1c39cc681]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c3ee19-ebe9-435c-9e45-29341e927937]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Flushing IO for device /dev/sde {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08bb111-8ab4-4fad-b61b-50a5bf88cfbf]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[264d4884-a7de-4550-b3f7-038026d0a7e4]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] SCSI volumes sde have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab23c9c-08c4-486b-bc05-a8e0e1164127]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e413bb-f7a0-4e95-94fb-3228a6c75d78]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78, portal: 172.16.0.220,3260]
Oct 25 21:21:25 user nova-compute[74189]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78, portal: 172.16.0.220,3260] successful.
Oct 25 21:21:25 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f05c4f6-68f6-4dcc-abb9-3cca1be667fe]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] <== disconnect_volume: return (361ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:21:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:21:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:27 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:21:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:27 user nova-compute[74189]: DEBUG nova.objects.instance [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lazy-loading 'migration_context' on Instance uuid 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:21:27 user nova-compute[74189]: DEBUG nova.objects.base [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Object Instance<5d21b93a-b312-4c1b-9e43-ffb4b729c7d3> lazy-loaded attributes: resources,migration_context {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:21:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:27 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Refreshing inventories for resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 21:21:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-9b17c7ff-ff4f-416c-a9f7-05043339c7a4 req-45ce601b-545f-482a-ba99-22ad80d5947a service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Received event network-vif-unplugged-c6a0280f-def7-4677-910c-7a3a3c6b57df {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:21:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9b17c7ff-ff4f-416c-a9f7-05043339c7a4 req-45ce601b-545f-482a-ba99-22ad80d5947a service nova] Acquiring lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9b17c7ff-ff4f-416c-a9f7-05043339c7a4 req-45ce601b-545f-482a-ba99-22ad80d5947a service nova] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9b17c7ff-ff4f-416c-a9f7-05043339c7a4 req-45ce601b-545f-482a-ba99-22ad80d5947a service nova] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-9b17c7ff-ff4f-416c-a9f7-05043339c7a4 req-45ce601b-545f-482a-ba99-22ad80d5947a service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] No waiting events found dispatching network-vif-unplugged-c6a0280f-def7-4677-910c-7a3a3c6b57df {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:21:27 user nova-compute[74189]: WARNING nova.compute.manager [req-9b17c7ff-ff4f-416c-a9f7-05043339c7a4 req-45ce601b-545f-482a-ba99-22ad80d5947a service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Received unexpected event network-vif-unplugged-c6a0280f-def7-4677-910c-7a3a3c6b57df for instance with vm_state resized and task_state resize_reverting.
Oct 25 21:21:28 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Updating ProviderTree inventory for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 21:21:28 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Updating inventory in ProviderTree for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 21:21:28 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Refreshing aggregate associations for resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc, aggregates: None {{(pid=74189) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 21:21:28 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Refreshing trait associations for resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING {{(pid=74189) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 21:21:28 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:21:28 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:21:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.969s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.572s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:28 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:21:28 user nova-compute[74189]: INFO nova.compute.claims [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Claim successful on node user
Oct 25 21:21:28 user nova-compute[74189]: INFO nova.compute.manager [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Swapping old allocation on dict_keys(['4eea19d7-3bab-440b-873e-a6e9c99ba7fc']) held by migration e69c91a9-6190-44b8-be8b-aa63f8edf28a for instance
Oct 25 21:21:28 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Overwriting current allocation {'allocations': {'4eea19d7-3bab-440b-873e-a6e9c99ba7fc': {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}, 'generation': 21}}, 'project_id': 'e426fbc4bb374115a46d927092d62423', 'user_id': '7e81aaad00624abdafe04f6c8de4c5c0', 'consumer_generation': 1} on consumer 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3 {{(pid=74189) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Oct 25 21:21:28 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:21:28 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:21:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquiring lock "refresh_cache-5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:21:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquired lock "refresh_cache-5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:21:28 user nova-compute[74189]: DEBUG nova.network.neutron [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:21:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:28 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:21:29 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:21:29 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG nova.policy [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e55da2b7458469e844fad1fe95cb695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d0f1deb7f04244920dae579032b287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:21:29 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Creating image(s)
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "/opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "/opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "/opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:29 user nova-compute[74189]: INFO nova.virt.block_device [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Booting with volume ba681370-9e8a-4b48-abd0-b23648598603 at /dev/vdc
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.225s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG os_brick.utils [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[80301a59-7567-4a0a-897c-32a2182e3834]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ae5f2d-9ee2-49df-a12b-a33e2c536c50]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a38aee2-e96d-4f14-b297-2a293b206e0a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3627dcd9-e948-4a83-a4ee-16fdce4de162]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.196s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:21:29 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[179e40b0-40ef-4550-885a-cb9fae3af725]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG os_brick.utils [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] <== get_connector_properties: return (181ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Updating existing volume attachment record: ef7bcb13-814f-451e-9531-4b86f975d3d1 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk 1073741824" returned: 0 in 0.063s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG nova.network.neutron [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Updating instance_info_cache with network_info: [{"id": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "address": "fa:16:3e:92:dc:7e", "network": {"id": "197dd483-54ad-4b81-a0d0-26c633b3a101", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1141346509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e426fbc4bb374115a46d927092d62423", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a0280f-de", "ovs_interfaceid": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Releasing lock "refresh_cache-5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG os_brick.utils [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c9c2fc-ade6-465b-a6f4-553762d306e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c100aad5-464a-4a56-8ca9-7168cf81aa94]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d312a5a-48b5-4601-8d43-ac2f20ae944f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[130dbe07-f133-49a4-89f4-1866b6cedd6c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:21:29 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cc04d5-0e29-4ef1-bb20-a423f44bd039]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG os_brick.utils [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.200s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:21:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:30 user nova-compute[74189]: DEBUG nova.compute.manager [req-dbc6d8b6-9379-4471-9c61-588c82af7bb1 req-5f9fec7b-74c6-4ecd-b11e-cf5c4da929cf service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Received event network-vif-plugged-c6a0280f-def7-4677-910c-7a3a3c6b57df {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:21:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-dbc6d8b6-9379-4471-9c61-588c82af7bb1 req-5f9fec7b-74c6-4ecd-b11e-cf5c4da929cf service nova] Acquiring lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-dbc6d8b6-9379-4471-9c61-588c82af7bb1 req-5f9fec7b-74c6-4ecd-b11e-cf5c4da929cf service nova] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-dbc6d8b6-9379-4471-9c61-588c82af7bb1 req-5f9fec7b-74c6-4ecd-b11e-cf5c4da929cf service nova] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:30 user nova-compute[74189]: DEBUG nova.compute.manager [req-dbc6d8b6-9379-4471-9c61-588c82af7bb1 req-5f9fec7b-74c6-4ecd-b11e-cf5c4da929cf service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] No waiting events found dispatching network-vif-plugged-c6a0280f-def7-4677-910c-7a3a3c6b57df {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:21:30 user nova-compute[74189]: WARNING nova.compute.manager [req-dbc6d8b6-9379-4471-9c61-588c82af7bb1 req-5f9fec7b-74c6-4ecd-b11e-cf5c4da929cf service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Received unexpected event network-vif-plugged-c6a0280f-def7-4677-910c-7a3a3c6b57df for instance with vm_state resized and task_state resize_reverting.
Oct 25 21:21:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:30 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Cannot resize image /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:21:30 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:21:30 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Ensure instance console log exists: /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:21:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:30 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Successfully created port: b0bbbcbc-085e-476f-b600-f1d684f23beb {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Successfully updated port: b0bbbcbc-085e-476f-b600-f1d684f23beb {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "refresh_cache-de6b6789-b328-4c3b-8d24-07774d5dbe6d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquired lock "refresh_cache-de6b6789-b328-4c3b-8d24-07774d5dbe6d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.compute.manager [req-ef9ad8af-423b-45f0-802f-4d25ae2f596f req-7d8468c7-0124-46d8-9778-a35455dc4bd9 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Received event network-changed-b0bbbcbc-085e-476f-b600-f1d684f23beb {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.compute.manager [req-ef9ad8af-423b-45f0-802f-4d25ae2f596f req-7d8468c7-0124-46d8-9778-a35455dc4bd9 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Refreshing instance network info cache due to event network-changed-b0bbbcbc-085e-476f-b600-f1d684f23beb. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ef9ad8af-423b-45f0-802f-4d25ae2f596f req-7d8468c7-0124-46d8-9778-a35455dc4bd9 service nova] Acquiring lock "refresh_cache-de6b6789-b328-4c3b-8d24-07774d5dbe6d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Updating instance_info_cache with network_info: [{"id": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "address": "fa:16:3e:df:d0:7a", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bbbcbc-08", "ovs_interfaceid": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Releasing lock "refresh_cache-de6b6789-b328-4c3b-8d24-07774d5dbe6d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Instance network_info: |[{"id": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "address": "fa:16:3e:df:d0:7a", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bbbcbc-08", "ovs_interfaceid": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ef9ad8af-423b-45f0-802f-4d25ae2f596f req-7d8468c7-0124-46d8-9778-a35455dc4bd9 service nova] Acquired lock "refresh_cache-de6b6789-b328-4c3b-8d24-07774d5dbe6d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.network.neutron [req-ef9ad8af-423b-45f0-802f-4d25ae2f596f req-7d8468c7-0124-46d8-9778-a35455dc4bd9 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Refreshing network info cache for port b0bbbcbc-085e-476f-b600-f1d684f23beb {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Start _get_guest_xml network_info=[{"id": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "address": "fa:16:3e:df:d0:7a", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bbbcbc-08", "ovs_interfaceid": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:21:31 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:21:31 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:21:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1758392823',display_name='tempest-AttachVolumeTestJSON-server-1758392823',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1758392823',id=17,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPiYEbKeppJsHkf9Hx5OHRO2CLzGAPd2wBVnTnbTrf7OneA+NCoBGPS8Iup7Bh8CoPm7/VcfZ0KMuu8zfSepXMiLSwU39yVEsYz6SpCmvS4oU93LKx611A6fXbw0yJUBA==',key_name='tempest-keypair-2000039022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1d0f1deb7f04244920dae579032b287',ramdisk_id='',reservation_id='r-90yevjj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1213560671',owner_user_name='tempest-AttachVolumeTestJSON-1213560671-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:21:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e55da2b7458469e844fad1fe95cb695',uuid=de6b6789-b328-4c3b-8d24-07774d5dbe6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "address": "fa:16:3e:df:d0:7a", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bbbcbc-08", "ovs_interfaceid": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Converting VIF {"id": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "address": "fa:16:3e:df:d0:7a", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bbbcbc-08", "ovs_interfaceid": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:d0:7a,bridge_name='br-int',has_traffic_filtering=True,id=b0bbbcbc-085e-476f-b600-f1d684f23beb,network=Network(1d219ea7-a949-4c77-9cd1-79cc99d6ac42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bbbcbc-08') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lazy-loading 'pci_devices' on Instance uuid de6b6789-b328-4c3b-8d24-07774d5dbe6d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:21:31 user nova-compute[74189]:   <uuid>de6b6789-b328-4c3b-8d24-07774d5dbe6d</uuid>
Oct 25 21:21:31 user nova-compute[74189]:   <name>instance-00000011</name>
Oct 25 21:21:31 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:21:31 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:21:31 user nova-compute[74189]:   <metadata>
Oct 25 21:21:31 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:21:31 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:21:31 user nova-compute[74189]:       <nova:name>tempest-AttachVolumeTestJSON-server-1758392823</nova:name>
Oct 25 21:21:31 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:21:31</nova:creationTime>
Oct 25 21:21:31 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:21:31 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:21:31 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:21:31 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:21:31 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:21:31 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:21:31 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:21:31 user nova-compute[74189]:       <nova:owner>
Oct 25 21:21:31 user nova-compute[74189]:         <nova:user uuid="9e55da2b7458469e844fad1fe95cb695">tempest-AttachVolumeTestJSON-1213560671-project-member</nova:user>
Oct 25 21:21:31 user nova-compute[74189]:         <nova:project uuid="d1d0f1deb7f04244920dae579032b287">tempest-AttachVolumeTestJSON-1213560671</nova:project>
Oct 25 21:21:31 user nova-compute[74189]:       </nova:owner>
Oct 25 21:21:31 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:21:31 user nova-compute[74189]:       <nova:ports>
Oct 25 21:21:31 user nova-compute[74189]:         <nova:port uuid="b0bbbcbc-085e-476f-b600-f1d684f23beb">
Oct 25 21:21:31 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 21:21:31 user nova-compute[74189]:         </nova:port>
Oct 25 21:21:31 user nova-compute[74189]:       </nova:ports>
Oct 25 21:21:31 user nova-compute[74189]:     </nova:instance>
Oct 25 21:21:31 user nova-compute[74189]:   </metadata>
Oct 25 21:21:31 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:21:31 user nova-compute[74189]:     <system>
Oct 25 21:21:31 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:21:31 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:21:31 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:21:31 user nova-compute[74189]:       <entry name="serial">de6b6789-b328-4c3b-8d24-07774d5dbe6d</entry>
Oct 25 21:21:31 user nova-compute[74189]:       <entry name="uuid">de6b6789-b328-4c3b-8d24-07774d5dbe6d</entry>
Oct 25 21:21:31 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:21:31 user nova-compute[74189]:     </system>
Oct 25 21:21:31 user nova-compute[74189]:   </sysinfo>
Oct 25 21:21:31 user nova-compute[74189]:   <os>
Oct 25 21:21:31 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:21:31 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:21:31 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:21:31 user nova-compute[74189]:   </os>
Oct 25 21:21:31 user nova-compute[74189]:   <features>
Oct 25 21:21:31 user nova-compute[74189]:     <acpi/>
Oct 25 21:21:31 user nova-compute[74189]:     <apic/>
Oct 25 21:21:31 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:21:31 user nova-compute[74189]:   </features>
Oct 25 21:21:31 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:21:31 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:21:31 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:21:31 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:21:31 user nova-compute[74189]:   </clock>
Oct 25 21:21:31 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:21:31 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:21:31 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:21:31 user nova-compute[74189]:   </cpu>
Oct 25 21:21:31 user nova-compute[74189]:   <devices>
Oct 25 21:21:31 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:21:31 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:21:31 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk"/>
Oct 25 21:21:31 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:21:31 user nova-compute[74189]:     </disk>
Oct 25 21:21:31 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:21:31 user nova-compute[74189]:       <mac address="fa:16:3e:df:d0:7a"/>
Oct 25 21:21:31 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:21:31 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:21:31 user nova-compute[74189]:       <target dev="tapb0bbbcbc-08"/>
Oct 25 21:21:31 user nova-compute[74189]:     </interface>
Oct 25 21:21:31 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:21:31 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/console.log" append="off"/>
Oct 25 21:21:31 user nova-compute[74189]:     </serial>
Oct 25 21:21:31 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:21:31 user nova-compute[74189]:     <video>
Oct 25 21:21:31 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:21:31 user nova-compute[74189]:     </video>
Oct 25 21:21:31 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:21:31 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:21:31 user nova-compute[74189]:     </rng>
Oct 25 21:21:31 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:21:31 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:21:31 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:21:31 user nova-compute[74189]:     </memballoon>
Oct 25 21:21:31 user nova-compute[74189]:   </devices>
Oct 25 21:21:31 user nova-compute[74189]: </domain>
Oct 25 21:21:31 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:21:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1758392823',display_name='tempest-AttachVolumeTestJSON-server-1758392823',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1758392823',id=17,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPiYEbKeppJsHkf9Hx5OHRO2CLzGAPd2wBVnTnbTrf7OneA+NCoBGPS8Iup7Bh8CoPm7/VcfZ0KMuu8zfSepXMiLSwU39yVEsYz6SpCmvS4oU93LKx611A6fXbw0yJUBA==',key_name='tempest-keypair-2000039022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1d0f1deb7f04244920dae579032b287',ramdisk_id='',reservation_id='r-90yevjj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1213560671',owner_user_name='tempest-AttachVolumeTestJSON-1213560671-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:21:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e55da2b7458469e844fad1fe95cb695',uuid=de6b6789-b328-4c3b-8d24-07774d5dbe6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "address": "fa:16:3e:df:d0:7a", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bbbcbc-08", "ovs_interfaceid": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Converting VIF {"id": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "address": "fa:16:3e:df:d0:7a", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bbbcbc-08", "ovs_interfaceid": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:d0:7a,bridge_name='br-int',has_traffic_filtering=True,id=b0bbbcbc-085e-476f-b600-f1d684f23beb,network=Network(1d219ea7-a949-4c77-9cd1-79cc99d6ac42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bbbcbc-08') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG os_vif [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:d0:7a,bridge_name='br-int',has_traffic_filtering=True,id=b0bbbcbc-085e-476f-b600-f1d684f23beb,network=Network(1d219ea7-a949-4c77-9cd1-79cc99d6ac42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bbbcbc-08') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15c15be6-9f0b-54e6-8f6c-4f53901d39e5', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0bbbcbc-08, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb0bbbcbc-08, col_values=(('qos', UUID('6f63a963-a1b6-4e59-aac6-89b9c4894045')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb0bbbcbc-08, col_values=(('external_ids', {'iface-id': 'b0bbbcbc-085e-476f-b600-f1d684f23beb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:d0:7a', 'vm-uuid': 'de6b6789-b328-4c3b-8d24-07774d5dbe6d'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:31 user nova-compute[74189]: INFO os_vif [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:d0:7a,bridge_name='br-int',has_traffic_filtering=True,id=b0bbbcbc-085e-476f-b600-f1d684f23beb,network=Network(1d219ea7-a949-4c77-9cd1-79cc99d6ac42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bbbcbc-08')
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:21:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] No VIF found with MAC fa:16:3e:df:d0:7a, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:21:32 user nova-compute[74189]: DEBUG nova.network.neutron [req-ef9ad8af-423b-45f0-802f-4d25ae2f596f req-7d8468c7-0124-46d8-9778-a35455dc4bd9 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Updated VIF entry in instance network info cache for port b0bbbcbc-085e-476f-b600-f1d684f23beb. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:21:32 user nova-compute[74189]: DEBUG nova.network.neutron [req-ef9ad8af-423b-45f0-802f-4d25ae2f596f req-7d8468c7-0124-46d8-9778-a35455dc4bd9 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Updating instance_info_cache with network_info: [{"id": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "address": "fa:16:3e:df:d0:7a", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bbbcbc-08", "ovs_interfaceid": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:21:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ef9ad8af-423b-45f0-802f-4d25ae2f596f req-7d8468c7-0124-46d8-9778-a35455dc4bd9 service nova] Releasing lock "refresh_cache-de6b6789-b328-4c3b-8d24-07774d5dbe6d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:21:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fa32e6ab-977f-4853-8d4b-157585c9e4fe tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Acquiring lock "28a5eb34-5e63-414b-81d9-12f2b41c699c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fa32e6ab-977f-4853-8d4b-157585c9e4fe tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Lock "28a5eb34-5e63-414b-81d9-12f2b41c699c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fa32e6ab-977f-4853-8d4b-157585c9e4fe tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Acquiring lock "28a5eb34-5e63-414b-81d9-12f2b41c699c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fa32e6ab-977f-4853-8d4b-157585c9e4fe tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Lock "28a5eb34-5e63-414b-81d9-12f2b41c699c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fa32e6ab-977f-4853-8d4b-157585c9e4fe tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Lock "28a5eb34-5e63-414b-81d9-12f2b41c699c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:32 user nova-compute[74189]: INFO nova.compute.manager [None req-fa32e6ab-977f-4853-8d4b-157585c9e4fe tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Terminating instance
Oct 25 21:21:32 user nova-compute[74189]: DEBUG nova.compute.manager [None req-fa32e6ab-977f-4853-8d4b-157585c9e4fe tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:21:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-5be0491d-07fb-4a23-809a-ae4fd9fd59bb req-db740b23-5979-4e2c-a9ca-090cb30e835c service nova] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Received event network-vif-unplugged-fc507e9a-e2b6-4604-bc65-0f62b3b6da6e {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:21:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-5be0491d-07fb-4a23-809a-ae4fd9fd59bb req-db740b23-5979-4e2c-a9ca-090cb30e835c service nova] Acquiring lock "28a5eb34-5e63-414b-81d9-12f2b41c699c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-5be0491d-07fb-4a23-809a-ae4fd9fd59bb req-db740b23-5979-4e2c-a9ca-090cb30e835c service nova] Lock "28a5eb34-5e63-414b-81d9-12f2b41c699c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-5be0491d-07fb-4a23-809a-ae4fd9fd59bb req-db740b23-5979-4e2c-a9ca-090cb30e835c service nova] Lock "28a5eb34-5e63-414b-81d9-12f2b41c699c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-5be0491d-07fb-4a23-809a-ae4fd9fd59bb req-db740b23-5979-4e2c-a9ca-090cb30e835c service nova] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] No waiting events found dispatching network-vif-unplugged-fc507e9a-e2b6-4604-bc65-0f62b3b6da6e {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:21:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-5be0491d-07fb-4a23-809a-ae4fd9fd59bb req-db740b23-5979-4e2c-a9ca-090cb30e835c service nova] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Received event network-vif-unplugged-fc507e9a-e2b6-4604-bc65-0f62b3b6da6e for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:21:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:34 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Instance destroyed successfully.
Oct 25 21:21:34 user nova-compute[74189]: DEBUG nova.objects.instance [None req-fa32e6ab-977f-4853-8d4b-157585c9e4fe tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Lazy-loading 'resources' on Instance uuid 28a5eb34-5e63-414b-81d9-12f2b41c699c {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:21:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-fa32e6ab-977f-4853-8d4b-157585c9e4fe tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:19:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1279099933',display_name='tempest-VolumesActionsTest-instance-1279099933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1279099933',id=14,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:19:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='927b9214b64840ee97bcbcadbe893e04',ramdisk_id='',reservation_id='r-7pes3jq2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1374618448',owner_user_name='tempest-VolumesActionsTest-1374618448-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:19:33Z,user_data=None,user_id='ca9db6daf29c4e27b78a6439d1d9ec08',uuid=28a5eb34-5e63-414b-81d9-12f2b41c699c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc507e9a-e2b6-4604-bc65-0f62b3b6da6e", "address": "fa:16:3e:91:e6:5a", "network": {"id": "925c3fd0-b4db-47a8-95c3-dcff4b31c3b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2002620134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "927b9214b64840ee97bcbcadbe893e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc507e9a-e2", "ovs_interfaceid": "fc507e9a-e2b6-4604-bc65-0f62b3b6da6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:21:34 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-fa32e6ab-977f-4853-8d4b-157585c9e4fe tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Converting VIF {"id": "fc507e9a-e2b6-4604-bc65-0f62b3b6da6e", "address": "fa:16:3e:91:e6:5a", "network": {"id": "925c3fd0-b4db-47a8-95c3-dcff4b31c3b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2002620134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "927b9214b64840ee97bcbcadbe893e04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc507e9a-e2", "ovs_interfaceid": "fc507e9a-e2b6-4604-bc65-0f62b3b6da6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:21:34 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-fa32e6ab-977f-4853-8d4b-157585c9e4fe tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:e6:5a,bridge_name='br-int',has_traffic_filtering=True,id=fc507e9a-e2b6-4604-bc65-0f62b3b6da6e,network=Network(925c3fd0-b4db-47a8-95c3-dcff4b31c3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc507e9a-e2') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:21:34 user nova-compute[74189]: DEBUG os_vif [None req-fa32e6ab-977f-4853-8d4b-157585c9e4fe tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:e6:5a,bridge_name='br-int',has_traffic_filtering=True,id=fc507e9a-e2b6-4604-bc65-0f62b3b6da6e,network=Network(925c3fd0-b4db-47a8-95c3-dcff4b31c3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc507e9a-e2') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:21:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc507e9a-e2, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:21:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=68cea62f-e9cc-40ca-87d8-8dfed4b0e1ba) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:21:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:34 user nova-compute[74189]: INFO os_vif [None req-fa32e6ab-977f-4853-8d4b-157585c9e4fe tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:e6:5a,bridge_name='br-int',has_traffic_filtering=True,id=fc507e9a-e2b6-4604-bc65-0f62b3b6da6e,network=Network(925c3fd0-b4db-47a8-95c3-dcff4b31c3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc507e9a-e2')
Oct 25 21:21:34 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-fa32e6ab-977f-4853-8d4b-157585c9e4fe tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Deleting instance files /opt/stack/data/nova/instances/28a5eb34-5e63-414b-81d9-12f2b41c699c_del
Oct 25 21:21:34 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-fa32e6ab-977f-4853-8d4b-157585c9e4fe tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Deletion of /opt/stack/data/nova/instances/28a5eb34-5e63-414b-81d9-12f2b41c699c_del complete
Oct 25 21:21:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:34 user nova-compute[74189]: INFO nova.compute.manager [None req-fa32e6ab-977f-4853-8d4b-157585c9e4fe tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Took 1.55 seconds to destroy the instance on the hypervisor.
Oct 25 21:21:34 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-fa32e6ab-977f-4853-8d4b-157585c9e4fe tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:21:34 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:21:34 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:21:35 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:21:35 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Took 0.77 seconds to deallocate network for instance.
Oct 25 21:21:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-d407c974-49ec-4944-8257-3d76479610f7 req-e3740ecc-235c-4775-b058-856d648243d4 service nova] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Received event network-vif-deleted-fc507e9a-e2b6-4604-bc65-0f62b3b6da6e {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:21:35 user nova-compute[74189]: INFO nova.compute.manager [req-d407c974-49ec-4944-8257-3d76479610f7 req-e3740ecc-235c-4775-b058-856d648243d4 service nova] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Neutron deleted interface fc507e9a-e2b6-4604-bc65-0f62b3b6da6e; detaching it from the instance and deleting it from the info cache
Oct 25 21:21:35 user nova-compute[74189]: DEBUG nova.network.neutron [req-d407c974-49ec-4944-8257-3d76479610f7 req-e3740ecc-235c-4775-b058-856d648243d4 service nova] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:21:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-d407c974-49ec-4944-8257-3d76479610f7 req-e3740ecc-235c-4775-b058-856d648243d4 service nova] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Detach interface failed, port_id=fc507e9a-e2b6-4604-bc65-0f62b3b6da6e, reason: Instance 28a5eb34-5e63-414b-81d9-12f2b41c699c could not be found. {{(pid=74189) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 21:21:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fa32e6ab-977f-4853-8d4b-157585c9e4fe tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fa32e6ab-977f-4853-8d4b-157585c9e4fe tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-992751bf-52ec-4d2c-b968-b1149aa9599c req-5c398933-76c1-45a1-8510-cddb7bc2e0e4 service nova] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Received event network-vif-plugged-fc507e9a-e2b6-4604-bc65-0f62b3b6da6e {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:21:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-992751bf-52ec-4d2c-b968-b1149aa9599c req-5c398933-76c1-45a1-8510-cddb7bc2e0e4 service nova] Acquiring lock "28a5eb34-5e63-414b-81d9-12f2b41c699c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-992751bf-52ec-4d2c-b968-b1149aa9599c req-5c398933-76c1-45a1-8510-cddb7bc2e0e4 service nova] Lock "28a5eb34-5e63-414b-81d9-12f2b41c699c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-992751bf-52ec-4d2c-b968-b1149aa9599c req-5c398933-76c1-45a1-8510-cddb7bc2e0e4 service nova] Lock "28a5eb34-5e63-414b-81d9-12f2b41c699c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-992751bf-52ec-4d2c-b968-b1149aa9599c req-5c398933-76c1-45a1-8510-cddb7bc2e0e4 service nova] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] No waiting events found dispatching network-vif-plugged-fc507e9a-e2b6-4604-bc65-0f62b3b6da6e {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:21:35 user nova-compute[74189]: WARNING nova.compute.manager [req-992751bf-52ec-4d2c-b968-b1149aa9599c req-5c398933-76c1-45a1-8510-cddb7bc2e0e4 service nova] [instance: 28a5eb34-5e63-414b-81d9-12f2b41c699c] Received unexpected event network-vif-plugged-fc507e9a-e2b6-4604-bc65-0f62b3b6da6e for instance with vm_state deleted and task_state None.
Oct 25 21:21:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-992751bf-52ec-4d2c-b968-b1149aa9599c req-5c398933-76c1-45a1-8510-cddb7bc2e0e4 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Received event network-vif-plugged-b0bbbcbc-085e-476f-b600-f1d684f23beb {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:21:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-992751bf-52ec-4d2c-b968-b1149aa9599c req-5c398933-76c1-45a1-8510-cddb7bc2e0e4 service nova] Acquiring lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-992751bf-52ec-4d2c-b968-b1149aa9599c req-5c398933-76c1-45a1-8510-cddb7bc2e0e4 service nova] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-992751bf-52ec-4d2c-b968-b1149aa9599c req-5c398933-76c1-45a1-8510-cddb7bc2e0e4 service nova] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-992751bf-52ec-4d2c-b968-b1149aa9599c req-5c398933-76c1-45a1-8510-cddb7bc2e0e4 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] No waiting events found dispatching network-vif-plugged-b0bbbcbc-085e-476f-b600-f1d684f23beb {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:21:35 user nova-compute[74189]: WARNING nova.compute.manager [req-992751bf-52ec-4d2c-b968-b1149aa9599c req-5c398933-76c1-45a1-8510-cddb7bc2e0e4 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Received unexpected event network-vif-plugged-b0bbbcbc-085e-476f-b600-f1d684f23beb for instance with vm_state building and task_state spawning.
Oct 25 21:21:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-992751bf-52ec-4d2c-b968-b1149aa9599c req-5c398933-76c1-45a1-8510-cddb7bc2e0e4 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Received event network-vif-plugged-b0bbbcbc-085e-476f-b600-f1d684f23beb {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:21:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-992751bf-52ec-4d2c-b968-b1149aa9599c req-5c398933-76c1-45a1-8510-cddb7bc2e0e4 service nova] Acquiring lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-992751bf-52ec-4d2c-b968-b1149aa9599c req-5c398933-76c1-45a1-8510-cddb7bc2e0e4 service nova] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-992751bf-52ec-4d2c-b968-b1149aa9599c req-5c398933-76c1-45a1-8510-cddb7bc2e0e4 service nova] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-992751bf-52ec-4d2c-b968-b1149aa9599c req-5c398933-76c1-45a1-8510-cddb7bc2e0e4 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] No waiting events found dispatching network-vif-plugged-b0bbbcbc-085e-476f-b600-f1d684f23beb {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:21:35 user nova-compute[74189]: WARNING nova.compute.manager [req-992751bf-52ec-4d2c-b968-b1149aa9599c req-5c398933-76c1-45a1-8510-cddb7bc2e0e4 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Received unexpected event network-vif-plugged-b0bbbcbc-085e-476f-b600-f1d684f23beb for instance with vm_state building and task_state spawning.
Oct 25 21:21:35 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-fa32e6ab-977f-4853-8d4b-157585c9e4fe tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:21:35 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-fa32e6ab-977f-4853-8d4b-157585c9e4fe tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:21:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fa32e6ab-977f-4853-8d4b-157585c9e4fe tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:35 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-fa32e6ab-977f-4853-8d4b-157585c9e4fe tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Deleted allocations for instance 28a5eb34-5e63-414b-81d9-12f2b41c699c
Oct 25 21:21:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fa32e6ab-977f-4853-8d4b-157585c9e4fe tempest-VolumesActionsTest-1374618448 tempest-VolumesActionsTest-1374618448-project-member] Lock "28a5eb34-5e63-414b-81d9-12f2b41c699c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.927s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:36 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:21:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:21:36 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Instance spawned successfully.
Oct 25 21:21:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:21:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:21:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:21:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:21:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:21:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:21:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:21:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:36 user nova-compute[74189]: INFO nova.compute.manager [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Took 7.46 seconds to spawn the instance on the hypervisor.
Oct 25 21:21:36 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:21:36 user nova-compute[74189]: INFO nova.compute.manager [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Took 9.29 seconds to build instance.
Oct 25 21:21:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a0cee36a-828a-42b0-a1fe-c2be17de84e2 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.406s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "932fe8ac-fdde-45c6-aa32-9bf866f19a4e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "932fe8ac-fdde-45c6-aa32-9bf866f19a4e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:21:51 user nova-compute[74189]: INFO nova.compute.claims [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Claim successful on node user
Oct 25 21:21:51 user nova-compute[74189]: DEBUG nova.compute.manager [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:21:51 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Creating image(s)
Oct 25 21:21:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Did not create local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Ensure instance console log exists: /opt/stack/data/nova/instances/46ffb192-ad11-416e-9094-c8e080b5414e/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Start _get_guest_xml network_info=[{"id": "35311a59-a404-4759-8125-ac222750d5fa", "address": "fa:16:3e:b5:8d:bc", "network": {"id": "477a555b-610a-4b4f-8e0e-efd52c856097", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1102892168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35311a59-a4", "ovs_interfaceid": "35311a59-a404-4759-8125-ac222750d5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "address": "fa:16:3e:b2:20:8d", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1d7d42-01", "ovs_interfaceid": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f967dd2c-da19-4645-b52e-2d79f61baabe", "address": "fa:16:3e:d1:88:5b", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf967dd2c-da", "ovs_interfaceid": "f967dd2c-da19-4645-b52e-2d79f61baabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f18e575-80eb-41e8-8615-bcbbe00ff9de", "address": "fa:16:3e:c2:d7:0b", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f18e575-80", "ovs_interfaceid": "5f18e575-80eb-41e8-8615-bcbbe00ff9de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4caa88c4-c581-41eb-b8f8-a291aaef3ad4", "address": "fa:16:3e:24:e8:88", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4caa88c4-c5", "ovs_interfaceid": "4caa88c4-c581-41eb-b8f8-a291aaef3ad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b60a817a-3478-48d7-b117-bee088bc7e86", "address": "fa:16:3e:0f:4d:3e", "network": {"id": "68ea97b8-852c-464a-9ccb-b2dc55c63e47", "bridge": "br-int", "label": "tempest-device-tagging-net2-670429054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60a817a-34", "ovs_interfaceid": "b60a817a-3478-48d7-b117-bee088bc7e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56", "address": "fa:16:3e:b0:f9:54", "network": {"id": "68ea97b8-852c-464a-9ccb-b2dc55c63e47", "bridge": "br-int", "label": "tempest-device-tagging-net2-670429054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e0f5a2-44", "ovs_interfaceid": "94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kRpGoDPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '46ffb192-ad11-416e-9094-c8e080b5414e', 'attached_at': '', 'detached_at': '', 'volume_id': 'a545b3af-6d77-4506-b9c1-7c6d0320efee', 'serial': 'a545b3af-6d77-4506-b9c1-7c6d0320efee'}, 'attachment_id': '1f5198cb-4ede-4047-b357-f529129b249b', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'agWnbZlp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '46ffb192-ad11-416e-9094-c8e080b5414e', 'attached_at': '', 'detached_at': '', 'volume_id': '4460d0cc-0295-4c0b-9126-f84e0439c706', 'serial': '4460d0cc-0295-4c0b-9126-f84e0439c706'}, 'attachment_id': '324dd01c-c43f-44a4-8e4c-a6fd50bef12e', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': 1, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yalSTDnC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '46ffb192-ad11-416e-9094-c8e080b5414e', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba681370-9e8a-4b48-abd0-b23648598603', 'serial': 'ba681370-9e8a-4b48-abd0-b23648598603'}, 'attachment_id': 'ef7bcb13-814f-451e-9531-4b86f975d3d1', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'boot_index': 2, 'volume_type': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:21:51 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:21:51 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:21:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kRpGoDPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:21:51 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:21:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:21:51 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:21:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:21:51 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:21:51 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d77bc2-1f41-43c0-afeb-b8501c050c3a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:21:51 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:51 user nova-compute[74189]: WARNING nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] While synchronizing instance power states, found 8 instances in the database and 5 instances on the hypervisor.
Oct 25 21:21:51 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Triggering sync for uuid d7c3a99a-ab38-4e88-896d-94ae51a09a48 {{(pid=74189) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Triggering sync for uuid 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3 {{(pid=74189) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Triggering sync for uuid c69c0800-7a6c-4155-9f90-bbcd323276d3 {{(pid=74189) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Triggering sync for uuid af1d7b3c-9950-4b74-8f15-b31011ccfa24 {{(pid=74189) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Triggering sync for uuid 46ffb192-ad11-416e-9094-c8e080b5414e {{(pid=74189) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Triggering sync for uuid 680e134e-5e0d-464f-9e30-460010348795 {{(pid=74189) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Triggering sync for uuid de6b6789-b328-4c3b-8d24-07774d5dbe6d {{(pid=74189) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Triggering sync for uuid 932fe8ac-fdde-45c6-aa32-9bf866f19a4e {{(pid=74189) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e53310b-891e-4801-aed4-b65bf90929ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "d7c3a99a-ab38-4e88-896d-94ae51a09a48" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "d7c3a99a-ab38-4e88-896d-94ae51a09a48" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:51 user nova-compute[74189]: INFO nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Oct 25 21:21:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "c69c0800-7a6c-4155-9f90-bbcd323276d3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "c69c0800-7a6c-4155-9f90-bbcd323276d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "46ffb192-ad11-416e-9094-c8e080b5414e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "680e134e-5e0d-464f-9e30-460010348795" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "680e134e-5e0d-464f-9e30-460010348795" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "932fe8ac-fdde-45c6-aa32-9bf866f19a4e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee] added
Oct 25 21:21:51 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a59d20-f4e2-419d-b9f2-2c554ad7fb3c]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c835bd42-66e7-48ec-9bbd-bc03a1e2063a]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kRpGoDPd {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kRpGoDPd" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[086b8ef1-486d-4880-ab9f-f81fa0ac2868]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kRpGoDPd'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "c69c0800-7a6c-4155-9f90-bbcd323276d3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "d7c3a99a-ab38-4e88-896d-94ae51a09a48" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.127s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.122s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1beb487-599c-49f5-932b-7c417412ebcf]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.127s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "680e134e-5e0d-464f-9e30-460010348795" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.133s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1727b4-ce05-445a-824c-85ed13ace3d0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:21:52 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:21:52 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.570s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[06630c8d-0231-4834-a4eb-993407d0f3cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee, portal: 172.16.0.220,3260]
Oct 25 21:21:52 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee, portal: 172.16.0.220,3260] successful.
Oct 25 21:21:52 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Starting finish_revert_migration {{(pid=74189) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[be96edb7-ff5c-4880-9e21-b6c9669abde0]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Start _get_guest_xml network_info=[{"id": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "address": "fa:16:3e:92:dc:7e", "network": {"id": "197dd483-54ad-4b81-a0d0-26c633b3a101", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1141346509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e426fbc4bb374115a46d927092d62423", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a0280f-de", "ovs_interfaceid": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDQlxprB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '5d21b93a-b312-4c1b-9e43-ffb4b729c7d3', 'attached_at': '2023-10-25T21:21:52.000000', 'detached_at': '', 'volume_id': 'baed35ad-5534-47eb-93f6-2393d45d9e78', 'serial': 'baed35ad-5534-47eb-93f6-2393d45d9e78'}, 'attachment_id': '98efae3e-8d69-409c-bcdc-08ebba82bbc0', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:21:52 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:21:52 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:21:52 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:21:52 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f557e1cf-5e48-48dd-8947-88346ba26a9e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:21:52 user nova-compute[74189]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee (non-flash)
Oct 25 21:21:52 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:21:52 user nova-compute[74189]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee (non-flash)
Oct 25 21:21:52 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.425s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG nova.objects.instance [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[af86b76d-2453-4861-8787-3bc1e1cc3510]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kRpGoDPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDQlxprB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:21:52 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:21:52 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG nova.policy [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b34817b1868f40a38a32a51d0e970d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4815aedea48841188ed8797a0eb51925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:21:52 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Creating image(s)
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "/opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "/opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "/opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.205s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.195s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk 1073741824" returned: 0 in 0.053s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.181s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Checking if we can resize image /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Successfully created port: 8eb6e9e2-60c6-463d-8525-b768933a94df {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Cannot resize image /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Ensure instance console log exists: /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.464s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] <== connect_volume: return (1466ms) {'type': 'block', 'scsi_wwn': '26661396136393734', 'path': '/dev/sdc'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661396136393734', 'path': '/dev/sdc'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.980s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:21:53 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:21:53 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:21:53 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89d145c-caf9-4768-8c8f-2df356b3741a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:21:53 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'agWnbZlp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:21:53 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:21:53 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cce626-e825-4485-9649-a65330b9e7ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78] added
Oct 25 21:21:53 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df11e25-1f0c-4f89-a6dd-bb4587aa8dfb]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12f4d65-970a-4593-bc6a-97e34d82f63a]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CDQlxprB {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CDQlxprB" returned: 0 in 0.031s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5133b467-2cad-48d3-82a2-d32adb31bdfe]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CDQlxprB'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a497cbde-9485-49e6-8c81-5fe12b88365e]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[377c1fa4-d96c-489d-9871-947fc6b3ad2a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:21:53 user nova-compute[74189]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee (non-flash)
Oct 25 21:21:53 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:21:53 user nova-compute[74189]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee (non-flash)
Oct 25 21:21:53 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb991ba-9f26-4c7f-9042-3bde3a5fa8cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78, portal: 172.16.0.220,3260]
Oct 25 21:21:53 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78, portal: 172.16.0.220,3260] successful.
Oct 25 21:21:53 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.127s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdf93b7-1569-4bf4-aed7-c992c6821b9f]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c75d8f-81ac-4683-8712-4937252d6ae9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:21:53 user nova-compute[74189]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee (non-flash)
Oct 25 21:21:53 user nova-compute[74189]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:21:53 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:21:53 user nova-compute[74189]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee (non-flash)
Oct 25 21:21:53 user nova-compute[74189]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:21:53 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.448s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e19cf60-ce2c-41da-a186-35c992bfbec9]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDQlxprB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:21:53 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Successfully updated port: 8eb6e9e2-60c6-463d-8525-b768933a94df {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "refresh_cache-932fe8ac-fdde-45c6-aa32-9bf866f19a4e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquired lock "refresh_cache-932fe8ac-fdde-45c6-aa32-9bf866f19a4e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.compute.manager [req-e696a1e7-b339-4295-9886-5621b61b0060 req-99c52887-135e-439e-98ab-1d8265f58d9d service nova] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Received event network-changed-8eb6e9e2-60c6-463d-8525-b768933a94df {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.compute.manager [req-e696a1e7-b339-4295-9886-5621b61b0060 req-99c52887-135e-439e-98ab-1d8265f58d9d service nova] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Refreshing instance network info cache due to event network-changed-8eb6e9e2-60c6-463d-8525-b768933a94df. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e696a1e7-b339-4295-9886-5621b61b0060 req-99c52887-135e-439e-98ab-1d8265f58d9d service nova] Acquiring lock "refresh_cache-932fe8ac-fdde-45c6-aa32-9bf866f19a4e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Updating instance_info_cache with network_info: [{"id": "8eb6e9e2-60c6-463d-8525-b768933a94df", "address": "fa:16:3e:e8:de:d0", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb6e9e2-60", "ovs_interfaceid": "8eb6e9e2-60c6-463d-8525-b768933a94df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Releasing lock "refresh_cache-932fe8ac-fdde-45c6-aa32-9bf866f19a4e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Instance network_info: |[{"id": "8eb6e9e2-60c6-463d-8525-b768933a94df", "address": "fa:16:3e:e8:de:d0", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb6e9e2-60", "ovs_interfaceid": "8eb6e9e2-60c6-463d-8525-b768933a94df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e696a1e7-b339-4295-9886-5621b61b0060 req-99c52887-135e-439e-98ab-1d8265f58d9d service nova] Acquired lock "refresh_cache-932fe8ac-fdde-45c6-aa32-9bf866f19a4e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.network.neutron [req-e696a1e7-b339-4295-9886-5621b61b0060 req-99c52887-135e-439e-98ab-1d8265f58d9d service nova] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Refreshing network info cache for port 8eb6e9e2-60c6-463d-8525-b768933a94df {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Start _get_guest_xml network_info=[{"id": "8eb6e9e2-60c6-463d-8525-b768933a94df", "address": "fa:16:3e:e8:de:d0", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb6e9e2-60", "ovs_interfaceid": "8eb6e9e2-60c6-463d-8525-b768933a94df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:21:54 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:21:54 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:21:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-944612279',display_name='tempest-ServerActionsTestOtherA-server-944612279',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-944612279',id=18,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2S7seSL6H542o42+kjhdFVCcVB3vmP0zFQehKH4IjkXrBgeXgKPGixJeOzeDKKnbCU86Dz8L3oU7gAYCj2cW/f6u+7OuTUBmRTwo8tpApDh9NwCKVzKxF9Lu0jaZZAvw==',key_name='tempest-keypair-2141227250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4815aedea48841188ed8797a0eb51925',ramdisk_id='',reservation_id='r-fqo400nx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1355855048',owner_user_name='tempest-ServerActionsTestOtherA-1355855048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:21:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b34817b1868f40a38a32a51d0e970d51',uuid=932fe8ac-fdde-45c6-aa32-9bf866f19a4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8eb6e9e2-60c6-463d-8525-b768933a94df", "address": "fa:16:3e:e8:de:d0", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb6e9e2-60", "ovs_interfaceid": "8eb6e9e2-60c6-463d-8525-b768933a94df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Converting VIF {"id": "8eb6e9e2-60c6-463d-8525-b768933a94df", "address": "fa:16:3e:e8:de:d0", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb6e9e2-60", "ovs_interfaceid": "8eb6e9e2-60c6-463d-8525-b768933a94df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:de:d0,bridge_name='br-int',has_traffic_filtering=True,id=8eb6e9e2-60c6-463d-8525-b768933a94df,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eb6e9e2-60') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lazy-loading 'pci_devices' on Instance uuid 932fe8ac-fdde-45c6-aa32-9bf866f19a4e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:21:54 user nova-compute[74189]:   <uuid>932fe8ac-fdde-45c6-aa32-9bf866f19a4e</uuid>
Oct 25 21:21:54 user nova-compute[74189]:   <name>instance-00000012</name>
Oct 25 21:21:54 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:21:54 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:21:54 user nova-compute[74189]:   <metadata>
Oct 25 21:21:54 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:21:54 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:21:54 user nova-compute[74189]:       <nova:name>tempest-ServerActionsTestOtherA-server-944612279</nova:name>
Oct 25 21:21:54 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:21:54</nova:creationTime>
Oct 25 21:21:54 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:21:54 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:21:54 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:21:54 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:21:54 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:21:54 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:21:54 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:21:54 user nova-compute[74189]:       <nova:owner>
Oct 25 21:21:54 user nova-compute[74189]:         <nova:user uuid="b34817b1868f40a38a32a51d0e970d51">tempest-ServerActionsTestOtherA-1355855048-project-member</nova:user>
Oct 25 21:21:54 user nova-compute[74189]:         <nova:project uuid="4815aedea48841188ed8797a0eb51925">tempest-ServerActionsTestOtherA-1355855048</nova:project>
Oct 25 21:21:54 user nova-compute[74189]:       </nova:owner>
Oct 25 21:21:54 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:21:54 user nova-compute[74189]:       <nova:ports>
Oct 25 21:21:54 user nova-compute[74189]:         <nova:port uuid="8eb6e9e2-60c6-463d-8525-b768933a94df">
Oct 25 21:21:54 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 25 21:21:54 user nova-compute[74189]:         </nova:port>
Oct 25 21:21:54 user nova-compute[74189]:       </nova:ports>
Oct 25 21:21:54 user nova-compute[74189]:     </nova:instance>
Oct 25 21:21:54 user nova-compute[74189]:   </metadata>
Oct 25 21:21:54 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:21:54 user nova-compute[74189]:     <system>
Oct 25 21:21:54 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:21:54 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:21:54 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:21:54 user nova-compute[74189]:       <entry name="serial">932fe8ac-fdde-45c6-aa32-9bf866f19a4e</entry>
Oct 25 21:21:54 user nova-compute[74189]:       <entry name="uuid">932fe8ac-fdde-45c6-aa32-9bf866f19a4e</entry>
Oct 25 21:21:54 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:21:54 user nova-compute[74189]:     </system>
Oct 25 21:21:54 user nova-compute[74189]:   </sysinfo>
Oct 25 21:21:54 user nova-compute[74189]:   <os>
Oct 25 21:21:54 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:21:54 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:21:54 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:21:54 user nova-compute[74189]:   </os>
Oct 25 21:21:54 user nova-compute[74189]:   <features>
Oct 25 21:21:54 user nova-compute[74189]:     <acpi/>
Oct 25 21:21:54 user nova-compute[74189]:     <apic/>
Oct 25 21:21:54 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:21:54 user nova-compute[74189]:   </features>
Oct 25 21:21:54 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:21:54 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:21:54 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:21:54 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:21:54 user nova-compute[74189]:   </clock>
Oct 25 21:21:54 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:21:54 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:21:54 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:21:54 user nova-compute[74189]:   </cpu>
Oct 25 21:21:54 user nova-compute[74189]:   <devices>
Oct 25 21:21:54 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:21:54 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:21:54 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk"/>
Oct 25 21:21:54 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:21:54 user nova-compute[74189]:     </disk>
Oct 25 21:21:54 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:21:54 user nova-compute[74189]:       <mac address="fa:16:3e:e8:de:d0"/>
Oct 25 21:21:54 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:21:54 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:21:54 user nova-compute[74189]:       <target dev="tap8eb6e9e2-60"/>
Oct 25 21:21:54 user nova-compute[74189]:     </interface>
Oct 25 21:21:54 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:21:54 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/console.log" append="off"/>
Oct 25 21:21:54 user nova-compute[74189]:     </serial>
Oct 25 21:21:54 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:21:54 user nova-compute[74189]:     <video>
Oct 25 21:21:54 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:21:54 user nova-compute[74189]:     </video>
Oct 25 21:21:54 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:21:54 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:21:54 user nova-compute[74189]:     </rng>
Oct 25 21:21:54 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:21:54 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:21:54 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:21:54 user nova-compute[74189]:     </memballoon>
Oct 25 21:21:54 user nova-compute[74189]:   </devices>
Oct 25 21:21:54 user nova-compute[74189]: </domain>
Oct 25 21:21:54 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:21:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-944612279',display_name='tempest-ServerActionsTestOtherA-server-944612279',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-944612279',id=18,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2S7seSL6H542o42+kjhdFVCcVB3vmP0zFQehKH4IjkXrBgeXgKPGixJeOzeDKKnbCU86Dz8L3oU7gAYCj2cW/f6u+7OuTUBmRTwo8tpApDh9NwCKVzKxF9Lu0jaZZAvw==',key_name='tempest-keypair-2141227250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4815aedea48841188ed8797a0eb51925',ramdisk_id='',reservation_id='r-fqo400nx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1355855048',owner_user_name='tempest-ServerActionsTestOtherA-1355855048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:21:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b34817b1868f40a38a32a51d0e970d51',uuid=932fe8ac-fdde-45c6-aa32-9bf866f19a4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8eb6e9e2-60c6-463d-8525-b768933a94df", "address": "fa:16:3e:e8:de:d0", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb6e9e2-60", "ovs_interfaceid": "8eb6e9e2-60c6-463d-8525-b768933a94df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Converting VIF {"id": "8eb6e9e2-60c6-463d-8525-b768933a94df", "address": "fa:16:3e:e8:de:d0", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb6e9e2-60", "ovs_interfaceid": "8eb6e9e2-60c6-463d-8525-b768933a94df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:de:d0,bridge_name='br-int',has_traffic_filtering=True,id=8eb6e9e2-60c6-463d-8525-b768933a94df,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eb6e9e2-60') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG os_vif [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:de:d0,bridge_name='br-int',has_traffic_filtering=True,id=8eb6e9e2-60c6-463d-8525-b768933a94df,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eb6e9e2-60') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3cbff069-daf8-5f1e-a04e-8e69a1833ba9', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8eb6e9e2-60, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8eb6e9e2-60, col_values=(('qos', UUID('9cb8e7ac-1363-4fec-b3c3-bc08a621eb75')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8eb6e9e2-60, col_values=(('external_ids', {'iface-id': '8eb6e9e2-60c6-463d-8525-b768933a94df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:de:d0', 'vm-uuid': '932fe8ac-fdde-45c6-aa32-9bf866f19a4e'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:54 user nova-compute[74189]: INFO os_vif [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:de:d0,bridge_name='br-int',has_traffic_filtering=True,id=8eb6e9e2-60c6-463d-8525-b768933a94df,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eb6e9e2-60')
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] No VIF found with MAC fa:16:3e:e8:de:d0, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.network.neutron [req-e696a1e7-b339-4295-9886-5621b61b0060 req-99c52887-135e-439e-98ab-1d8265f58d9d service nova] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Updated VIF entry in instance network info cache for port 8eb6e9e2-60c6-463d-8525-b768933a94df. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.network.neutron [req-e696a1e7-b339-4295-9886-5621b61b0060 req-99c52887-135e-439e-98ab-1d8265f58d9d service nova] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Updating instance_info_cache with network_info: [{"id": "8eb6e9e2-60c6-463d-8525-b768933a94df", "address": "fa:16:3e:e8:de:d0", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb6e9e2-60", "ovs_interfaceid": "8eb6e9e2-60c6-463d-8525-b768933a94df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e696a1e7-b339-4295-9886-5621b61b0060 req-99c52887-135e-439e-98ab-1d8265f58d9d service nova] Releasing lock "refresh_cache-932fe8ac-fdde-45c6-aa32-9bf866f19a4e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.496s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] <== connect_volume: return (2477ms) {'type': 'block', 'scsi_wwn': '26332383433326233', 'path': '/dev/sdd'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332383433326233', 'path': '/dev/sdd'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.457s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:21:54 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:21:54 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:21:54 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:21:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abacc23-5c5c-40ba-a1ef-8ea6574335cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:21:54 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:15:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2127723699',display_name='tempest-ServerActionsTestOtherB-server-2127723699',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2127723699',id=3,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjedofMSVtj00tqk1jqFMH5AZ5Pyw9+9WP37zpM0w2hcAIIw4fFannJXo68FjlEI0XSKwz6/AZjg4uhqhEM0AXh7nvdUT82CEMoJ2RGXuMes6AOS513uwlo8CUT17ABSg==',key_name='tempest-keypair-611941333',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:20:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e426fbc4bb374115a46d927092d62423',ramdisk_id='',reservation_id='r-q0q32lk1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-40176194',owner_user_name='tempest-ServerActionsTestOtherB-40176194-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:21:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e81aaad00624abdafe04f6c8de4c5c0',uuid=5d21b93a-b312-4c1b-9e43-ffb4b729c7d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "address": "fa:16:3e:92:dc:7e", "network": {"id": "197dd483-54ad-4b81-a0d0-26c633b3a101", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1141346509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e426fbc4bb374115a46d927092d62423", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a0280f-de", "ovs_interfaceid": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Converting VIF {"id": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "address": "fa:16:3e:92:dc:7e", "network": {"id": "197dd483-54ad-4b81-a0d0-26c633b3a101", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1141346509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e426fbc4bb374115a46d927092d62423", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a0280f-de", "ovs_interfaceid": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:dc:7e,bridge_name='br-int',has_traffic_filtering=True,id=c6a0280f-def7-4677-910c-7a3a3c6b57df,network=Network(197dd483-54ad-4b81-a0d0-26c633b3a101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6a0280f-de') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:21:54 user nova-compute[74189]:   <uuid>5d21b93a-b312-4c1b-9e43-ffb4b729c7d3</uuid>
Oct 25 21:21:54 user nova-compute[74189]:   <name>instance-00000003</name>
Oct 25 21:21:54 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:21:54 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:21:54 user nova-compute[74189]:   <metadata>
Oct 25 21:21:54 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:21:54 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:21:54 user nova-compute[74189]:       <nova:name>tempest-ServerActionsTestOtherB-server-2127723699</nova:name>
Oct 25 21:21:54 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:21:52</nova:creationTime>
Oct 25 21:21:54 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:21:54 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:21:54 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:21:54 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:21:54 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:21:54 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:21:54 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:21:54 user nova-compute[74189]:       <nova:owner>
Oct 25 21:21:54 user nova-compute[74189]:         <nova:user uuid="7e81aaad00624abdafe04f6c8de4c5c0">tempest-ServerActionsTestOtherB-40176194-project-member</nova:user>
Oct 25 21:21:54 user nova-compute[74189]:         <nova:project uuid="e426fbc4bb374115a46d927092d62423">tempest-ServerActionsTestOtherB-40176194</nova:project>
Oct 25 21:21:54 user nova-compute[74189]:       </nova:owner>
Oct 25 21:21:54 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:21:54 user nova-compute[74189]:       <nova:ports>
Oct 25 21:21:54 user nova-compute[74189]:         <nova:port uuid="c6a0280f-def7-4677-910c-7a3a3c6b57df">
Oct 25 21:21:54 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 25 21:21:54 user nova-compute[74189]:         </nova:port>
Oct 25 21:21:54 user nova-compute[74189]:       </nova:ports>
Oct 25 21:21:54 user nova-compute[74189]:     </nova:instance>
Oct 25 21:21:54 user nova-compute[74189]:   </metadata>
Oct 25 21:21:54 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:21:54 user nova-compute[74189]:     <system>
Oct 25 21:21:54 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:21:54 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:21:54 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:21:54 user nova-compute[74189]:       <entry name="serial">5d21b93a-b312-4c1b-9e43-ffb4b729c7d3</entry>
Oct 25 21:21:54 user nova-compute[74189]:       <entry name="uuid">5d21b93a-b312-4c1b-9e43-ffb4b729c7d3</entry>
Oct 25 21:21:54 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:21:54 user nova-compute[74189]:     </system>
Oct 25 21:21:54 user nova-compute[74189]:   </sysinfo>
Oct 25 21:21:54 user nova-compute[74189]:   <os>
Oct 25 21:21:54 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:21:54 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:21:54 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:21:54 user nova-compute[74189]:   </os>
Oct 25 21:21:54 user nova-compute[74189]:   <features>
Oct 25 21:21:54 user nova-compute[74189]:     <acpi/>
Oct 25 21:21:54 user nova-compute[74189]:     <apic/>
Oct 25 21:21:54 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:21:54 user nova-compute[74189]:   </features>
Oct 25 21:21:54 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:21:54 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:21:54 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:21:54 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:21:54 user nova-compute[74189]:   </clock>
Oct 25 21:21:54 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:21:54 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:21:54 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:21:54 user nova-compute[74189]:   </cpu>
Oct 25 21:21:54 user nova-compute[74189]:   <devices>
Oct 25 21:21:54 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:21:54 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:21:54 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk"/>
Oct 25 21:21:54 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:21:54 user nova-compute[74189]:     </disk>
Oct 25 21:21:54 user nova-compute[74189]:     <disk type="block" device="disk">
Oct 25 21:21:54 user nova-compute[74189]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:21:54 user nova-compute[74189]:       <source dev="/dev/sdd"/>
Oct 25 21:21:54 user nova-compute[74189]:       <target dev="vdb" bus="virtio"/>
Oct 25 21:21:54 user nova-compute[74189]:       <serial>baed35ad-5534-47eb-93f6-2393d45d9e78</serial>
Oct 25 21:21:54 user nova-compute[74189]:     </disk>
Oct 25 21:21:54 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:21:54 user nova-compute[74189]:       <mac address="fa:16:3e:92:dc:7e"/>
Oct 25 21:21:54 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:21:54 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:21:54 user nova-compute[74189]:       <target dev="tapc6a0280f-de"/>
Oct 25 21:21:54 user nova-compute[74189]:     </interface>
Oct 25 21:21:54 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:21:54 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/console.log" append="off"/>
Oct 25 21:21:54 user nova-compute[74189]:     </serial>
Oct 25 21:21:54 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:21:54 user nova-compute[74189]:     <video>
Oct 25 21:21:54 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:21:54 user nova-compute[74189]:     </video>
Oct 25 21:21:54 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:21:54 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:21:54 user nova-compute[74189]:     </rng>
Oct 25 21:21:54 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:21:54 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:21:54 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:21:54 user nova-compute[74189]:     </memballoon>
Oct 25 21:21:54 user nova-compute[74189]:   </devices>
Oct 25 21:21:54 user nova-compute[74189]: </domain>
Oct 25 21:21:54 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:15:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2127723699',display_name='tempest-ServerActionsTestOtherB-server-2127723699',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2127723699',id=3,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjedofMSVtj00tqk1jqFMH5AZ5Pyw9+9WP37zpM0w2hcAIIw4fFannJXo68FjlEI0XSKwz6/AZjg4uhqhEM0AXh7nvdUT82CEMoJ2RGXuMes6AOS513uwlo8CUT17ABSg==',key_name='tempest-keypair-611941333',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:20:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e426fbc4bb374115a46d927092d62423',ramdisk_id='',reservation_id='r-q0q32lk1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-40176194',owner_user_name='tempest-ServerActionsTestOtherB-40176194-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:21:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e81aaad00624abdafe04f6c8de4c5c0',uuid=5d21b93a-b312-4c1b-9e43-ffb4b729c7d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "address": "fa:16:3e:92:dc:7e", "network": {"id": "197dd483-54ad-4b81-a0d0-26c633b3a101", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1141346509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e426fbc4bb374115a46d927092d62423", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a0280f-de", "ovs_interfaceid": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Converting VIF {"id": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "address": "fa:16:3e:92:dc:7e", "network": {"id": "197dd483-54ad-4b81-a0d0-26c633b3a101", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1141346509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e426fbc4bb374115a46d927092d62423", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a0280f-de", "ovs_interfaceid": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:dc:7e,bridge_name='br-int',has_traffic_filtering=True,id=c6a0280f-def7-4677-910c-7a3a3c6b57df,network=Network(197dd483-54ad-4b81-a0d0-26c633b3a101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6a0280f-de') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG os_vif [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:dc:7e,bridge_name='br-int',has_traffic_filtering=True,id=c6a0280f-def7-4677-910c-7a3a3c6b57df,network=Network(197dd483-54ad-4b81-a0d0-26c633b3a101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6a0280f-de') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0a599051-42c4-58ad-af42-6ca12a2e31cb', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb96a361-c0c3-4952-b693-ebafc67c9756]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706] added
Oct 25 21:21:54 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6a0280f-de, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc6a0280f-de, col_values=(('qos', UUID('9793da21-2349-476b-be77-0f79348e630a')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc6a0280f-de, col_values=(('external_ids', {'iface-id': 'c6a0280f-def7-4677-910c-7a3a3c6b57df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:dc:7e', 'vm-uuid': '5d21b93a-b312-4c1b-9e43-ffb4b729c7d3'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b057294a-7ee1-43c5-93d7-bda8214c52bc]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:54 user nova-compute[74189]: INFO os_vif [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:dc:7e,bridge_name='br-int',has_traffic_filtering=True,id=c6a0280f-def7-4677-910c-7a3a3c6b57df,network=Network(197dd483-54ad-4b81-a0d0-26c633b3a101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6a0280f-de')
Oct 25 21:21:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[656dded4-18fd-4c0e-80df-068e1f3c5c4a]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v agWnbZlp {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v agWnbZlp" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8ccb4d-ca31-4655-b396-d0f61a35aeac]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'agWnbZlp'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc42256-3f11-4772-b0a0-15d6cfbbf216]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb832e9a-1319-4618-b4af-1ef64849f7a5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:21:55 user nova-compute[74189]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee (non-flash)
Oct 25 21:21:55 user nova-compute[74189]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:21:55 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:21:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:21:55 user nova-compute[74189]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee (non-flash)
Oct 25 21:21:55 user nova-compute[74189]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:21:55 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:21:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8701f8fe-ae88-497e-a7c9-6b73d61238d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706, portal: 172.16.0.220,3260]
Oct 25 21:21:55 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706, portal: 172.16.0.220,3260] successful.
Oct 25 21:21:55 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26522fb-0de5-4d54-aa7f-106908973aba]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[348451cf-fa20-4bcc-b7f6-d87fed0f67a1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:21:55 user nova-compute[74189]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee (non-flash)
Oct 25 21:21:55 user nova-compute[74189]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:21:55 user nova-compute[74189]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 (non-flash)
Oct 25 21:21:55 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:21:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:21:55 user nova-compute[74189]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee (non-flash)
Oct 25 21:21:55 user nova-compute[74189]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:21:55 user nova-compute[74189]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 (non-flash)
Oct 25 21:21:55 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:21:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:21:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:21:55 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] HCTL ('36', '-', '-', 0) found on session 21 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:21:55 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:21:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4398b3-7642-4fa9-aafe-d0b90e6e9603]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:55 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:21:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'agWnbZlp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] <== connect_volume: return (2790ms) {'type': 'block', 'scsi_wwn': '26166323962333361', 'path': '/dev/sde'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166323962333361', 'path': '/dev/sde'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yalSTDnC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:21:56 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:21:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:21:56 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:21:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:21:56 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:21:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bc286e-9fa1-4a55-a9da-c78c89f7bd5a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:21:56 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5eaa391-fbae-47ce-84d9-f96a68c831ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603] added
Oct 25 21:21:56 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1406ef44-7079-4db6-afdf-c023607649f7]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0933e6-79c0-467b-8a51-6d4d7929450a]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yalSTDnC {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yalSTDnC" returned: 0 in 0.028s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd047e5b-ab2a-4fa3-9537-3a2302107c2a]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yalSTDnC'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4711fc-8221-4b67-851e-e5e90f236602]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c958d4-f3d8-4907-9a5f-0ae433fb3faa]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:21:56 user nova-compute[74189]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee (non-flash)
Oct 25 21:21:56 user nova-compute[74189]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:21:56 user nova-compute[74189]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 (non-flash)
Oct 25 21:21:56 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:21:56 user nova-compute[74189]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee (non-flash)
Oct 25 21:21:56 user nova-compute[74189]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:21:56 user nova-compute[74189]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 (non-flash)
Oct 25 21:21:56 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7bbfbe-5dd9-48da-a9d5-cadc6ecd7f4b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603, portal: 172.16.0.220,3260]
Oct 25 21:21:56 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603, portal: 172.16.0.220,3260] successful.
Oct 25 21:21:56 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f213f046-d122-410d-b4f9-cb7f75389787]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[34336ed3-fa8b-4158-b58b-13ab218fbdeb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:21:56 user nova-compute[74189]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee (non-flash)
Oct 25 21:21:56 user nova-compute[74189]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:21:56 user nova-compute[74189]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 (non-flash)
Oct 25 21:21:56 user nova-compute[74189]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 (non-flash)
Oct 25 21:21:56 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:21:56 user nova-compute[74189]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee (non-flash)
Oct 25 21:21:56 user nova-compute[74189]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:21:56 user nova-compute[74189]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 (non-flash)
Oct 25 21:21:56 user nova-compute[74189]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 (non-flash)
Oct 25 21:21:56 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] HCTL ('37', '-', '-', 0) found on session 22 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.028s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c872683d-8082-4644-800d-2a5f0386f544]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Searching for a device in session 22 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yalSTDnC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-18de649c-f897-4a2c-8434-1fecfbec529b req-91e19969-2cef-4ebe-942c-3ff1e1b006c5 service nova] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Received event network-vif-plugged-8eb6e9e2-60c6-463d-8525-b768933a94df {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-18de649c-f897-4a2c-8434-1fecfbec529b req-91e19969-2cef-4ebe-942c-3ff1e1b006c5 service nova] Acquiring lock "932fe8ac-fdde-45c6-aa32-9bf866f19a4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-18de649c-f897-4a2c-8434-1fecfbec529b req-91e19969-2cef-4ebe-942c-3ff1e1b006c5 service nova] Lock "932fe8ac-fdde-45c6-aa32-9bf866f19a4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-18de649c-f897-4a2c-8434-1fecfbec529b req-91e19969-2cef-4ebe-942c-3ff1e1b006c5 service nova] Lock "932fe8ac-fdde-45c6-aa32-9bf866f19a4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-18de649c-f897-4a2c-8434-1fecfbec529b req-91e19969-2cef-4ebe-942c-3ff1e1b006c5 service nova] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] No waiting events found dispatching network-vif-plugged-8eb6e9e2-60c6-463d-8525-b768933a94df {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:21:57 user nova-compute[74189]: WARNING nova.compute.manager [req-18de649c-f897-4a2c-8434-1fecfbec529b req-91e19969-2cef-4ebe-942c-3ff1e1b006c5 service nova] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Received unexpected event network-vif-plugged-8eb6e9e2-60c6-463d-8525-b768933a94df for instance with vm_state building and task_state spawning.
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-609080ab-d3cb-4da9-9b16-924937a38436 req-a7b5352d-caef-40bd-a83c-389405e612ee service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Received event network-vif-plugged-c6a0280f-def7-4677-910c-7a3a3c6b57df {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-609080ab-d3cb-4da9-9b16-924937a38436 req-a7b5352d-caef-40bd-a83c-389405e612ee service nova] Acquiring lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-609080ab-d3cb-4da9-9b16-924937a38436 req-a7b5352d-caef-40bd-a83c-389405e612ee service nova] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-609080ab-d3cb-4da9-9b16-924937a38436 req-a7b5352d-caef-40bd-a83c-389405e612ee service nova] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-609080ab-d3cb-4da9-9b16-924937a38436 req-a7b5352d-caef-40bd-a83c-389405e612ee service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] No waiting events found dispatching network-vif-plugged-c6a0280f-def7-4677-910c-7a3a3c6b57df {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:21:57 user nova-compute[74189]: WARNING nova.compute.manager [req-609080ab-d3cb-4da9-9b16-924937a38436 req-a7b5352d-caef-40bd-a83c-389405e612ee service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Received unexpected event network-vif-plugged-c6a0280f-def7-4677-910c-7a3a3c6b57df for instance with vm_state resized and task_state resize_reverting.
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23737633736366564', 'path': '/dev/sdf'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737633736366564', 'path': '/dev/sdf'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920835665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-920835665',id=15,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7FZk64RryMLyk++QiCGXXc6F4kczfNZkLF/M8gV7fC8oRD+LglFRr9PqpSbI3FpMuDRig++iLTLZch4e1RR5Oy04z44+nk2RSdOAieaA1OaHo6pDDmUX+imOxyUbWyrg==',key_name='tempest-keypair-2022750063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f78ddc9861f9455aa58a9a532548023a',ramdisk_id='',reservation_id='r-yuvohw46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-994959279',owner_user_name='tempest-TaggedBootDevicesTest_v242-994959279-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:20:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ccd825e31941ce9a876d85b607e02f',uuid=46ffb192-ad11-416e-9094-c8e080b5414e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35311a59-a404-4759-8125-ac222750d5fa", "address": "fa:16:3e:b5:8d:bc", "network": {"id": "477a555b-610a-4b4f-8e0e-efd52c856097", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1102892168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35311a59-a4", "ovs_interfaceid": "35311a59-a404-4759-8125-ac222750d5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converting VIF {"id": "35311a59-a404-4759-8125-ac222750d5fa", "address": "fa:16:3e:b5:8d:bc", "network": {"id": "477a555b-610a-4b4f-8e0e-efd52c856097", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1102892168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35311a59-a4", "ovs_interfaceid": "35311a59-a404-4759-8125-ac222750d5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:8d:bc,bridge_name='br-int',has_traffic_filtering=True,id=35311a59-a404-4759-8125-ac222750d5fa,network=Network(477a555b-610a-4b4f-8e0e-efd52c856097),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35311a59-a4') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920835665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-920835665',id=15,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7FZk64RryMLyk++QiCGXXc6F4kczfNZkLF/M8gV7fC8oRD+LglFRr9PqpSbI3FpMuDRig++iLTLZch4e1RR5Oy04z44+nk2RSdOAieaA1OaHo6pDDmUX+imOxyUbWyrg==',key_name='tempest-keypair-2022750063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f78ddc9861f9455aa58a9a532548023a',ramdisk_id='',reservation_id='r-yuvohw46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-994959279',owner_user_name='tempest-TaggedBootDevicesTest_v242-994959279-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:20:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ccd825e31941ce9a876d85b607e02f',uuid=46ffb192-ad11-416e-9094-c8e080b5414e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "address": "fa:16:3e:b2:20:8d", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1d7d42-01", "ovs_interfaceid": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converting VIF {"id": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "address": "fa:16:3e:b2:20:8d", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1d7d42-01", "ovs_interfaceid": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:20:8d,bridge_name='br-int',has_traffic_filtering=True,id=bf1d7d42-01d4-4d66-814b-00a055fd82a5,network=Network(cabdedc4-8ff4-4fab-9935-925c40f2a8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbf1d7d42-01') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920835665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-920835665',id=15,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7FZk64RryMLyk++QiCGXXc6F4kczfNZkLF/M8gV7fC8oRD+LglFRr9PqpSbI3FpMuDRig++iLTLZch4e1RR5Oy04z44+nk2RSdOAieaA1OaHo6pDDmUX+imOxyUbWyrg==',key_name='tempest-keypair-2022750063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f78ddc9861f9455aa58a9a532548023a',ramdisk_id='',reservation_id='r-yuvohw46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-994959279',owner_user_name='tempest-TaggedBootDevicesTest_v242-994959279-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:20:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ccd825e31941ce9a876d85b607e02f',uuid=46ffb192-ad11-416e-9094-c8e080b5414e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f967dd2c-da19-4645-b52e-2d79f61baabe", "address": "fa:16:3e:d1:88:5b", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf967dd2c-da", "ovs_interfaceid": "f967dd2c-da19-4645-b52e-2d79f61baabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converting VIF {"id": "f967dd2c-da19-4645-b52e-2d79f61baabe", "address": "fa:16:3e:d1:88:5b", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf967dd2c-da", "ovs_interfaceid": "f967dd2c-da19-4645-b52e-2d79f61baabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:88:5b,bridge_name='br-int',has_traffic_filtering=True,id=f967dd2c-da19-4645-b52e-2d79f61baabe,network=Network(cabdedc4-8ff4-4fab-9935-925c40f2a8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf967dd2c-da') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920835665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-920835665',id=15,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7FZk64RryMLyk++QiCGXXc6F4kczfNZkLF/M8gV7fC8oRD+LglFRr9PqpSbI3FpMuDRig++iLTLZch4e1RR5Oy04z44+nk2RSdOAieaA1OaHo6pDDmUX+imOxyUbWyrg==',key_name='tempest-keypair-2022750063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f78ddc9861f9455aa58a9a532548023a',ramdisk_id='',reservation_id='r-yuvohw46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-994959279',owner_user_name='tempest-TaggedBootDevicesTest_v242-994959279-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:20:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ccd825e31941ce9a876d85b607e02f',uuid=46ffb192-ad11-416e-9094-c8e080b5414e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f18e575-80eb-41e8-8615-bcbbe00ff9de", "address": "fa:16:3e:c2:d7:0b", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f18e575-80", "ovs_interfaceid": "5f18e575-80eb-41e8-8615-bcbbe00ff9de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converting VIF {"id": "5f18e575-80eb-41e8-8615-bcbbe00ff9de", "address": "fa:16:3e:c2:d7:0b", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f18e575-80", "ovs_interfaceid": "5f18e575-80eb-41e8-8615-bcbbe00ff9de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:d7:0b,bridge_name='br-int',has_traffic_filtering=True,id=5f18e575-80eb-41e8-8615-bcbbe00ff9de,network=Network(cabdedc4-8ff4-4fab-9935-925c40f2a8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f18e575-80') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920835665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-920835665',id=15,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7FZk64RryMLyk++QiCGXXc6F4kczfNZkLF/M8gV7fC8oRD+LglFRr9PqpSbI3FpMuDRig++iLTLZch4e1RR5Oy04z44+nk2RSdOAieaA1OaHo6pDDmUX+imOxyUbWyrg==',key_name='tempest-keypair-2022750063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f78ddc9861f9455aa58a9a532548023a',ramdisk_id='',reservation_id='r-yuvohw46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-994959279',owner_user_name='tempest-TaggedBootDevicesTest_v242-994959279-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:20:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ccd825e31941ce9a876d85b607e02f',uuid=46ffb192-ad11-416e-9094-c8e080b5414e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4caa88c4-c581-41eb-b8f8-a291aaef3ad4", "address": "fa:16:3e:24:e8:88", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4caa88c4-c5", "ovs_interfaceid": "4caa88c4-c581-41eb-b8f8-a291aaef3ad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converting VIF {"id": "4caa88c4-c581-41eb-b8f8-a291aaef3ad4", "address": "fa:16:3e:24:e8:88", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4caa88c4-c5", "ovs_interfaceid": "4caa88c4-c581-41eb-b8f8-a291aaef3ad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:e8:88,bridge_name='br-int',has_traffic_filtering=True,id=4caa88c4-c581-41eb-b8f8-a291aaef3ad4,network=Network(cabdedc4-8ff4-4fab-9935-925c40f2a8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4caa88c4-c5') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920835665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-920835665',id=15,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7FZk64RryMLyk++QiCGXXc6F4kczfNZkLF/M8gV7fC8oRD+LglFRr9PqpSbI3FpMuDRig++iLTLZch4e1RR5Oy04z44+nk2RSdOAieaA1OaHo6pDDmUX+imOxyUbWyrg==',key_name='tempest-keypair-2022750063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f78ddc9861f9455aa58a9a532548023a',ramdisk_id='',reservation_id='r-yuvohw46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-994959279',owner_user_name='tempest-TaggedBootDevicesTest_v242-994959279-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:20:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ccd825e31941ce9a876d85b607e02f',uuid=46ffb192-ad11-416e-9094-c8e080b5414e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b60a817a-3478-48d7-b117-bee088bc7e86", "address": "fa:16:3e:0f:4d:3e", "network": {"id": "68ea97b8-852c-464a-9ccb-b2dc55c63e47", "bridge": "br-int", "label": "tempest-device-tagging-net2-670429054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60a817a-34", "ovs_interfaceid": "b60a817a-3478-48d7-b117-bee088bc7e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converting VIF {"id": "b60a817a-3478-48d7-b117-bee088bc7e86", "address": "fa:16:3e:0f:4d:3e", "network": {"id": "68ea97b8-852c-464a-9ccb-b2dc55c63e47", "bridge": "br-int", "label": "tempest-device-tagging-net2-670429054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60a817a-34", "ovs_interfaceid": "b60a817a-3478-48d7-b117-bee088bc7e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:4d:3e,bridge_name='br-int',has_traffic_filtering=True,id=b60a817a-3478-48d7-b117-bee088bc7e86,network=Network(68ea97b8-852c-464a-9ccb-b2dc55c63e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb60a817a-34') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920835665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-920835665',id=15,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7FZk64RryMLyk++QiCGXXc6F4kczfNZkLF/M8gV7fC8oRD+LglFRr9PqpSbI3FpMuDRig++iLTLZch4e1RR5Oy04z44+nk2RSdOAieaA1OaHo6pDDmUX+imOxyUbWyrg==',key_name='tempest-keypair-2022750063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f78ddc9861f9455aa58a9a532548023a',ramdisk_id='',reservation_id='r-yuvohw46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-994959279',owner_user_name='tempest-TaggedBootDevicesTest_v242-994959279-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:20:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ccd825e31941ce9a876d85b607e02f',uuid=46ffb192-ad11-416e-9094-c8e080b5414e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56", "address": "fa:16:3e:b0:f9:54", "network": {"id": "68ea97b8-852c-464a-9ccb-b2dc55c63e47", "bridge": "br-int", "label": "tempest-device-tagging-net2-670429054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e0f5a2-44", "ovs_interfaceid": "94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converting VIF {"id": "94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56", "address": "fa:16:3e:b0:f9:54", "network": {"id": "68ea97b8-852c-464a-9ccb-b2dc55c63e47", "bridge": "br-int", "label": "tempest-device-tagging-net2-670429054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e0f5a2-44", "ovs_interfaceid": "94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f9:54,bridge_name='br-int',has_traffic_filtering=True,id=94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56,network=Network(68ea97b8-852c-464a-9ccb-b2dc55c63e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94e0f5a2-44') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.objects.instance [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Lazy-loading 'pci_devices' on Instance uuid 46ffb192-ad11-416e-9094-c8e080b5414e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:21:57 user nova-compute[74189]:   <uuid>46ffb192-ad11-416e-9094-c8e080b5414e</uuid>
Oct 25 21:21:57 user nova-compute[74189]:   <name>instance-0000000f</name>
Oct 25 21:21:57 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:21:57 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:21:57 user nova-compute[74189]:   <metadata>
Oct 25 21:21:57 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:21:57 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:21:57 user nova-compute[74189]:       <nova:name>tempest-device-tagging-server-920835665</nova:name>
Oct 25 21:21:57 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:21:51</nova:creationTime>
Oct 25 21:21:57 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:21:57 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:21:57 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:21:57 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:21:57 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:21:57 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:21:57 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:21:57 user nova-compute[74189]:       <nova:owner>
Oct 25 21:21:57 user nova-compute[74189]:         <nova:user uuid="03ccd825e31941ce9a876d85b607e02f">tempest-TaggedBootDevicesTest_v242-994959279-project-member</nova:user>
Oct 25 21:21:57 user nova-compute[74189]:         <nova:project uuid="f78ddc9861f9455aa58a9a532548023a">tempest-TaggedBootDevicesTest_v242-994959279</nova:project>
Oct 25 21:21:57 user nova-compute[74189]:       </nova:owner>
Oct 25 21:21:57 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:21:57 user nova-compute[74189]:       <nova:ports>
Oct 25 21:21:57 user nova-compute[74189]:         <nova:port uuid="35311a59-a404-4759-8125-ac222750d5fa">
Oct 25 21:21:57 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 21:21:57 user nova-compute[74189]:         </nova:port>
Oct 25 21:21:57 user nova-compute[74189]:         <nova:port uuid="bf1d7d42-01d4-4d66-814b-00a055fd82a5">
Oct 25 21:21:57 user nova-compute[74189]:           <nova:ip type="fixed" address="10.1.1.254" ipVersion="4"/>
Oct 25 21:21:57 user nova-compute[74189]:         </nova:port>
Oct 25 21:21:57 user nova-compute[74189]:         <nova:port uuid="f967dd2c-da19-4645-b52e-2d79f61baabe">
Oct 25 21:21:57 user nova-compute[74189]:           <nova:ip type="fixed" address="10.1.1.168" ipVersion="4"/>
Oct 25 21:21:57 user nova-compute[74189]:         </nova:port>
Oct 25 21:21:57 user nova-compute[74189]:         <nova:port uuid="5f18e575-80eb-41e8-8615-bcbbe00ff9de">
Oct 25 21:21:57 user nova-compute[74189]:           <nova:ip type="fixed" address="10.1.1.36" ipVersion="4"/>
Oct 25 21:21:57 user nova-compute[74189]:         </nova:port>
Oct 25 21:21:57 user nova-compute[74189]:         <nova:port uuid="4caa88c4-c581-41eb-b8f8-a291aaef3ad4">
Oct 25 21:21:57 user nova-compute[74189]:           <nova:ip type="fixed" address="10.1.1.215" ipVersion="4"/>
Oct 25 21:21:57 user nova-compute[74189]:         </nova:port>
Oct 25 21:21:57 user nova-compute[74189]:         <nova:port uuid="b60a817a-3478-48d7-b117-bee088bc7e86">
Oct 25 21:21:57 user nova-compute[74189]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 25 21:21:57 user nova-compute[74189]:         </nova:port>
Oct 25 21:21:57 user nova-compute[74189]:         <nova:port uuid="94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56">
Oct 25 21:21:57 user nova-compute[74189]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 25 21:21:57 user nova-compute[74189]:         </nova:port>
Oct 25 21:21:57 user nova-compute[74189]:       </nova:ports>
Oct 25 21:21:57 user nova-compute[74189]:     </nova:instance>
Oct 25 21:21:57 user nova-compute[74189]:   </metadata>
Oct 25 21:21:57 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:21:57 user nova-compute[74189]:     <system>
Oct 25 21:21:57 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:21:57 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:21:57 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:21:57 user nova-compute[74189]:       <entry name="serial">46ffb192-ad11-416e-9094-c8e080b5414e</entry>
Oct 25 21:21:57 user nova-compute[74189]:       <entry name="uuid">46ffb192-ad11-416e-9094-c8e080b5414e</entry>
Oct 25 21:21:57 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:21:57 user nova-compute[74189]:     </system>
Oct 25 21:21:57 user nova-compute[74189]:   </sysinfo>
Oct 25 21:21:57 user nova-compute[74189]:   <os>
Oct 25 21:21:57 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:21:57 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:21:57 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:21:57 user nova-compute[74189]:   </os>
Oct 25 21:21:57 user nova-compute[74189]:   <features>
Oct 25 21:21:57 user nova-compute[74189]:     <acpi/>
Oct 25 21:21:57 user nova-compute[74189]:     <apic/>
Oct 25 21:21:57 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:21:57 user nova-compute[74189]:   </features>
Oct 25 21:21:57 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:21:57 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:21:57 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:21:57 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:21:57 user nova-compute[74189]:   </clock>
Oct 25 21:21:57 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:21:57 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:21:57 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:21:57 user nova-compute[74189]:   </cpu>
Oct 25 21:21:57 user nova-compute[74189]:   <devices>
Oct 25 21:21:57 user nova-compute[74189]:     <disk type="file" device="cdrom">
Oct 25 21:21:57 user nova-compute[74189]:       <driver name="qemu" type="raw" cache="none"/>
Oct 25 21:21:57 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/46ffb192-ad11-416e-9094-c8e080b5414e/disk.config"/>
Oct 25 21:21:57 user nova-compute[74189]:       <target dev="hda" bus="ide"/>
Oct 25 21:21:57 user nova-compute[74189]:     </disk>
Oct 25 21:21:57 user nova-compute[74189]:     <disk type="block" device="disk">
Oct 25 21:21:57 user nova-compute[74189]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:21:57 user nova-compute[74189]:       <source dev="/dev/sdc"/>
Oct 25 21:21:57 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:21:57 user nova-compute[74189]:       <serial>a545b3af-6d77-4506-b9c1-7c6d0320efee</serial>
Oct 25 21:21:57 user nova-compute[74189]:     </disk>
Oct 25 21:21:57 user nova-compute[74189]:     <disk type="block" device="disk">
Oct 25 21:21:57 user nova-compute[74189]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:21:57 user nova-compute[74189]:       <source dev="/dev/sde"/>
Oct 25 21:21:57 user nova-compute[74189]:       <target dev="vdb" bus="virtio"/>
Oct 25 21:21:57 user nova-compute[74189]:       <serial>4460d0cc-0295-4c0b-9126-f84e0439c706</serial>
Oct 25 21:21:57 user nova-compute[74189]:     </disk>
Oct 25 21:21:57 user nova-compute[74189]:     <disk type="block" device="disk">
Oct 25 21:21:57 user nova-compute[74189]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:21:57 user nova-compute[74189]:       <source dev="/dev/sdf"/>
Oct 25 21:21:57 user nova-compute[74189]:       <target dev="vdc" bus="virtio"/>
Oct 25 21:21:57 user nova-compute[74189]:       <serial>ba681370-9e8a-4b48-abd0-b23648598603</serial>
Oct 25 21:21:57 user nova-compute[74189]:     </disk>
Oct 25 21:21:57 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:21:57 user nova-compute[74189]:       <mac address="fa:16:3e:b5:8d:bc"/>
Oct 25 21:21:57 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:21:57 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:21:57 user nova-compute[74189]:       <target dev="tap35311a59-a4"/>
Oct 25 21:21:57 user nova-compute[74189]:     </interface>
Oct 25 21:21:57 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:21:57 user nova-compute[74189]:       <mac address="fa:16:3e:b2:20:8d"/>
Oct 25 21:21:57 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:21:57 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:21:57 user nova-compute[74189]:       <target dev="tapbf1d7d42-01"/>
Oct 25 21:21:57 user nova-compute[74189]:     </interface>
Oct 25 21:21:57 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:21:57 user nova-compute[74189]:       <mac address="fa:16:3e:d1:88:5b"/>
Oct 25 21:21:57 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:21:57 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:21:57 user nova-compute[74189]:       <target dev="tapf967dd2c-da"/>
Oct 25 21:21:57 user nova-compute[74189]:     </interface>
Oct 25 21:21:57 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:21:57 user nova-compute[74189]:       <mac address="fa:16:3e:c2:d7:0b"/>
Oct 25 21:21:57 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:21:57 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:21:57 user nova-compute[74189]:       <target dev="tap5f18e575-80"/>
Oct 25 21:21:57 user nova-compute[74189]:     </interface>
Oct 25 21:21:57 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:21:57 user nova-compute[74189]:       <mac address="fa:16:3e:24:e8:88"/>
Oct 25 21:21:57 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:21:57 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:21:57 user nova-compute[74189]:       <target dev="tap4caa88c4-c5"/>
Oct 25 21:21:57 user nova-compute[74189]:     </interface>
Oct 25 21:21:57 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:21:57 user nova-compute[74189]:       <mac address="fa:16:3e:0f:4d:3e"/>
Oct 25 21:21:57 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:21:57 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:21:57 user nova-compute[74189]:       <target dev="tapb60a817a-34"/>
Oct 25 21:21:57 user nova-compute[74189]:     </interface>
Oct 25 21:21:57 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:21:57 user nova-compute[74189]:       <mac address="fa:16:3e:b0:f9:54"/>
Oct 25 21:21:57 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:21:57 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:21:57 user nova-compute[74189]:       <target dev="tap94e0f5a2-44"/>
Oct 25 21:21:57 user nova-compute[74189]:     </interface>
Oct 25 21:21:57 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:21:57 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/46ffb192-ad11-416e-9094-c8e080b5414e/console.log" append="off"/>
Oct 25 21:21:57 user nova-compute[74189]:     </serial>
Oct 25 21:21:57 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:21:57 user nova-compute[74189]:     <video>
Oct 25 21:21:57 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:21:57 user nova-compute[74189]:     </video>
Oct 25 21:21:57 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:21:57 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:21:57 user nova-compute[74189]:     </rng>
Oct 25 21:21:57 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:21:57 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:21:57 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:21:57 user nova-compute[74189]:     </memballoon>
Oct 25 21:21:57 user nova-compute[74189]:   </devices>
Oct 25 21:21:57 user nova-compute[74189]: </domain>
Oct 25 21:21:57 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920835665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-920835665',id=15,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7FZk64RryMLyk++QiCGXXc6F4kczfNZkLF/M8gV7fC8oRD+LglFRr9PqpSbI3FpMuDRig++iLTLZch4e1RR5Oy04z44+nk2RSdOAieaA1OaHo6pDDmUX+imOxyUbWyrg==',key_name='tempest-keypair-2022750063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f78ddc9861f9455aa58a9a532548023a',ramdisk_id='',reservation_id='r-yuvohw46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-994959279',owner_user_name='tempest-TaggedBootDevicesTest_v242-994959279-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:20:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ccd825e31941ce9a876d85b607e02f',uuid=46ffb192-ad11-416e-9094-c8e080b5414e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35311a59-a404-4759-8125-ac222750d5fa", "address": "fa:16:3e:b5:8d:bc", "network": {"id": "477a555b-610a-4b4f-8e0e-efd52c856097", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1102892168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35311a59-a4", "ovs_interfaceid": "35311a59-a404-4759-8125-ac222750d5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converting VIF {"id": "35311a59-a404-4759-8125-ac222750d5fa", "address": "fa:16:3e:b5:8d:bc", "network": {"id": "477a555b-610a-4b4f-8e0e-efd52c856097", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1102892168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35311a59-a4", "ovs_interfaceid": "35311a59-a404-4759-8125-ac222750d5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:8d:bc,bridge_name='br-int',has_traffic_filtering=True,id=35311a59-a404-4759-8125-ac222750d5fa,network=Network(477a555b-610a-4b4f-8e0e-efd52c856097),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35311a59-a4') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG os_vif [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:8d:bc,bridge_name='br-int',has_traffic_filtering=True,id=35311a59-a404-4759-8125-ac222750d5fa,network=Network(477a555b-610a-4b4f-8e0e-efd52c856097),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35311a59-a4') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '51d29899-3d2b-5f13-9d64-9247ead8e106', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35311a59-a4, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap35311a59-a4, col_values=(('qos', UUID('23bdceaf-5bf7-4b4b-99ed-d1a084722749')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap35311a59-a4, col_values=(('external_ids', {'iface-id': '35311a59-a404-4759-8125-ac222750d5fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:8d:bc', 'vm-uuid': '46ffb192-ad11-416e-9094-c8e080b5414e'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: INFO os_vif [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:8d:bc,bridge_name='br-int',has_traffic_filtering=True,id=35311a59-a404-4759-8125-ac222750d5fa,network=Network(477a555b-610a-4b4f-8e0e-efd52c856097),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35311a59-a4')
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920835665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-920835665',id=15,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7FZk64RryMLyk++QiCGXXc6F4kczfNZkLF/M8gV7fC8oRD+LglFRr9PqpSbI3FpMuDRig++iLTLZch4e1RR5Oy04z44+nk2RSdOAieaA1OaHo6pDDmUX+imOxyUbWyrg==',key_name='tempest-keypair-2022750063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f78ddc9861f9455aa58a9a532548023a',ramdisk_id='',reservation_id='r-yuvohw46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-994959279',owner_user_name='tempest-TaggedBootDevicesTest_v242-994959279-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:20:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ccd825e31941ce9a876d85b607e02f',uuid=46ffb192-ad11-416e-9094-c8e080b5414e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "address": "fa:16:3e:b2:20:8d", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1d7d42-01", "ovs_interfaceid": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converting VIF {"id": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "address": "fa:16:3e:b2:20:8d", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1d7d42-01", "ovs_interfaceid": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:20:8d,bridge_name='br-int',has_traffic_filtering=True,id=bf1d7d42-01d4-4d66-814b-00a055fd82a5,network=Network(cabdedc4-8ff4-4fab-9935-925c40f2a8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbf1d7d42-01') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG os_vif [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:20:8d,bridge_name='br-int',has_traffic_filtering=True,id=bf1d7d42-01d4-4d66-814b-00a055fd82a5,network=Network(cabdedc4-8ff4-4fab-9935-925c40f2a8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbf1d7d42-01') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '87eef489-bd3a-5cba-a934-caf108d0c63a', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf1d7d42-01, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf1d7d42-01, col_values=(('qos', UUID('69941af7-64ee-42a1-85a7-618b45c13fe2')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf1d7d42-01, col_values=(('external_ids', {'iface-id': 'bf1d7d42-01d4-4d66-814b-00a055fd82a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:20:8d', 'vm-uuid': '46ffb192-ad11-416e-9094-c8e080b5414e'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: INFO os_vif [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:20:8d,bridge_name='br-int',has_traffic_filtering=True,id=bf1d7d42-01d4-4d66-814b-00a055fd82a5,network=Network(cabdedc4-8ff4-4fab-9935-925c40f2a8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbf1d7d42-01')
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920835665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-920835665',id=15,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7FZk64RryMLyk++QiCGXXc6F4kczfNZkLF/M8gV7fC8oRD+LglFRr9PqpSbI3FpMuDRig++iLTLZch4e1RR5Oy04z44+nk2RSdOAieaA1OaHo6pDDmUX+imOxyUbWyrg==',key_name='tempest-keypair-2022750063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f78ddc9861f9455aa58a9a532548023a',ramdisk_id='',reservation_id='r-yuvohw46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-994959279',owner_user_name='tempest-TaggedBootDevicesTest_v242-994959279-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:20:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ccd825e31941ce9a876d85b607e02f',uuid=46ffb192-ad11-416e-9094-c8e080b5414e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f967dd2c-da19-4645-b52e-2d79f61baabe", "address": "fa:16:3e:d1:88:5b", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf967dd2c-da", "ovs_interfaceid": "f967dd2c-da19-4645-b52e-2d79f61baabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converting VIF {"id": "f967dd2c-da19-4645-b52e-2d79f61baabe", "address": "fa:16:3e:d1:88:5b", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf967dd2c-da", "ovs_interfaceid": "f967dd2c-da19-4645-b52e-2d79f61baabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:88:5b,bridge_name='br-int',has_traffic_filtering=True,id=f967dd2c-da19-4645-b52e-2d79f61baabe,network=Network(cabdedc4-8ff4-4fab-9935-925c40f2a8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf967dd2c-da') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG os_vif [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:88:5b,bridge_name='br-int',has_traffic_filtering=True,id=f967dd2c-da19-4645-b52e-2d79f61baabe,network=Network(cabdedc4-8ff4-4fab-9935-925c40f2a8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf967dd2c-da') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d53a518-d32d-552d-bc8e-70657ac7d6e6', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf967dd2c-da, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf967dd2c-da, col_values=(('qos', UUID('cb818b4a-72f5-4944-a22c-c2343470b281')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf967dd2c-da, col_values=(('external_ids', {'iface-id': 'f967dd2c-da19-4645-b52e-2d79f61baabe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:88:5b', 'vm-uuid': '46ffb192-ad11-416e-9094-c8e080b5414e'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: INFO os_vif [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:88:5b,bridge_name='br-int',has_traffic_filtering=True,id=f967dd2c-da19-4645-b52e-2d79f61baabe,network=Network(cabdedc4-8ff4-4fab-9935-925c40f2a8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf967dd2c-da')
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920835665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-920835665',id=15,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7FZk64RryMLyk++QiCGXXc6F4kczfNZkLF/M8gV7fC8oRD+LglFRr9PqpSbI3FpMuDRig++iLTLZch4e1RR5Oy04z44+nk2RSdOAieaA1OaHo6pDDmUX+imOxyUbWyrg==',key_name='tempest-keypair-2022750063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f78ddc9861f9455aa58a9a532548023a',ramdisk_id='',reservation_id='r-yuvohw46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-994959279',owner_user_name='tempest-TaggedBootDevicesTest_v242-994959279-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:20:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ccd825e31941ce9a876d85b607e02f',uuid=46ffb192-ad11-416e-9094-c8e080b5414e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f18e575-80eb-41e8-8615-bcbbe00ff9de", "address": "fa:16:3e:c2:d7:0b", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f18e575-80", "ovs_interfaceid": "5f18e575-80eb-41e8-8615-bcbbe00ff9de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converting VIF {"id": "5f18e575-80eb-41e8-8615-bcbbe00ff9de", "address": "fa:16:3e:c2:d7:0b", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f18e575-80", "ovs_interfaceid": "5f18e575-80eb-41e8-8615-bcbbe00ff9de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:d7:0b,bridge_name='br-int',has_traffic_filtering=True,id=5f18e575-80eb-41e8-8615-bcbbe00ff9de,network=Network(cabdedc4-8ff4-4fab-9935-925c40f2a8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f18e575-80') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG os_vif [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:d7:0b,bridge_name='br-int',has_traffic_filtering=True,id=5f18e575-80eb-41e8-8615-bcbbe00ff9de,network=Network(cabdedc4-8ff4-4fab-9935-925c40f2a8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f18e575-80') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0d706032-31b5-50e0-8164-df741afd2fb2', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f18e575-80, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f18e575-80, col_values=(('qos', UUID('7feb899a-1f14-4344-8b75-8cf4bad02a5f')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f18e575-80, col_values=(('external_ids', {'iface-id': '5f18e575-80eb-41e8-8615-bcbbe00ff9de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:d7:0b', 'vm-uuid': '46ffb192-ad11-416e-9094-c8e080b5414e'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: INFO os_vif [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:d7:0b,bridge_name='br-int',has_traffic_filtering=True,id=5f18e575-80eb-41e8-8615-bcbbe00ff9de,network=Network(cabdedc4-8ff4-4fab-9935-925c40f2a8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f18e575-80')
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920835665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-920835665',id=15,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7FZk64RryMLyk++QiCGXXc6F4kczfNZkLF/M8gV7fC8oRD+LglFRr9PqpSbI3FpMuDRig++iLTLZch4e1RR5Oy04z44+nk2RSdOAieaA1OaHo6pDDmUX+imOxyUbWyrg==',key_name='tempest-keypair-2022750063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f78ddc9861f9455aa58a9a532548023a',ramdisk_id='',reservation_id='r-yuvohw46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-994959279',owner_user_name='tempest-TaggedBootDevicesTest_v242-994959279-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:20:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ccd825e31941ce9a876d85b607e02f',uuid=46ffb192-ad11-416e-9094-c8e080b5414e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4caa88c4-c581-41eb-b8f8-a291aaef3ad4", "address": "fa:16:3e:24:e8:88", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4caa88c4-c5", "ovs_interfaceid": "4caa88c4-c581-41eb-b8f8-a291aaef3ad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converting VIF {"id": "4caa88c4-c581-41eb-b8f8-a291aaef3ad4", "address": "fa:16:3e:24:e8:88", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4caa88c4-c5", "ovs_interfaceid": "4caa88c4-c581-41eb-b8f8-a291aaef3ad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:e8:88,bridge_name='br-int',has_traffic_filtering=True,id=4caa88c4-c581-41eb-b8f8-a291aaef3ad4,network=Network(cabdedc4-8ff4-4fab-9935-925c40f2a8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4caa88c4-c5') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG os_vif [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:e8:88,bridge_name='br-int',has_traffic_filtering=True,id=4caa88c4-c581-41eb-b8f8-a291aaef3ad4,network=Network(cabdedc4-8ff4-4fab-9935-925c40f2a8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4caa88c4-c5') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9516aa3b-7269-57d5-a61e-3a6ffe66d0ed', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4caa88c4-c5, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4caa88c4-c5, col_values=(('qos', UUID('f711d2f2-4968-48aa-917e-8221d6d5f88c')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4caa88c4-c5, col_values=(('external_ids', {'iface-id': '4caa88c4-c581-41eb-b8f8-a291aaef3ad4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:e8:88', 'vm-uuid': '46ffb192-ad11-416e-9094-c8e080b5414e'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:58 user nova-compute[74189]: INFO os_vif [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:e8:88,bridge_name='br-int',has_traffic_filtering=True,id=4caa88c4-c581-41eb-b8f8-a291aaef3ad4,network=Network(cabdedc4-8ff4-4fab-9935-925c40f2a8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4caa88c4-c5')
Oct 25 21:21:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920835665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-920835665',id=15,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7FZk64RryMLyk++QiCGXXc6F4kczfNZkLF/M8gV7fC8oRD+LglFRr9PqpSbI3FpMuDRig++iLTLZch4e1RR5Oy04z44+nk2RSdOAieaA1OaHo6pDDmUX+imOxyUbWyrg==',key_name='tempest-keypair-2022750063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f78ddc9861f9455aa58a9a532548023a',ramdisk_id='',reservation_id='r-yuvohw46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-994959279',owner_user_name='tempest-TaggedBootDevicesTest_v242-994959279-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:20:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ccd825e31941ce9a876d85b607e02f',uuid=46ffb192-ad11-416e-9094-c8e080b5414e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b60a817a-3478-48d7-b117-bee088bc7e86", "address": "fa:16:3e:0f:4d:3e", "network": {"id": "68ea97b8-852c-464a-9ccb-b2dc55c63e47", "bridge": "br-int", "label": "tempest-device-tagging-net2-670429054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60a817a-34", "ovs_interfaceid": "b60a817a-3478-48d7-b117-bee088bc7e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converting VIF {"id": "b60a817a-3478-48d7-b117-bee088bc7e86", "address": "fa:16:3e:0f:4d:3e", "network": {"id": "68ea97b8-852c-464a-9ccb-b2dc55c63e47", "bridge": "br-int", "label": "tempest-device-tagging-net2-670429054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60a817a-34", "ovs_interfaceid": "b60a817a-3478-48d7-b117-bee088bc7e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:4d:3e,bridge_name='br-int',has_traffic_filtering=True,id=b60a817a-3478-48d7-b117-bee088bc7e86,network=Network(68ea97b8-852c-464a-9ccb-b2dc55c63e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb60a817a-34') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG os_vif [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:4d:3e,bridge_name='br-int',has_traffic_filtering=True,id=b60a817a-3478-48d7-b117-bee088bc7e86,network=Network(68ea97b8-852c-464a-9ccb-b2dc55c63e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb60a817a-34') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2be32417-537e-5a7a-9769-6adda7ef631c', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb60a817a-34, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb60a817a-34, col_values=(('qos', UUID('3cf5594c-48a3-4734-b325-e486bf23fdd3')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb60a817a-34, col_values=(('external_ids', {'iface-id': 'b60a817a-3478-48d7-b117-bee088bc7e86', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:4d:3e', 'vm-uuid': '46ffb192-ad11-416e-9094-c8e080b5414e'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:58 user nova-compute[74189]: INFO os_vif [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:4d:3e,bridge_name='br-int',has_traffic_filtering=True,id=b60a817a-3478-48d7-b117-bee088bc7e86,network=Network(68ea97b8-852c-464a-9ccb-b2dc55c63e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb60a817a-34')
Oct 25 21:21:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920835665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-920835665',id=15,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7FZk64RryMLyk++QiCGXXc6F4kczfNZkLF/M8gV7fC8oRD+LglFRr9PqpSbI3FpMuDRig++iLTLZch4e1RR5Oy04z44+nk2RSdOAieaA1OaHo6pDDmUX+imOxyUbWyrg==',key_name='tempest-keypair-2022750063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f78ddc9861f9455aa58a9a532548023a',ramdisk_id='',reservation_id='r-yuvohw46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-994959279',owner_user_name='tempest-TaggedBootDevicesTest_v242-994959279-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:20:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ccd825e31941ce9a876d85b607e02f',uuid=46ffb192-ad11-416e-9094-c8e080b5414e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56", "address": "fa:16:3e:b0:f9:54", "network": {"id": "68ea97b8-852c-464a-9ccb-b2dc55c63e47", "bridge": "br-int", "label": "tempest-device-tagging-net2-670429054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e0f5a2-44", "ovs_interfaceid": "94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converting VIF {"id": "94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56", "address": "fa:16:3e:b0:f9:54", "network": {"id": "68ea97b8-852c-464a-9ccb-b2dc55c63e47", "bridge": "br-int", "label": "tempest-device-tagging-net2-670429054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e0f5a2-44", "ovs_interfaceid": "94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f9:54,bridge_name='br-int',has_traffic_filtering=True,id=94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56,network=Network(68ea97b8-852c-464a-9ccb-b2dc55c63e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94e0f5a2-44') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG os_vif [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f9:54,bridge_name='br-int',has_traffic_filtering=True,id=94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56,network=Network(68ea97b8-852c-464a-9ccb-b2dc55c63e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94e0f5a2-44') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dc778368-bc8c-5449-873b-7604140bb77f', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94e0f5a2-44, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap94e0f5a2-44, col_values=(('qos', UUID('45a10a11-4abd-47df-a6a0-6c8d37c1cdc9')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap94e0f5a2-44, col_values=(('external_ids', {'iface-id': '94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:f9:54', 'vm-uuid': '46ffb192-ad11-416e-9094-c8e080b5414e'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:21:58 user nova-compute[74189]: INFO os_vif [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f9:54,bridge_name='br-int',has_traffic_filtering=True,id=94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56,network=Network(68ea97b8-852c-464a-9ccb-b2dc55c63e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94e0f5a2-44')
Oct 25 21:21:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] No BDM found with device name hda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] No VIF found with MAC fa:16:3e:b5:8d:bc, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] No VIF found with MAC fa:16:3e:24:e8:88, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:21:58 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Using config drive
Oct 25 21:21:58 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Creating config drive at /opt/stack/data/nova/instances/46ffb192-ad11-416e-9094-c8e080b5414e/disk.config
Oct 25 21:21:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/46ffb192-ad11-416e-9094-c8e080b5414e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpj4x8f7ul {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:21:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/46ffb192-ad11-416e-9094-c8e080b5414e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpj4x8f7ul" returned: 0 in 0.056s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:21:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-0bf04b92-ef60-4193-ae42-d2f53ab1be6d req-8da3fb7c-9662-48df-a75b-462ca9f80d20 service nova] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Received event network-vif-plugged-8eb6e9e2-60c6-463d-8525-b768933a94df {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:21:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0bf04b92-ef60-4193-ae42-d2f53ab1be6d req-8da3fb7c-9662-48df-a75b-462ca9f80d20 service nova] Acquiring lock "932fe8ac-fdde-45c6-aa32-9bf866f19a4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0bf04b92-ef60-4193-ae42-d2f53ab1be6d req-8da3fb7c-9662-48df-a75b-462ca9f80d20 service nova] Lock "932fe8ac-fdde-45c6-aa32-9bf866f19a4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0bf04b92-ef60-4193-ae42-d2f53ab1be6d req-8da3fb7c-9662-48df-a75b-462ca9f80d20 service nova] Lock "932fe8ac-fdde-45c6-aa32-9bf866f19a4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-0bf04b92-ef60-4193-ae42-d2f53ab1be6d req-8da3fb7c-9662-48df-a75b-462ca9f80d20 service nova] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] No waiting events found dispatching network-vif-plugged-8eb6e9e2-60c6-463d-8525-b768933a94df {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:21:59 user nova-compute[74189]: WARNING nova.compute.manager [req-0bf04b92-ef60-4193-ae42-d2f53ab1be6d req-8da3fb7c-9662-48df-a75b-462ca9f80d20 service nova] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Received unexpected event network-vif-plugged-8eb6e9e2-60c6-463d-8525-b768933a94df for instance with vm_state building and task_state spawning.
Oct 25 21:21:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-61f002e4-7300-4146-b63c-160dbf67b921 req-4e28ecd7-975d-43c4-b507-7067e8b0bbb8 service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Received event network-vif-plugged-c6a0280f-def7-4677-910c-7a3a3c6b57df {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:21:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-61f002e4-7300-4146-b63c-160dbf67b921 req-4e28ecd7-975d-43c4-b507-7067e8b0bbb8 service nova] Acquiring lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:21:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-61f002e4-7300-4146-b63c-160dbf67b921 req-4e28ecd7-975d-43c4-b507-7067e8b0bbb8 service nova] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:21:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-61f002e4-7300-4146-b63c-160dbf67b921 req-4e28ecd7-975d-43c4-b507-7067e8b0bbb8 service nova] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:21:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-61f002e4-7300-4146-b63c-160dbf67b921 req-4e28ecd7-975d-43c4-b507-7067e8b0bbb8 service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] No waiting events found dispatching network-vif-plugged-c6a0280f-def7-4677-910c-7a3a3c6b57df {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:21:59 user nova-compute[74189]: WARNING nova.compute.manager [req-61f002e4-7300-4146-b63c-160dbf67b921 req-4e28ecd7-975d-43c4-b507-7067e8b0bbb8 service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Received unexpected event network-vif-plugged-c6a0280f-def7-4677-910c-7a3a3c6b57df for instance with vm_state resized and task_state resize_reverting.
Oct 25 21:21:59 user nova-compute[74189]: DEBUG nova.compute.manager [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:21:59 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:21:59 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:22:00 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Instance running successfully.
Oct 25 21:22:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] finish_revert_migration finished successfully. {{(pid=74189) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Oct 25 21:22:00 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Instance spawned successfully.
Oct 25 21:22:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:22:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:22:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:22:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:22:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:22:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:22:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:22:00 user nova-compute[74189]: INFO nova.compute.manager [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Took 7.65 seconds to spawn the instance on the hypervisor.
Oct 25 21:22:00 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:22:00 user nova-compute[74189]: INFO nova.compute.manager [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Took 8.66 seconds to build instance.
Oct 25 21:22:00 user nova-compute[74189]: INFO nova.compute.manager [None req-19dfadd9-e1f2-4843-b268-516f3f6058df tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Updating instance to original state: 'active'
Oct 25 21:22:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a748259c-2f96-440f-9bad-b0ccfb55eb28 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "932fe8ac-fdde-45c6-aa32-9bf866f19a4e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.792s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "932fe8ac-fdde-45c6-aa32-9bf866f19a4e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 8.294s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "932fe8ac-fdde-45c6-aa32-9bf866f19a4e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:00 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:22:00 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:22:00 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:22:00 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Rebuilding the list of instances to heal {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 21:22:00 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Skipping network cache update for instance because it is Building. {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-d7c3a99a-ab38-4e88-896d-94ae51a09a48" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-d7c3a99a-ab38-4e88-896d-94ae51a09a48" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lazy-loading 'info_cache' on Instance uuid d7c3a99a-ab38-4e88-896d-94ae51a09a48 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG nova.compute.manager [req-3d022a8f-7f9a-4454-b4f2-40fb96d96d8a req-e56d3a5c-fc57-4a27-9e31-ae3bc5bf848e service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-plugged-f967dd2c-da19-4645-b52e-2d79f61baabe {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3d022a8f-7f9a-4454-b4f2-40fb96d96d8a req-e56d3a5c-fc57-4a27-9e31-ae3bc5bf848e service nova] Acquiring lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3d022a8f-7f9a-4454-b4f2-40fb96d96d8a req-e56d3a5c-fc57-4a27-9e31-ae3bc5bf848e service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3d022a8f-7f9a-4454-b4f2-40fb96d96d8a req-e56d3a5c-fc57-4a27-9e31-ae3bc5bf848e service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG nova.compute.manager [req-3d022a8f-7f9a-4454-b4f2-40fb96d96d8a req-e56d3a5c-fc57-4a27-9e31-ae3bc5bf848e service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] No waiting events found dispatching network-vif-plugged-f967dd2c-da19-4645-b52e-2d79f61baabe {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:22:01 user nova-compute[74189]: WARNING nova.compute.manager [req-3d022a8f-7f9a-4454-b4f2-40fb96d96d8a req-e56d3a5c-fc57-4a27-9e31-ae3bc5bf848e service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received unexpected event network-vif-plugged-f967dd2c-da19-4645-b52e-2d79f61baabe for instance with vm_state building and task_state spawning.
Oct 25 21:22:01 user nova-compute[74189]: DEBUG nova.compute.manager [req-2d2da7c1-6f68-410e-974b-15658857c7d7 req-af19270d-1e11-40ba-8bf8-93e61d1f61a0 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-plugged-bf1d7d42-01d4-4d66-814b-00a055fd82a5 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2d2da7c1-6f68-410e-974b-15658857c7d7 req-af19270d-1e11-40ba-8bf8-93e61d1f61a0 service nova] Acquiring lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2d2da7c1-6f68-410e-974b-15658857c7d7 req-af19270d-1e11-40ba-8bf8-93e61d1f61a0 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2d2da7c1-6f68-410e-974b-15658857c7d7 req-af19270d-1e11-40ba-8bf8-93e61d1f61a0 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG nova.compute.manager [req-2d2da7c1-6f68-410e-974b-15658857c7d7 req-af19270d-1e11-40ba-8bf8-93e61d1f61a0 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] No waiting events found dispatching network-vif-plugged-bf1d7d42-01d4-4d66-814b-00a055fd82a5 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:22:01 user nova-compute[74189]: WARNING nova.compute.manager [req-2d2da7c1-6f68-410e-974b-15658857c7d7 req-af19270d-1e11-40ba-8bf8-93e61d1f61a0 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received unexpected event network-vif-plugged-bf1d7d42-01d4-4d66-814b-00a055fd82a5 for instance with vm_state building and task_state spawning.
Oct 25 21:22:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG nova.compute.manager [req-9717c2c6-fd53-46ae-b5eb-93a5788785f8 req-21a80e8f-9e8f-4e6a-9198-e24df57ac89e service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-plugged-35311a59-a404-4759-8125-ac222750d5fa {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9717c2c6-fd53-46ae-b5eb-93a5788785f8 req-21a80e8f-9e8f-4e6a-9198-e24df57ac89e service nova] Acquiring lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9717c2c6-fd53-46ae-b5eb-93a5788785f8 req-21a80e8f-9e8f-4e6a-9198-e24df57ac89e service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9717c2c6-fd53-46ae-b5eb-93a5788785f8 req-21a80e8f-9e8f-4e6a-9198-e24df57ac89e service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG nova.compute.manager [req-9717c2c6-fd53-46ae-b5eb-93a5788785f8 req-21a80e8f-9e8f-4e6a-9198-e24df57ac89e service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] No waiting events found dispatching network-vif-plugged-35311a59-a404-4759-8125-ac222750d5fa {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:22:01 user nova-compute[74189]: WARNING nova.compute.manager [req-9717c2c6-fd53-46ae-b5eb-93a5788785f8 req-21a80e8f-9e8f-4e6a-9198-e24df57ac89e service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received unexpected event network-vif-plugged-35311a59-a404-4759-8125-ac222750d5fa for instance with vm_state building and task_state spawning.
Oct 25 21:22:01 user nova-compute[74189]: DEBUG nova.compute.manager [req-9717c2c6-fd53-46ae-b5eb-93a5788785f8 req-21a80e8f-9e8f-4e6a-9198-e24df57ac89e service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-plugged-35311a59-a404-4759-8125-ac222750d5fa {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9717c2c6-fd53-46ae-b5eb-93a5788785f8 req-21a80e8f-9e8f-4e6a-9198-e24df57ac89e service nova] Acquiring lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9717c2c6-fd53-46ae-b5eb-93a5788785f8 req-21a80e8f-9e8f-4e6a-9198-e24df57ac89e service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9717c2c6-fd53-46ae-b5eb-93a5788785f8 req-21a80e8f-9e8f-4e6a-9198-e24df57ac89e service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG nova.compute.manager [req-9717c2c6-fd53-46ae-b5eb-93a5788785f8 req-21a80e8f-9e8f-4e6a-9198-e24df57ac89e service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] No waiting events found dispatching network-vif-plugged-35311a59-a404-4759-8125-ac222750d5fa {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:22:01 user nova-compute[74189]: WARNING nova.compute.manager [req-9717c2c6-fd53-46ae-b5eb-93a5788785f8 req-21a80e8f-9e8f-4e6a-9198-e24df57ac89e service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received unexpected event network-vif-plugged-35311a59-a404-4759-8125-ac222750d5fa for instance with vm_state building and task_state spawning.
Oct 25 21:22:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Updating instance_info_cache with network_info: [{"id": "44169902-69da-4fe1-8292-a23e0ff15fc7", "address": "fa:16:3e:b9:37:c6", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44169902-69", "ovs_interfaceid": "44169902-69da-4fe1-8292-a23e0ff15fc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-d7c3a99a-ab38-4e88-896d-94ae51a09a48" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:01 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:22:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-8f027885-7f11-4bba-8c2b-31014468964a req-19705f3a-f604-4aaf-84b6-23ab819619fe service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-plugged-f967dd2c-da19-4645-b52e-2d79f61baabe {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8f027885-7f11-4bba-8c2b-31014468964a req-19705f3a-f604-4aaf-84b6-23ab819619fe service nova] Acquiring lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8f027885-7f11-4bba-8c2b-31014468964a req-19705f3a-f604-4aaf-84b6-23ab819619fe service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8f027885-7f11-4bba-8c2b-31014468964a req-19705f3a-f604-4aaf-84b6-23ab819619fe service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-8f027885-7f11-4bba-8c2b-31014468964a req-19705f3a-f604-4aaf-84b6-23ab819619fe service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] No waiting events found dispatching network-vif-plugged-f967dd2c-da19-4645-b52e-2d79f61baabe {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:22:03 user nova-compute[74189]: WARNING nova.compute.manager [req-8f027885-7f11-4bba-8c2b-31014468964a req-19705f3a-f604-4aaf-84b6-23ab819619fe service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received unexpected event network-vif-plugged-f967dd2c-da19-4645-b52e-2d79f61baabe for instance with vm_state building and task_state spawning.
Oct 25 21:22:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-8f027885-7f11-4bba-8c2b-31014468964a req-19705f3a-f604-4aaf-84b6-23ab819619fe service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-plugged-5f18e575-80eb-41e8-8615-bcbbe00ff9de {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8f027885-7f11-4bba-8c2b-31014468964a req-19705f3a-f604-4aaf-84b6-23ab819619fe service nova] Acquiring lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8f027885-7f11-4bba-8c2b-31014468964a req-19705f3a-f604-4aaf-84b6-23ab819619fe service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8f027885-7f11-4bba-8c2b-31014468964a req-19705f3a-f604-4aaf-84b6-23ab819619fe service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-8f027885-7f11-4bba-8c2b-31014468964a req-19705f3a-f604-4aaf-84b6-23ab819619fe service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] No waiting events found dispatching network-vif-plugged-5f18e575-80eb-41e8-8615-bcbbe00ff9de {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:22:03 user nova-compute[74189]: WARNING nova.compute.manager [req-8f027885-7f11-4bba-8c2b-31014468964a req-19705f3a-f604-4aaf-84b6-23ab819619fe service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received unexpected event network-vif-plugged-5f18e575-80eb-41e8-8615-bcbbe00ff9de for instance with vm_state building and task_state spawning.
Oct 25 21:22:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-8f027885-7f11-4bba-8c2b-31014468964a req-19705f3a-f604-4aaf-84b6-23ab819619fe service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-plugged-5f18e575-80eb-41e8-8615-bcbbe00ff9de {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8f027885-7f11-4bba-8c2b-31014468964a req-19705f3a-f604-4aaf-84b6-23ab819619fe service nova] Acquiring lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8f027885-7f11-4bba-8c2b-31014468964a req-19705f3a-f604-4aaf-84b6-23ab819619fe service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8f027885-7f11-4bba-8c2b-31014468964a req-19705f3a-f604-4aaf-84b6-23ab819619fe service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-8f027885-7f11-4bba-8c2b-31014468964a req-19705f3a-f604-4aaf-84b6-23ab819619fe service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] No waiting events found dispatching network-vif-plugged-5f18e575-80eb-41e8-8615-bcbbe00ff9de {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:22:03 user nova-compute[74189]: WARNING nova.compute.manager [req-8f027885-7f11-4bba-8c2b-31014468964a req-19705f3a-f604-4aaf-84b6-23ab819619fe service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received unexpected event network-vif-plugged-5f18e575-80eb-41e8-8615-bcbbe00ff9de for instance with vm_state building and task_state spawning.
Oct 25 21:22:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-8f027885-7f11-4bba-8c2b-31014468964a req-19705f3a-f604-4aaf-84b6-23ab819619fe service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-plugged-94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8f027885-7f11-4bba-8c2b-31014468964a req-19705f3a-f604-4aaf-84b6-23ab819619fe service nova] Acquiring lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8f027885-7f11-4bba-8c2b-31014468964a req-19705f3a-f604-4aaf-84b6-23ab819619fe service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8f027885-7f11-4bba-8c2b-31014468964a req-19705f3a-f604-4aaf-84b6-23ab819619fe service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-8f027885-7f11-4bba-8c2b-31014468964a req-19705f3a-f604-4aaf-84b6-23ab819619fe service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] No waiting events found dispatching network-vif-plugged-94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:22:03 user nova-compute[74189]: WARNING nova.compute.manager [req-8f027885-7f11-4bba-8c2b-31014468964a req-19705f3a-f604-4aaf-84b6-23ab819619fe service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received unexpected event network-vif-plugged-94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56 for instance with vm_state building and task_state spawning.
Oct 25 21:22:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-8f027885-7f11-4bba-8c2b-31014468964a req-19705f3a-f604-4aaf-84b6-23ab819619fe service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-plugged-94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8f027885-7f11-4bba-8c2b-31014468964a req-19705f3a-f604-4aaf-84b6-23ab819619fe service nova] Acquiring lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8f027885-7f11-4bba-8c2b-31014468964a req-19705f3a-f604-4aaf-84b6-23ab819619fe service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8f027885-7f11-4bba-8c2b-31014468964a req-19705f3a-f604-4aaf-84b6-23ab819619fe service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-8f027885-7f11-4bba-8c2b-31014468964a req-19705f3a-f604-4aaf-84b6-23ab819619fe service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] No waiting events found dispatching network-vif-plugged-94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:22:03 user nova-compute[74189]: WARNING nova.compute.manager [req-8f027885-7f11-4bba-8c2b-31014468964a req-19705f3a-f604-4aaf-84b6-23ab819619fe service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received unexpected event network-vif-plugged-94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56 for instance with vm_state building and task_state spawning.
Oct 25 21:22:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-21a1a2b9-9765-4220-a7f1-44666b08403f req-eb0dc9dc-3238-4500-aeae-92a12335141e service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-plugged-bf1d7d42-01d4-4d66-814b-00a055fd82a5 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-21a1a2b9-9765-4220-a7f1-44666b08403f req-eb0dc9dc-3238-4500-aeae-92a12335141e service nova] Acquiring lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-21a1a2b9-9765-4220-a7f1-44666b08403f req-eb0dc9dc-3238-4500-aeae-92a12335141e service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-21a1a2b9-9765-4220-a7f1-44666b08403f req-eb0dc9dc-3238-4500-aeae-92a12335141e service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-21a1a2b9-9765-4220-a7f1-44666b08403f req-eb0dc9dc-3238-4500-aeae-92a12335141e service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] No waiting events found dispatching network-vif-plugged-bf1d7d42-01d4-4d66-814b-00a055fd82a5 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:22:03 user nova-compute[74189]: WARNING nova.compute.manager [req-21a1a2b9-9765-4220-a7f1-44666b08403f req-eb0dc9dc-3238-4500-aeae-92a12335141e service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received unexpected event network-vif-plugged-bf1d7d42-01d4-4d66-814b-00a055fd82a5 for instance with vm_state building and task_state spawning.
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-8846249c-76f5-4ef2-b52e-82ec2111d3d3 req-3f181b22-8817-44cc-8179-7e1d2b6c8124 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-plugged-4caa88c4-c581-41eb-b8f8-a291aaef3ad4 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8846249c-76f5-4ef2-b52e-82ec2111d3d3 req-3f181b22-8817-44cc-8179-7e1d2b6c8124 service nova] Acquiring lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8846249c-76f5-4ef2-b52e-82ec2111d3d3 req-3f181b22-8817-44cc-8179-7e1d2b6c8124 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8846249c-76f5-4ef2-b52e-82ec2111d3d3 req-3f181b22-8817-44cc-8179-7e1d2b6c8124 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-8846249c-76f5-4ef2-b52e-82ec2111d3d3 req-3f181b22-8817-44cc-8179-7e1d2b6c8124 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] No waiting events found dispatching network-vif-plugged-4caa88c4-c581-41eb-b8f8-a291aaef3ad4 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:22:03 user nova-compute[74189]: WARNING nova.compute.manager [req-8846249c-76f5-4ef2-b52e-82ec2111d3d3 req-3f181b22-8817-44cc-8179-7e1d2b6c8124 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received unexpected event network-vif-plugged-4caa88c4-c581-41eb-b8f8-a291aaef3ad4 for instance with vm_state building and task_state spawning.
Oct 25 21:22:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-8846249c-76f5-4ef2-b52e-82ec2111d3d3 req-3f181b22-8817-44cc-8179-7e1d2b6c8124 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-plugged-4caa88c4-c581-41eb-b8f8-a291aaef3ad4 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8846249c-76f5-4ef2-b52e-82ec2111d3d3 req-3f181b22-8817-44cc-8179-7e1d2b6c8124 service nova] Acquiring lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8846249c-76f5-4ef2-b52e-82ec2111d3d3 req-3f181b22-8817-44cc-8179-7e1d2b6c8124 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8846249c-76f5-4ef2-b52e-82ec2111d3d3 req-3f181b22-8817-44cc-8179-7e1d2b6c8124 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-8846249c-76f5-4ef2-b52e-82ec2111d3d3 req-3f181b22-8817-44cc-8179-7e1d2b6c8124 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] No waiting events found dispatching network-vif-plugged-4caa88c4-c581-41eb-b8f8-a291aaef3ad4 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:22:03 user nova-compute[74189]: WARNING nova.compute.manager [req-8846249c-76f5-4ef2-b52e-82ec2111d3d3 req-3f181b22-8817-44cc-8179-7e1d2b6c8124 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received unexpected event network-vif-plugged-4caa88c4-c581-41eb-b8f8-a291aaef3ad4 for instance with vm_state building and task_state spawning.
Oct 25 21:22:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-8846249c-76f5-4ef2-b52e-82ec2111d3d3 req-3f181b22-8817-44cc-8179-7e1d2b6c8124 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-plugged-b60a817a-3478-48d7-b117-bee088bc7e86 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8846249c-76f5-4ef2-b52e-82ec2111d3d3 req-3f181b22-8817-44cc-8179-7e1d2b6c8124 service nova] Acquiring lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8846249c-76f5-4ef2-b52e-82ec2111d3d3 req-3f181b22-8817-44cc-8179-7e1d2b6c8124 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8846249c-76f5-4ef2-b52e-82ec2111d3d3 req-3f181b22-8817-44cc-8179-7e1d2b6c8124 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-8846249c-76f5-4ef2-b52e-82ec2111d3d3 req-3f181b22-8817-44cc-8179-7e1d2b6c8124 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] No waiting events found dispatching network-vif-plugged-b60a817a-3478-48d7-b117-bee088bc7e86 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:22:03 user nova-compute[74189]: WARNING nova.compute.manager [req-8846249c-76f5-4ef2-b52e-82ec2111d3d3 req-3f181b22-8817-44cc-8179-7e1d2b6c8124 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received unexpected event network-vif-plugged-b60a817a-3478-48d7-b117-bee088bc7e86 for instance with vm_state building and task_state spawning.
Oct 25 21:22:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-8846249c-76f5-4ef2-b52e-82ec2111d3d3 req-3f181b22-8817-44cc-8179-7e1d2b6c8124 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-plugged-b60a817a-3478-48d7-b117-bee088bc7e86 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8846249c-76f5-4ef2-b52e-82ec2111d3d3 req-3f181b22-8817-44cc-8179-7e1d2b6c8124 service nova] Acquiring lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8846249c-76f5-4ef2-b52e-82ec2111d3d3 req-3f181b22-8817-44cc-8179-7e1d2b6c8124 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8846249c-76f5-4ef2-b52e-82ec2111d3d3 req-3f181b22-8817-44cc-8179-7e1d2b6c8124 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-8846249c-76f5-4ef2-b52e-82ec2111d3d3 req-3f181b22-8817-44cc-8179-7e1d2b6c8124 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] No waiting events found dispatching network-vif-plugged-b60a817a-3478-48d7-b117-bee088bc7e86 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:22:03 user nova-compute[74189]: WARNING nova.compute.manager [req-8846249c-76f5-4ef2-b52e-82ec2111d3d3 req-3f181b22-8817-44cc-8179-7e1d2b6c8124 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received unexpected event network-vif-plugged-b60a817a-3478-48d7-b117-bee088bc7e86 for instance with vm_state building and task_state spawning.
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:22:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:22:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:22:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:22:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:22:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:22:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:22:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:22:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:22:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:22:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:22:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:22:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:22:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:22:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af1d7b3c-9950-4b74-8f15-b31011ccfa24/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:22:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af1d7b3c-9950-4b74-8f15-b31011ccfa24/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:22:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af1d7b3c-9950-4b74-8f15-b31011ccfa24/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:22:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af1d7b3c-9950-4b74-8f15-b31011ccfa24/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:22:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:22:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:22:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:22:05 user nova-compute[74189]: DEBUG nova.compute.manager [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:22:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:22:05 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Instance spawned successfully.
Oct 25 21:22:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:22:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:22:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:22:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:22:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:22:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:22:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:22:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:22:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:22:06 user nova-compute[74189]: INFO nova.compute.manager [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Took 14.20 seconds to spawn the instance on the hypervisor.
Oct 25 21:22:06 user nova-compute[74189]: DEBUG nova.compute.manager [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:22:06 user nova-compute[74189]: INFO nova.compute.manager [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Took 83.84 seconds to build instance.
Oct 25 21:22:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b1751e8d-80b1-481d-bb3c-352868b349ed tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Lock "46ffb192-ad11-416e-9094-c8e080b5414e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 83.961s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "46ffb192-ad11-416e-9094-c8e080b5414e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 14.210s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:06 user nova-compute[74189]: INFO nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] During sync_power_state the instance has a pending task (spawning). Skip.
Oct 25 21:22:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "46ffb192-ad11-416e-9094-c8e080b5414e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:22:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:22:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:22:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/680e134e-5e0d-464f-9e30-460010348795/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:22:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/680e134e-5e0d-464f-9e30-460010348795/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:22:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/680e134e-5e0d-464f-9e30-460010348795/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:22:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/680e134e-5e0d-464f-9e30-460010348795/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:22:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:07 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:22:07 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:22:07 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=7869MB free_disk=25.399417877197266GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:22:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:22:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:07 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance d7c3a99a-ab38-4e88-896d-94ae51a09a48 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:22:07 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance c69c0800-7a6c-4155-9f90-bbcd323276d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:22:07 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance af1d7b3c-9950-4b74-8f15-b31011ccfa24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:22:07 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:22:07 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 46ffb192-ad11-416e-9094-c8e080b5414e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:22:07 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 680e134e-5e0d-464f-9e30-460010348795 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:22:07 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance de6b6789-b328-4c3b-8d24-07774d5dbe6d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:22:07 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 932fe8ac-fdde-45c6-aa32-9bf866f19a4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:22:07 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:22:07 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:22:08 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:22:08 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:22:08 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:22:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.569s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:09 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:22:09 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:22:09 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:22:09 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:22:09 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:22:09 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:22:09 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fc7eb065-7615-466f-a457-b29bc08b06c8 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Acquiring lock "c69c0800-7a6c-4155-9f90-bbcd323276d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:22:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fc7eb065-7615-466f-a457-b29bc08b06c8 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "c69c0800-7a6c-4155-9f90-bbcd323276d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fc7eb065-7615-466f-a457-b29bc08b06c8 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Acquiring lock "c69c0800-7a6c-4155-9f90-bbcd323276d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:22:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fc7eb065-7615-466f-a457-b29bc08b06c8 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "c69c0800-7a6c-4155-9f90-bbcd323276d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fc7eb065-7615-466f-a457-b29bc08b06c8 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "c69c0800-7a6c-4155-9f90-bbcd323276d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:16 user nova-compute[74189]: INFO nova.compute.manager [None req-fc7eb065-7615-466f-a457-b29bc08b06c8 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Terminating instance
Oct 25 21:22:16 user nova-compute[74189]: DEBUG nova.compute.manager [None req-fc7eb065-7615-466f-a457-b29bc08b06c8 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:22:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:16 user nova-compute[74189]: DEBUG nova.compute.manager [req-58b7f677-93c9-4cf3-955a-6e59d79cdd0a req-ae100814-c25e-48db-bb75-f0cc3944364a service nova] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Received event network-vif-unplugged-e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:22:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-58b7f677-93c9-4cf3-955a-6e59d79cdd0a req-ae100814-c25e-48db-bb75-f0cc3944364a service nova] Acquiring lock "c69c0800-7a6c-4155-9f90-bbcd323276d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:22:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-58b7f677-93c9-4cf3-955a-6e59d79cdd0a req-ae100814-c25e-48db-bb75-f0cc3944364a service nova] Lock "c69c0800-7a6c-4155-9f90-bbcd323276d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-58b7f677-93c9-4cf3-955a-6e59d79cdd0a req-ae100814-c25e-48db-bb75-f0cc3944364a service nova] Lock "c69c0800-7a6c-4155-9f90-bbcd323276d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:16 user nova-compute[74189]: DEBUG nova.compute.manager [req-58b7f677-93c9-4cf3-955a-6e59d79cdd0a req-ae100814-c25e-48db-bb75-f0cc3944364a service nova] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] No waiting events found dispatching network-vif-unplugged-e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:22:16 user nova-compute[74189]: DEBUG nova.compute.manager [req-58b7f677-93c9-4cf3-955a-6e59d79cdd0a req-ae100814-c25e-48db-bb75-f0cc3944364a service nova] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Received event network-vif-unplugged-e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:22:17 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Instance destroyed successfully.
Oct 25 21:22:17 user nova-compute[74189]: DEBUG nova.objects.instance [None req-fc7eb065-7615-466f-a457-b29bc08b06c8 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lazy-loading 'resources' on Instance uuid c69c0800-7a6c-4155-9f90-bbcd323276d3 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:22:17 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-fc7eb065-7615-466f-a457-b29bc08b06c8 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:15:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-321773804',display_name='tempest-VolumesAdminNegativeTest-server-321773804',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-321773804',id=4,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAcw5K2fqQ5xKMGOSbKRExrPvp5/warLlYZ7C/EesC2xv80e7P00O+2HvP4NZszO8MvSIkHuDG0qMqoqJxbMj3TzgQtSkLFwJ/Q29Px71ky3eISIhv7x5mNa3is6lvenXw==',key_name='tempest-keypair-256484169',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:15:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09c2027cbebd4ffd9989ba14156beeba',ramdisk_id='',reservation_id='r-gy5555wd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-892271548',owner_user_name='tempest-VolumesAdminNegativeTest-892271548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:15:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='522bbceca0c6444cb16bb575f4186c5c',uuid=c69c0800-7a6c-4155-9f90-bbcd323276d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc", "address": "fa:16:3e:50:70:e6", "network": {"id": "093e46a2-3a83-46b5-a13b-661868863db1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1577201171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09c2027cbebd4ffd9989ba14156beeba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3d8e995-9e", "ovs_interfaceid": "e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:22:17 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-fc7eb065-7615-466f-a457-b29bc08b06c8 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Converting VIF {"id": "e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc", "address": "fa:16:3e:50:70:e6", "network": {"id": "093e46a2-3a83-46b5-a13b-661868863db1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1577201171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09c2027cbebd4ffd9989ba14156beeba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3d8e995-9e", "ovs_interfaceid": "e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:22:17 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-fc7eb065-7615-466f-a457-b29bc08b06c8 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:70:e6,bridge_name='br-int',has_traffic_filtering=True,id=e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc,network=Network(093e46a2-3a83-46b5-a13b-661868863db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3d8e995-9e') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:22:17 user nova-compute[74189]: DEBUG os_vif [None req-fc7eb065-7615-466f-a457-b29bc08b06c8 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:70:e6,bridge_name='br-int',has_traffic_filtering=True,id=e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc,network=Network(093e46a2-3a83-46b5-a13b-661868863db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3d8e995-9e') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:22:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3d8e995-9e, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:22:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:22:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bbc421f1-9439-4a79-8859-1ad619d08f28) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:22:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:17 user nova-compute[74189]: INFO os_vif [None req-fc7eb065-7615-466f-a457-b29bc08b06c8 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:70:e6,bridge_name='br-int',has_traffic_filtering=True,id=e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc,network=Network(093e46a2-3a83-46b5-a13b-661868863db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3d8e995-9e')
Oct 25 21:22:17 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-fc7eb065-7615-466f-a457-b29bc08b06c8 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Deleting instance files /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3_del
Oct 25 21:22:17 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-fc7eb065-7615-466f-a457-b29bc08b06c8 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Deletion of /opt/stack/data/nova/instances/c69c0800-7a6c-4155-9f90-bbcd323276d3_del complete
Oct 25 21:22:17 user nova-compute[74189]: INFO nova.compute.manager [None req-fc7eb065-7615-466f-a457-b29bc08b06c8 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 25 21:22:17 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-fc7eb065-7615-466f-a457-b29bc08b06c8 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:22:17 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:22:17 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:22:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:19 user nova-compute[74189]: DEBUG nova.compute.manager [req-d04346bf-88c6-4463-9c32-0fdeeaf38697 req-68f6cf74-58d3-4aee-b433-84a95cd7f00c service nova] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Received event network-vif-plugged-e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:22:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d04346bf-88c6-4463-9c32-0fdeeaf38697 req-68f6cf74-58d3-4aee-b433-84a95cd7f00c service nova] Acquiring lock "c69c0800-7a6c-4155-9f90-bbcd323276d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:22:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d04346bf-88c6-4463-9c32-0fdeeaf38697 req-68f6cf74-58d3-4aee-b433-84a95cd7f00c service nova] Lock "c69c0800-7a6c-4155-9f90-bbcd323276d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d04346bf-88c6-4463-9c32-0fdeeaf38697 req-68f6cf74-58d3-4aee-b433-84a95cd7f00c service nova] Lock "c69c0800-7a6c-4155-9f90-bbcd323276d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:19 user nova-compute[74189]: DEBUG nova.compute.manager [req-d04346bf-88c6-4463-9c32-0fdeeaf38697 req-68f6cf74-58d3-4aee-b433-84a95cd7f00c service nova] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] No waiting events found dispatching network-vif-plugged-e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:22:19 user nova-compute[74189]: WARNING nova.compute.manager [req-d04346bf-88c6-4463-9c32-0fdeeaf38697 req-68f6cf74-58d3-4aee-b433-84a95cd7f00c service nova] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Received unexpected event network-vif-plugged-e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc for instance with vm_state active and task_state deleting.
Oct 25 21:22:19 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:22:19 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Took 1.80 seconds to deallocate network for instance.
Oct 25 21:22:19 user nova-compute[74189]: DEBUG nova.compute.manager [req-c7d9aacd-9c4b-4217-8577-fe48101831a0 req-53e0e8eb-c862-4683-9bb3-cdb8b36fa870 service nova] [instance: c69c0800-7a6c-4155-9f90-bbcd323276d3] Received event network-vif-deleted-e3d8e995-9ed9-4feb-836b-1fa2ae6cf0bc {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:22:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fc7eb065-7615-466f-a457-b29bc08b06c8 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:22:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fc7eb065-7615-466f-a457-b29bc08b06c8 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:19 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-fc7eb065-7615-466f-a457-b29bc08b06c8 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:22:19 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-fc7eb065-7615-466f-a457-b29bc08b06c8 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:22:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fc7eb065-7615-466f-a457-b29bc08b06c8 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:19 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-fc7eb065-7615-466f-a457-b29bc08b06c8 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Deleted allocations for instance c69c0800-7a6c-4155-9f90-bbcd323276d3
Oct 25 21:22:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fc7eb065-7615-466f-a457-b29bc08b06c8 tempest-VolumesAdminNegativeTest-892271548 tempest-VolumesAdminNegativeTest-892271548-project-member] Lock "c69c0800-7a6c-4155-9f90-bbcd323276d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.314s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Acquiring lock "75071d8a-2ce2-43b5-99f6-23853399dc97" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:22:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:23 user nova-compute[74189]: DEBUG nova.compute.manager [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:22:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:22:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:23 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:22:23 user nova-compute[74189]: INFO nova.compute.claims [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Claim successful on node user
Oct 25 21:22:23 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:22:23 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:22:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.384s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:23 user nova-compute[74189]: DEBUG nova.compute.manager [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:22:23 user nova-compute[74189]: DEBUG nova.compute.manager [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:22:23 user nova-compute[74189]: DEBUG nova.network.neutron [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:22:23 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:22:23 user nova-compute[74189]: DEBUG nova.compute.manager [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:22:24 user nova-compute[74189]: DEBUG nova.policy [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e2a4908113594f96adeab0b362046568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046417147a924afdbc8b72333c362261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:22:24 user nova-compute[74189]: DEBUG nova.compute.manager [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:22:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:22:24 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Creating image(s)
Oct 25 21:22:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Acquiring lock "/opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:22:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "/opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "/opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:22:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.184s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:22:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:22:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:22:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.192s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:22:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:22:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk 1073741824" returned: 0 in 0.081s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:22:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:22:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.191s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:22:24 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Checking if we can resize image /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:22:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:22:24 user nova-compute[74189]: DEBUG nova.network.neutron [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Successfully created port: 54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:22:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:22:24 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Cannot resize image /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:22:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:22:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Ensure instance console log exists: /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:22:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:22:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:25 user nova-compute[74189]: DEBUG nova.network.neutron [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Successfully updated port: 54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:22:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Acquiring lock "refresh_cache-75071d8a-2ce2-43b5-99f6-23853399dc97" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:22:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Acquired lock "refresh_cache-75071d8a-2ce2-43b5-99f6-23853399dc97" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:22:25 user nova-compute[74189]: DEBUG nova.network.neutron [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:22:25 user nova-compute[74189]: DEBUG nova.compute.manager [req-7ffa331a-ffbc-453f-9fe1-17ecf047b8af req-3fe618ea-d581-47fe-bcee-d999dff51364 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Received event network-changed-54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:22:25 user nova-compute[74189]: DEBUG nova.compute.manager [req-7ffa331a-ffbc-453f-9fe1-17ecf047b8af req-3fe618ea-d581-47fe-bcee-d999dff51364 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Refreshing instance network info cache due to event network-changed-54123e00-9921-4807-b1f7-79073453a82f. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:22:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7ffa331a-ffbc-453f-9fe1-17ecf047b8af req-3fe618ea-d581-47fe-bcee-d999dff51364 service nova] Acquiring lock "refresh_cache-75071d8a-2ce2-43b5-99f6-23853399dc97" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:22:25 user nova-compute[74189]: DEBUG nova.network.neutron [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:22:25 user nova-compute[74189]: DEBUG nova.network.neutron [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Updating instance_info_cache with network_info: [{"id": "54123e00-9921-4807-b1f7-79073453a82f", "address": "fa:16:3e:02:6a:1d", "network": {"id": "3159e1a7-f60f-4768-9e06-a92287d19dd6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-119288589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046417147a924afdbc8b72333c362261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54123e00-99", "ovs_interfaceid": "54123e00-9921-4807-b1f7-79073453a82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:22:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Releasing lock "refresh_cache-75071d8a-2ce2-43b5-99f6-23853399dc97" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:22:25 user nova-compute[74189]: DEBUG nova.compute.manager [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Instance network_info: |[{"id": "54123e00-9921-4807-b1f7-79073453a82f", "address": "fa:16:3e:02:6a:1d", "network": {"id": "3159e1a7-f60f-4768-9e06-a92287d19dd6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-119288589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046417147a924afdbc8b72333c362261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54123e00-99", "ovs_interfaceid": "54123e00-9921-4807-b1f7-79073453a82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:22:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7ffa331a-ffbc-453f-9fe1-17ecf047b8af req-3fe618ea-d581-47fe-bcee-d999dff51364 service nova] Acquired lock "refresh_cache-75071d8a-2ce2-43b5-99f6-23853399dc97" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:22:25 user nova-compute[74189]: DEBUG nova.network.neutron [req-7ffa331a-ffbc-453f-9fe1-17ecf047b8af req-3fe618ea-d581-47fe-bcee-d999dff51364 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Refreshing network info cache for port 54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:22:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Start _get_guest_xml network_info=[{"id": "54123e00-9921-4807-b1f7-79073453a82f", "address": "fa:16:3e:02:6a:1d", "network": {"id": "3159e1a7-f60f-4768-9e06-a92287d19dd6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-119288589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046417147a924afdbc8b72333c362261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54123e00-99", "ovs_interfaceid": "54123e00-9921-4807-b1f7-79073453a82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:22:26 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:22:26 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:22:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1061125685',display_name='tempest-ServerStableDeviceRescueTest-server-1061125685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1061125685',id=19,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC20gTviyjNJBjxArKToE8AgxJM88oQS6J0/B2LSO3z48gSESlt2Qa5Ij29DDLKcOPNYWCIhOLQrsgZVfD03v7gd4V+2bdXXxGL2qgyJABqFDgeQggV88dXUclIdYhAD0g==',key_name='tempest-keypair-1832175527',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='046417147a924afdbc8b72333c362261',ramdisk_id='',reservation_id='r-wm74eoqy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1979035755',owner_user_name='tempest-ServerStableDeviceRescueTest-1979035755-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:22:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e2a4908113594f96adeab0b362046568',uuid=75071d8a-2ce2-43b5-99f6-23853399dc97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54123e00-9921-4807-b1f7-79073453a82f", "address": "fa:16:3e:02:6a:1d", "network": {"id": "3159e1a7-f60f-4768-9e06-a92287d19dd6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-119288589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046417147a924afdbc8b72333c362261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54123e00-99", "ovs_interfaceid": "54123e00-9921-4807-b1f7-79073453a82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Converting VIF {"id": "54123e00-9921-4807-b1f7-79073453a82f", "address": "fa:16:3e:02:6a:1d", "network": {"id": "3159e1a7-f60f-4768-9e06-a92287d19dd6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-119288589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046417147a924afdbc8b72333c362261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54123e00-99", "ovs_interfaceid": "54123e00-9921-4807-b1f7-79073453a82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:6a:1d,bridge_name='br-int',has_traffic_filtering=True,id=54123e00-9921-4807-b1f7-79073453a82f,network=Network(3159e1a7-f60f-4768-9e06-a92287d19dd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54123e00-99') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG nova.objects.instance [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lazy-loading 'pci_devices' on Instance uuid 75071d8a-2ce2-43b5-99f6-23853399dc97 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:22:26 user nova-compute[74189]:   <uuid>75071d8a-2ce2-43b5-99f6-23853399dc97</uuid>
Oct 25 21:22:26 user nova-compute[74189]:   <name>instance-00000013</name>
Oct 25 21:22:26 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:22:26 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:22:26 user nova-compute[74189]:   <metadata>
Oct 25 21:22:26 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:22:26 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:22:26 user nova-compute[74189]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1061125685</nova:name>
Oct 25 21:22:26 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:22:26</nova:creationTime>
Oct 25 21:22:26 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:22:26 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:22:26 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:22:26 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:22:26 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:22:26 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:22:26 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:22:26 user nova-compute[74189]:       <nova:owner>
Oct 25 21:22:26 user nova-compute[74189]:         <nova:user uuid="e2a4908113594f96adeab0b362046568">tempest-ServerStableDeviceRescueTest-1979035755-project-member</nova:user>
Oct 25 21:22:26 user nova-compute[74189]:         <nova:project uuid="046417147a924afdbc8b72333c362261">tempest-ServerStableDeviceRescueTest-1979035755</nova:project>
Oct 25 21:22:26 user nova-compute[74189]:       </nova:owner>
Oct 25 21:22:26 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:22:26 user nova-compute[74189]:       <nova:ports>
Oct 25 21:22:26 user nova-compute[74189]:         <nova:port uuid="54123e00-9921-4807-b1f7-79073453a82f">
Oct 25 21:22:26 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 25 21:22:26 user nova-compute[74189]:         </nova:port>
Oct 25 21:22:26 user nova-compute[74189]:       </nova:ports>
Oct 25 21:22:26 user nova-compute[74189]:     </nova:instance>
Oct 25 21:22:26 user nova-compute[74189]:   </metadata>
Oct 25 21:22:26 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:22:26 user nova-compute[74189]:     <system>
Oct 25 21:22:26 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:22:26 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:22:26 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:22:26 user nova-compute[74189]:       <entry name="serial">75071d8a-2ce2-43b5-99f6-23853399dc97</entry>
Oct 25 21:22:26 user nova-compute[74189]:       <entry name="uuid">75071d8a-2ce2-43b5-99f6-23853399dc97</entry>
Oct 25 21:22:26 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:22:26 user nova-compute[74189]:     </system>
Oct 25 21:22:26 user nova-compute[74189]:   </sysinfo>
Oct 25 21:22:26 user nova-compute[74189]:   <os>
Oct 25 21:22:26 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:22:26 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:22:26 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:22:26 user nova-compute[74189]:   </os>
Oct 25 21:22:26 user nova-compute[74189]:   <features>
Oct 25 21:22:26 user nova-compute[74189]:     <acpi/>
Oct 25 21:22:26 user nova-compute[74189]:     <apic/>
Oct 25 21:22:26 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:22:26 user nova-compute[74189]:   </features>
Oct 25 21:22:26 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:22:26 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:22:26 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:22:26 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:22:26 user nova-compute[74189]:   </clock>
Oct 25 21:22:26 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:22:26 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:22:26 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:22:26 user nova-compute[74189]:   </cpu>
Oct 25 21:22:26 user nova-compute[74189]:   <devices>
Oct 25 21:22:26 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:22:26 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:22:26 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk"/>
Oct 25 21:22:26 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:22:26 user nova-compute[74189]:     </disk>
Oct 25 21:22:26 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:22:26 user nova-compute[74189]:       <mac address="fa:16:3e:02:6a:1d"/>
Oct 25 21:22:26 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:22:26 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:22:26 user nova-compute[74189]:       <target dev="tap54123e00-99"/>
Oct 25 21:22:26 user nova-compute[74189]:     </interface>
Oct 25 21:22:26 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:22:26 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/console.log" append="off"/>
Oct 25 21:22:26 user nova-compute[74189]:     </serial>
Oct 25 21:22:26 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:22:26 user nova-compute[74189]:     <video>
Oct 25 21:22:26 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:22:26 user nova-compute[74189]:     </video>
Oct 25 21:22:26 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:22:26 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:22:26 user nova-compute[74189]:     </rng>
Oct 25 21:22:26 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:22:26 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:22:26 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:22:26 user nova-compute[74189]:     </memballoon>
Oct 25 21:22:26 user nova-compute[74189]:   </devices>
Oct 25 21:22:26 user nova-compute[74189]: </domain>
Oct 25 21:22:26 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1061125685',display_name='tempest-ServerStableDeviceRescueTest-server-1061125685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1061125685',id=19,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC20gTviyjNJBjxArKToE8AgxJM88oQS6J0/B2LSO3z48gSESlt2Qa5Ij29DDLKcOPNYWCIhOLQrsgZVfD03v7gd4V+2bdXXxGL2qgyJABqFDgeQggV88dXUclIdYhAD0g==',key_name='tempest-keypair-1832175527',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='046417147a924afdbc8b72333c362261',ramdisk_id='',reservation_id='r-wm74eoqy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1979035755',owner_user_name='tempest-ServerStableDeviceRescueTest-1979035755-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:22:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e2a4908113594f96adeab0b362046568',uuid=75071d8a-2ce2-43b5-99f6-23853399dc97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54123e00-9921-4807-b1f7-79073453a82f", "address": "fa:16:3e:02:6a:1d", "network": {"id": "3159e1a7-f60f-4768-9e06-a92287d19dd6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-119288589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046417147a924afdbc8b72333c362261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54123e00-99", "ovs_interfaceid": "54123e00-9921-4807-b1f7-79073453a82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Converting VIF {"id": "54123e00-9921-4807-b1f7-79073453a82f", "address": "fa:16:3e:02:6a:1d", "network": {"id": "3159e1a7-f60f-4768-9e06-a92287d19dd6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-119288589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046417147a924afdbc8b72333c362261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54123e00-99", "ovs_interfaceid": "54123e00-9921-4807-b1f7-79073453a82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:6a:1d,bridge_name='br-int',has_traffic_filtering=True,id=54123e00-9921-4807-b1f7-79073453a82f,network=Network(3159e1a7-f60f-4768-9e06-a92287d19dd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54123e00-99') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG os_vif [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:6a:1d,bridge_name='br-int',has_traffic_filtering=True,id=54123e00-9921-4807-b1f7-79073453a82f,network=Network(3159e1a7-f60f-4768-9e06-a92287d19dd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54123e00-99') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b63225b5-c7d6-5d21-9840-a6a03d1640be', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54123e00-99, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap54123e00-99, col_values=(('qos', UUID('c3c54036-be82-4c23-ba0b-a03427c38f9d')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap54123e00-99, col_values=(('external_ids', {'iface-id': '54123e00-9921-4807-b1f7-79073453a82f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:6a:1d', 'vm-uuid': '75071d8a-2ce2-43b5-99f6-23853399dc97'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:26 user nova-compute[74189]: INFO os_vif [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:6a:1d,bridge_name='br-int',has_traffic_filtering=True,id=54123e00-9921-4807-b1f7-79073453a82f,network=Network(3159e1a7-f60f-4768-9e06-a92287d19dd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54123e00-99')
Oct 25 21:22:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] No VIF found with MAC fa:16:3e:02:6a:1d, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG nova.network.neutron [req-7ffa331a-ffbc-453f-9fe1-17ecf047b8af req-3fe618ea-d581-47fe-bcee-d999dff51364 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Updated VIF entry in instance network info cache for port 54123e00-9921-4807-b1f7-79073453a82f. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG nova.network.neutron [req-7ffa331a-ffbc-453f-9fe1-17ecf047b8af req-3fe618ea-d581-47fe-bcee-d999dff51364 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Updating instance_info_cache with network_info: [{"id": "54123e00-9921-4807-b1f7-79073453a82f", "address": "fa:16:3e:02:6a:1d", "network": {"id": "3159e1a7-f60f-4768-9e06-a92287d19dd6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-119288589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046417147a924afdbc8b72333c362261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54123e00-99", "ovs_interfaceid": "54123e00-9921-4807-b1f7-79073453a82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:22:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7ffa331a-ffbc-453f-9fe1-17ecf047b8af req-3fe618ea-d581-47fe-bcee-d999dff51364 service nova] Releasing lock "refresh_cache-75071d8a-2ce2-43b5-99f6-23853399dc97" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:22:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-ad86ad9e-f25d-4672-beb0-38034d2cc131 req-6ea2aeb4-e0a3-467e-bd1d-4d31ca75d7bb service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Received event network-vif-plugged-54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:22:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ad86ad9e-f25d-4672-beb0-38034d2cc131 req-6ea2aeb4-e0a3-467e-bd1d-4d31ca75d7bb service nova] Acquiring lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:22:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ad86ad9e-f25d-4672-beb0-38034d2cc131 req-6ea2aeb4-e0a3-467e-bd1d-4d31ca75d7bb service nova] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ad86ad9e-f25d-4672-beb0-38034d2cc131 req-6ea2aeb4-e0a3-467e-bd1d-4d31ca75d7bb service nova] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-ad86ad9e-f25d-4672-beb0-38034d2cc131 req-6ea2aeb4-e0a3-467e-bd1d-4d31ca75d7bb service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] No waiting events found dispatching network-vif-plugged-54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:22:27 user nova-compute[74189]: WARNING nova.compute.manager [req-ad86ad9e-f25d-4672-beb0-38034d2cc131 req-6ea2aeb4-e0a3-467e-bd1d-4d31ca75d7bb service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Received unexpected event network-vif-plugged-54123e00-9921-4807-b1f7-79073453a82f for instance with vm_state building and task_state spawning.
Oct 25 21:22:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:29 user nova-compute[74189]: DEBUG nova.compute.manager [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:22:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:22:29 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Instance spawned successfully.
Oct 25 21:22:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:22:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:22:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:22:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:22:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:22:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:22:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:22:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-d7f89919-2f8b-4703-922c-8d8d851614fa req-7a427d17-b0d9-479e-b715-763fbcbb40fc service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Received event network-vif-plugged-54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:22:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d7f89919-2f8b-4703-922c-8d8d851614fa req-7a427d17-b0d9-479e-b715-763fbcbb40fc service nova] Acquiring lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:22:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d7f89919-2f8b-4703-922c-8d8d851614fa req-7a427d17-b0d9-479e-b715-763fbcbb40fc service nova] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d7f89919-2f8b-4703-922c-8d8d851614fa req-7a427d17-b0d9-479e-b715-763fbcbb40fc service nova] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-d7f89919-2f8b-4703-922c-8d8d851614fa req-7a427d17-b0d9-479e-b715-763fbcbb40fc service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] No waiting events found dispatching network-vif-plugged-54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:22:29 user nova-compute[74189]: WARNING nova.compute.manager [req-d7f89919-2f8b-4703-922c-8d8d851614fa req-7a427d17-b0d9-479e-b715-763fbcbb40fc service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Received unexpected event network-vif-plugged-54123e00-9921-4807-b1f7-79073453a82f for instance with vm_state building and task_state spawning.
Oct 25 21:22:29 user nova-compute[74189]: INFO nova.compute.manager [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Took 5.83 seconds to spawn the instance on the hypervisor.
Oct 25 21:22:29 user nova-compute[74189]: DEBUG nova.compute.manager [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:22:30 user nova-compute[74189]: INFO nova.compute.manager [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Took 6.64 seconds to build instance.
Oct 25 21:22:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4f0f2ba4-3c61-4b7a-a88f-d416aa295a62 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.753s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:34 user nova-compute[74189]: INFO nova.compute.manager [None req-39121b0d-45b1-4857-99cc-333a7289ede1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Unrescuing
Oct 25 21:22:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-39121b0d-45b1-4857-99cc-333a7289ede1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "refresh_cache-af1d7b3c-9950-4b74-8f15-b31011ccfa24" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:22:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-39121b0d-45b1-4857-99cc-333a7289ede1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquired lock "refresh_cache-af1d7b3c-9950-4b74-8f15-b31011ccfa24" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:22:34 user nova-compute[74189]: DEBUG nova.network.neutron [None req-39121b0d-45b1-4857-99cc-333a7289ede1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:22:35 user nova-compute[74189]: DEBUG nova.network.neutron [None req-39121b0d-45b1-4857-99cc-333a7289ede1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Updating instance_info_cache with network_info: [{"id": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "address": "fa:16:3e:03:8e:2f", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4cdb73-9d", "ovs_interfaceid": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:22:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-39121b0d-45b1-4857-99cc-333a7289ede1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Releasing lock "refresh_cache-af1d7b3c-9950-4b74-8f15-b31011ccfa24" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:22:35 user nova-compute[74189]: DEBUG nova.objects.instance [None req-39121b0d-45b1-4857-99cc-333a7289ede1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lazy-loading 'flavor' on Instance uuid af1d7b3c-9950-4b74-8f15-b31011ccfa24 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:22:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-7260e0c6-ec92-4798-9c16-e85fd1a9c7a4 req-c4035f65-2f0d-4b08-b032-96ebdb4b6b33 service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Received event network-vif-unplugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:22:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7260e0c6-ec92-4798-9c16-e85fd1a9c7a4 req-c4035f65-2f0d-4b08-b032-96ebdb4b6b33 service nova] Acquiring lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:22:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7260e0c6-ec92-4798-9c16-e85fd1a9c7a4 req-c4035f65-2f0d-4b08-b032-96ebdb4b6b33 service nova] Lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7260e0c6-ec92-4798-9c16-e85fd1a9c7a4 req-c4035f65-2f0d-4b08-b032-96ebdb4b6b33 service nova] Lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-7260e0c6-ec92-4798-9c16-e85fd1a9c7a4 req-c4035f65-2f0d-4b08-b032-96ebdb4b6b33 service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] No waiting events found dispatching network-vif-unplugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:22:35 user nova-compute[74189]: WARNING nova.compute.manager [req-7260e0c6-ec92-4798-9c16-e85fd1a9c7a4 req-c4035f65-2f0d-4b08-b032-96ebdb4b6b33 service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Received unexpected event network-vif-unplugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b for instance with vm_state rescued and task_state unrescuing.
Oct 25 21:22:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:36 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Instance destroyed successfully.
Oct 25 21:22:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:37 user nova-compute[74189]: DEBUG nova.compute.manager [req-2a9d1dfa-fb1a-4718-b0cb-e86633f9e8c8 req-f8401adb-83c0-4bd1-af71-a1578fb338db service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Received event network-vif-plugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:22:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2a9d1dfa-fb1a-4718-b0cb-e86633f9e8c8 req-f8401adb-83c0-4bd1-af71-a1578fb338db service nova] Acquiring lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:22:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2a9d1dfa-fb1a-4718-b0cb-e86633f9e8c8 req-f8401adb-83c0-4bd1-af71-a1578fb338db service nova] Lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2a9d1dfa-fb1a-4718-b0cb-e86633f9e8c8 req-f8401adb-83c0-4bd1-af71-a1578fb338db service nova] Lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:37 user nova-compute[74189]: DEBUG nova.compute.manager [req-2a9d1dfa-fb1a-4718-b0cb-e86633f9e8c8 req-f8401adb-83c0-4bd1-af71-a1578fb338db service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] No waiting events found dispatching network-vif-plugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:22:37 user nova-compute[74189]: WARNING nova.compute.manager [req-2a9d1dfa-fb1a-4718-b0cb-e86633f9e8c8 req-f8401adb-83c0-4bd1-af71-a1578fb338db service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Received unexpected event network-vif-plugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b for instance with vm_state rescued and task_state unrescuing.
Oct 25 21:22:37 user nova-compute[74189]: DEBUG nova.compute.manager [req-2a9d1dfa-fb1a-4718-b0cb-e86633f9e8c8 req-f8401adb-83c0-4bd1-af71-a1578fb338db service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Received event network-vif-plugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:22:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2a9d1dfa-fb1a-4718-b0cb-e86633f9e8c8 req-f8401adb-83c0-4bd1-af71-a1578fb338db service nova] Acquiring lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:22:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2a9d1dfa-fb1a-4718-b0cb-e86633f9e8c8 req-f8401adb-83c0-4bd1-af71-a1578fb338db service nova] Lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2a9d1dfa-fb1a-4718-b0cb-e86633f9e8c8 req-f8401adb-83c0-4bd1-af71-a1578fb338db service nova] Lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:37 user nova-compute[74189]: DEBUG nova.compute.manager [req-2a9d1dfa-fb1a-4718-b0cb-e86633f9e8c8 req-f8401adb-83c0-4bd1-af71-a1578fb338db service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] No waiting events found dispatching network-vif-plugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:22:37 user nova-compute[74189]: WARNING nova.compute.manager [req-2a9d1dfa-fb1a-4718-b0cb-e86633f9e8c8 req-f8401adb-83c0-4bd1-af71-a1578fb338db service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Received unexpected event network-vif-plugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b for instance with vm_state rescued and task_state unrescuing.
Oct 25 21:22:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:39 user nova-compute[74189]: DEBUG nova.compute.manager [req-39eb64df-4115-4f23-a2d8-a11f8386d6ad req-6156c4d5-5ed3-46ab-aa6a-646c50df5062 service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Received event network-vif-plugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:22:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-39eb64df-4115-4f23-a2d8-a11f8386d6ad req-6156c4d5-5ed3-46ab-aa6a-646c50df5062 service nova] Acquiring lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:22:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-39eb64df-4115-4f23-a2d8-a11f8386d6ad req-6156c4d5-5ed3-46ab-aa6a-646c50df5062 service nova] Lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-39eb64df-4115-4f23-a2d8-a11f8386d6ad req-6156c4d5-5ed3-46ab-aa6a-646c50df5062 service nova] Lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:39 user nova-compute[74189]: DEBUG nova.compute.manager [req-39eb64df-4115-4f23-a2d8-a11f8386d6ad req-6156c4d5-5ed3-46ab-aa6a-646c50df5062 service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] No waiting events found dispatching network-vif-plugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:22:39 user nova-compute[74189]: WARNING nova.compute.manager [req-39eb64df-4115-4f23-a2d8-a11f8386d6ad req-6156c4d5-5ed3-46ab-aa6a-646c50df5062 service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Received unexpected event network-vif-plugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b for instance with vm_state rescued and task_state unrescuing.
Oct 25 21:22:40 user nova-compute[74189]: DEBUG nova.compute.manager [None req-39121b0d-45b1-4857-99cc-333a7289ede1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:22:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:46 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:51 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:52 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:52 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:52 user nova-compute[74189]: DEBUG nova.compute.manager [req-9844f36e-7cab-4b9d-aea6-4c50c7825ff8 req-f8165dab-755c-4490-9999-47efa20f1523 service nova] [instance: 680e134e-5e0d-464f-9e30-460010348795] Received event network-changed-41682423-a7e4-44c2-9936-24fe7a965bf9 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:22:52 user nova-compute[74189]: DEBUG nova.compute.manager [req-9844f36e-7cab-4b9d-aea6-4c50c7825ff8 req-f8165dab-755c-4490-9999-47efa20f1523 service nova] [instance: 680e134e-5e0d-464f-9e30-460010348795] Refreshing instance network info cache due to event network-changed-41682423-a7e4-44c2-9936-24fe7a965bf9. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:22:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9844f36e-7cab-4b9d-aea6-4c50c7825ff8 req-f8165dab-755c-4490-9999-47efa20f1523 service nova] Acquiring lock "refresh_cache-680e134e-5e0d-464f-9e30-460010348795" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:22:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9844f36e-7cab-4b9d-aea6-4c50c7825ff8 req-f8165dab-755c-4490-9999-47efa20f1523 service nova] Acquired lock "refresh_cache-680e134e-5e0d-464f-9e30-460010348795" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:22:52 user nova-compute[74189]: DEBUG nova.network.neutron [req-9844f36e-7cab-4b9d-aea6-4c50c7825ff8 req-f8165dab-755c-4490-9999-47efa20f1523 service nova] [instance: 680e134e-5e0d-464f-9e30-460010348795] Refreshing network info cache for port 41682423-a7e4-44c2-9936-24fe7a965bf9 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:22:53 user nova-compute[74189]: DEBUG nova.network.neutron [req-9844f36e-7cab-4b9d-aea6-4c50c7825ff8 req-f8165dab-755c-4490-9999-47efa20f1523 service nova] [instance: 680e134e-5e0d-464f-9e30-460010348795] Updated VIF entry in instance network info cache for port 41682423-a7e4-44c2-9936-24fe7a965bf9. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:22:53 user nova-compute[74189]: DEBUG nova.network.neutron [req-9844f36e-7cab-4b9d-aea6-4c50c7825ff8 req-f8165dab-755c-4490-9999-47efa20f1523 service nova] [instance: 680e134e-5e0d-464f-9e30-460010348795] Updating instance_info_cache with network_info: [{"id": "41682423-a7e4-44c2-9936-24fe7a965bf9", "address": "fa:16:3e:a3:82:56", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41682423-a7", "ovs_interfaceid": "41682423-a7e4-44c2-9936-24fe7a965bf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:22:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9844f36e-7cab-4b9d-aea6-4c50c7825ff8 req-f8165dab-755c-4490-9999-47efa20f1523 service nova] Releasing lock "refresh_cache-680e134e-5e0d-464f-9e30-460010348795" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:22:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:22:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "680e134e-5e0d-464f-9e30-460010348795" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:22:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "680e134e-5e0d-464f-9e30-460010348795" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:59 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lazy-loading 'flavor' on Instance uuid 680e134e-5e0d-464f-9e30-460010348795 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:22:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "680e134e-5e0d-464f-9e30-460010348795" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:22:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "680e134e-5e0d-464f-9e30-460010348795" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:22:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "680e134e-5e0d-464f-9e30-460010348795" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:22:59 user nova-compute[74189]: INFO nova.compute.manager [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Attaching volume a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 to /dev/vdb
Oct 25 21:22:59 user nova-compute[74189]: DEBUG os_brick.utils [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:22:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:22:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:22:59 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b2d381-c0fe-4620-9565-489b2e030214]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:22:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:22:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:22:59 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d17ae91-7e13-4365-b6d7-de9553b0da67]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:22:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:22:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:22:59 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75e2478-df71-405c-9d37-79a9b8c30c29]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:22:59 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e08f99-772e-46b3-88c3-84aca445f29e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:22:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:22:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:22:59 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:22:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:22:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:22:59 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:22:59 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c71428-e45a-4868-a85f-f82fd37cad75]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:22:59 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:22:59 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:22:59 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:22:59 user nova-compute[74189]: DEBUG os_brick.utils [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:22:59 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Updating existing volume attachment record: cf5b6aef-54ce-4f94-a864-aeed07e6021a {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:22:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:00 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:23:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:01 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:23:01 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:23:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:23:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:23:02 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:23:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:03 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Updating instance_info_cache with network_info: [{"id": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "address": "fa:16:3e:92:dc:7e", "network": {"id": "197dd483-54ad-4b81-a0d0-26c633b3a101", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1141346509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e426fbc4bb374115a46d927092d62423", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a0280f-de", "ovs_interfaceid": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:23:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:23:03 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:23:03 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:23:03 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:23:03 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:23:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:23:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:23:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:23:03 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:23:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:23:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:23:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:23:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:23:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:23:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/680e134e-5e0d-464f-9e30-460010348795/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/680e134e-5e0d-464f-9e30-460010348795/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/680e134e-5e0d-464f-9e30-460010348795/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/680e134e-5e0d-464f-9e30-460010348795/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:06 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:23:06 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:23:06 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=7645MB free_disk=25.342151641845703GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:23:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:23:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:23:06 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance d7c3a99a-ab38-4e88-896d-94ae51a09a48 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:23:06 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance af1d7b3c-9950-4b74-8f15-b31011ccfa24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:23:06 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:23:06 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 46ffb192-ad11-416e-9094-c8e080b5414e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:23:06 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 680e134e-5e0d-464f-9e30-460010348795 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:23:06 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance de6b6789-b328-4c3b-8d24-07774d5dbe6d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:23:06 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 932fe8ac-fdde-45c6-aa32-9bf866f19a4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:23:06 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 75071d8a-2ce2-43b5-99f6-23853399dc97 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:23:06 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:23:06 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:23:06 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:23:06 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:23:06 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:23:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.424s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:23:07 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:23:07 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:23:07 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:23:07 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:23:07 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:23:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:09 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:23:11 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:11 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:12 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:18 user nova-compute[74189]: DEBUG nova.compute.manager [req-4e6ed242-7a08-49ae-acbf-0aecfaecf430 req-95fbad0d-0412-41b8-8f02-414d54cad983 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Received event network-changed-b0bbbcbc-085e-476f-b600-f1d684f23beb {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:23:18 user nova-compute[74189]: DEBUG nova.compute.manager [req-4e6ed242-7a08-49ae-acbf-0aecfaecf430 req-95fbad0d-0412-41b8-8f02-414d54cad983 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Refreshing instance network info cache due to event network-changed-b0bbbcbc-085e-476f-b600-f1d684f23beb. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:23:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4e6ed242-7a08-49ae-acbf-0aecfaecf430 req-95fbad0d-0412-41b8-8f02-414d54cad983 service nova] Acquiring lock "refresh_cache-de6b6789-b328-4c3b-8d24-07774d5dbe6d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:23:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4e6ed242-7a08-49ae-acbf-0aecfaecf430 req-95fbad0d-0412-41b8-8f02-414d54cad983 service nova] Acquired lock "refresh_cache-de6b6789-b328-4c3b-8d24-07774d5dbe6d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:23:18 user nova-compute[74189]: DEBUG nova.network.neutron [req-4e6ed242-7a08-49ae-acbf-0aecfaecf430 req-95fbad0d-0412-41b8-8f02-414d54cad983 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Refreshing network info cache for port b0bbbcbc-085e-476f-b600-f1d684f23beb {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:23:18 user nova-compute[74189]: DEBUG nova.network.neutron [req-4e6ed242-7a08-49ae-acbf-0aecfaecf430 req-95fbad0d-0412-41b8-8f02-414d54cad983 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Updated VIF entry in instance network info cache for port b0bbbcbc-085e-476f-b600-f1d684f23beb. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:23:18 user nova-compute[74189]: DEBUG nova.network.neutron [req-4e6ed242-7a08-49ae-acbf-0aecfaecf430 req-95fbad0d-0412-41b8-8f02-414d54cad983 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Updating instance_info_cache with network_info: [{"id": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "address": "fa:16:3e:df:d0:7a", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bbbcbc-08", "ovs_interfaceid": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:23:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4e6ed242-7a08-49ae-acbf-0aecfaecf430 req-95fbad0d-0412-41b8-8f02-414d54cad983 service nova] Releasing lock "refresh_cache-de6b6789-b328-4c3b-8d24-07774d5dbe6d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'drbaqyvD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:23:19 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:23:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:23:19 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:23:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:23:19 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:23:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ff5628-3a9a-4217-8bac-004e0864fb84]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:23:19 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b48f16-68f1-4277-873b-ad7c847f7132]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1] added
Oct 25 21:23:19 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac78b04-1f88-4404-8d3b-c19bd151cef2]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[35166dbb-b9ee-46d1-91e0-2ea656ab0c55]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v drbaqyvD {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v drbaqyvD" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91e1c0e-8ebe-4a57-91e8-b029a8312b9b]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'drbaqyvD'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6436d2-d784-4d31-aed9-6f4f30259731]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa03dd28-20da-42a5-b352-cd6512ed43a4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:23:19 user nova-compute[74189]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee (non-flash)
Oct 25 21:23:19 user nova-compute[74189]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:23:19 user nova-compute[74189]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 (non-flash)
Oct 25 21:23:19 user nova-compute[74189]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 (non-flash)
Oct 25 21:23:19 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:23:19 user nova-compute[74189]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee (non-flash)
Oct 25 21:23:19 user nova-compute[74189]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:23:19 user nova-compute[74189]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 (non-flash)
Oct 25 21:23:19 user nova-compute[74189]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 (non-flash)
Oct 25 21:23:19 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaab95d4-0032-4cc0-ad6f-1b8e3ab1f8b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1, portal: 172.16.0.220,3260]
Oct 25 21:23:19 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1, portal: 172.16.0.220,3260] successful.
Oct 25 21:23:19 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97c79df-5309-4909-8217-e68f852d4a3a]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[301cd491-cdb6-48ac-b6f9-a6c4aef4809d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:23:19 user nova-compute[74189]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee (non-flash)
Oct 25 21:23:19 user nova-compute[74189]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:23:19 user nova-compute[74189]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 (non-flash)
Oct 25 21:23:19 user nova-compute[74189]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 (non-flash)
Oct 25 21:23:19 user nova-compute[74189]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)
Oct 25 21:23:19 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:23:19 user nova-compute[74189]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee (non-flash)
Oct 25 21:23:19 user nova-compute[74189]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:23:19 user nova-compute[74189]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 (non-flash)
Oct 25 21:23:19 user nova-compute[74189]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 (non-flash)
Oct 25 21:23:19 user nova-compute[74189]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)
Oct 25 21:23:19 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] HCTL ('38', '-', '-', 0) found on session 23 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f7614a-7b60-47a7-8faf-12498b48c450]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Searching for a device in session 23 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:23:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'drbaqyvD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:23:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:23:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26263633633613730', 'path': '/dev/sdg'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:23:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263633633613730', 'path': '/dev/sdg'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:23:20 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lazy-loading 'flavor' on Instance uuid 680e134e-5e0d-464f-9e30-460010348795 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:23:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 21:23:20 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:23:20 user nova-compute[74189]:   <source dev="/dev/sdg"/>
Oct 25 21:23:20 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:23:20 user nova-compute[74189]:   <serial>a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1</serial>
Oct 25 21:23:20 user nova-compute[74189]: </disk>
Oct 25 21:23:20 user nova-compute[74189]:  {{(pid=74189) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 21:23:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:23:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:23:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] No VIF found with MAC fa:16:3e:a3:82:56, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:23:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a91de5ed-a96b-44c5-8958-6cbc9058e64c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "680e134e-5e0d-464f-9e30-460010348795" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.136s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:23:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:24 user nova-compute[74189]: DEBUG nova.compute.manager [req-b0472253-0377-407c-b845-55cb472261c0 req-ff4f5253-197a-4e07-86d0-2f643bd917fe service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-changed-35311a59-a404-4759-8125-ac222750d5fa {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:23:24 user nova-compute[74189]: DEBUG nova.compute.manager [req-b0472253-0377-407c-b845-55cb472261c0 req-ff4f5253-197a-4e07-86d0-2f643bd917fe service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Refreshing instance network info cache due to event network-changed-35311a59-a404-4759-8125-ac222750d5fa. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:23:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b0472253-0377-407c-b845-55cb472261c0 req-ff4f5253-197a-4e07-86d0-2f643bd917fe service nova] Acquiring lock "refresh_cache-46ffb192-ad11-416e-9094-c8e080b5414e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:23:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b0472253-0377-407c-b845-55cb472261c0 req-ff4f5253-197a-4e07-86d0-2f643bd917fe service nova] Acquired lock "refresh_cache-46ffb192-ad11-416e-9094-c8e080b5414e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:23:24 user nova-compute[74189]: DEBUG nova.network.neutron [req-b0472253-0377-407c-b845-55cb472261c0 req-ff4f5253-197a-4e07-86d0-2f643bd917fe service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Refreshing network info cache for port 35311a59-a404-4759-8125-ac222750d5fa {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:23:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:23:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:23:24 user nova-compute[74189]: DEBUG nova.network.neutron [req-b0472253-0377-407c-b845-55cb472261c0 req-ff4f5253-197a-4e07-86d0-2f643bd917fe service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Updated VIF entry in instance network info cache for port 35311a59-a404-4759-8125-ac222750d5fa. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:23:24 user nova-compute[74189]: DEBUG nova.network.neutron [req-b0472253-0377-407c-b845-55cb472261c0 req-ff4f5253-197a-4e07-86d0-2f643bd917fe service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Updating instance_info_cache with network_info: [{"id": "35311a59-a404-4759-8125-ac222750d5fa", "address": "fa:16:3e:b5:8d:bc", "network": {"id": "477a555b-610a-4b4f-8e0e-efd52c856097", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1102892168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35311a59-a4", "ovs_interfaceid": "35311a59-a404-4759-8125-ac222750d5fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "address": "fa:16:3e:b2:20:8d", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1d7d42-01", "ovs_interfaceid": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f967dd2c-da19-4645-b52e-2d79f61baabe", "address": "fa:16:3e:d1:88:5b", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf967dd2c-da", "ovs_interfaceid": "f967dd2c-da19-4645-b52e-2d79f61baabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f18e575-80eb-41e8-8615-bcbbe00ff9de", "address": "fa:16:3e:c2:d7:0b", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f18e575-80", "ovs_interfaceid": "5f18e575-80eb-41e8-8615-bcbbe00ff9de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4caa88c4-c581-41eb-b8f8-a291aaef3ad4", "address": "fa:16:3e:24:e8:88", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4caa88c4-c5", "ovs_interfaceid": "4caa88c4-c581-41eb-b8f8-a291aaef3ad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b60a817a-3478-48d7-b117-bee088bc7e86", "address": "fa:16:3e:0f:4d:3e", "network": {"id": "68ea97b8-852c-464a-9ccb-b2dc55c63e47", "bridge": "br-int", "label": "tempest-device-tagging-net2-670429054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60a817a-34", "ovs_interfaceid": "b60a817a-3478-48d7-b117-bee088bc7e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56", "address": "fa:16:3e:b0:f9:54", "network": {"id": "68ea97b8-852c-464a-9ccb-b2dc55c63e47", "bridge": "br-int", "label": "tempest-device-tagging-net2-670429054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e0f5a2-44", "ovs_interfaceid": "94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:23:24 user nova-compute[74189]: DEBUG nova.objects.instance [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lazy-loading 'flavor' on Instance uuid de6b6789-b328-4c3b-8d24-07774d5dbe6d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:23:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b0472253-0377-407c-b845-55cb472261c0 req-ff4f5253-197a-4e07-86d0-2f643bd917fe service nova] Releasing lock "refresh_cache-46ffb192-ad11-416e-9094-c8e080b5414e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:23:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:23:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:23:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:23:25 user nova-compute[74189]: INFO nova.compute.manager [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Attaching volume 5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f to /dev/vdb
Oct 25 21:23:25 user nova-compute[74189]: DEBUG os_brick.utils [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:23:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18284c7-dc8d-4052-808c-8fad29aa273d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4c6647-9b7f-4740-a8d6-c6118f14b486]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "384e5528-a8d3-49f3-bc21-e7dbf3d14cb5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:23:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "384e5528-a8d3-49f3-bc21-e7dbf3d14cb5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:23:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:25 user nova-compute[74189]: DEBUG nova.compute.manager [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:23:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c503b3f-a669-46dc-91c2-2c913cb3bdba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a5ac92-560c-43be-9b30-d7c18a8ea0d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:23:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:23:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:23:25 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:23:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[deccd862-88a9-46a4-8747-d3ff2c56db80]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:23:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:23:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:23:25 user nova-compute[74189]: DEBUG os_brick.utils [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:23:25 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Updating existing volume attachment record: 10f5174f-74df-475c-90b8-4f4a8f95ed03 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:23:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:23:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:23:25 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:23:25 user nova-compute[74189]: INFO nova.compute.claims [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Claim successful on node user
Oct 25 21:23:25 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:23:25 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:23:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:23:25 user nova-compute[74189]: DEBUG nova.compute.manager [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:23:25 user nova-compute[74189]: DEBUG nova.compute.manager [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:23:25 user nova-compute[74189]: DEBUG nova.network.neutron [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:23:25 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:23:25 user nova-compute[74189]: DEBUG nova.compute.manager [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:23:25 user nova-compute[74189]: DEBUG nova.policy [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2f19a398fd9486fbef04eebad62a0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a555d708aa644d586d5edad7db837b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:23:26 user nova-compute[74189]: DEBUG nova.compute.manager [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:23:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:23:26 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Creating image(s)
Oct 25 21:23:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "/opt/stack/data/nova/instances/384e5528-a8d3-49f3-bc21-e7dbf3d14cb5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:23:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "/opt/stack/data/nova/instances/384e5528-a8d3-49f3-bc21-e7dbf3d14cb5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:23:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "/opt/stack/data/nova/instances/384e5528-a8d3-49f3-bc21-e7dbf3d14cb5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:23:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.222s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:23:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:23:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.177s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/384e5528-a8d3-49f3-bc21-e7dbf3d14cb5/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/384e5528-a8d3-49f3-bc21-e7dbf3d14cb5/disk 1073741824" returned: 0 in 0.072s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:23:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Acquiring lock "46ffb192-ad11-416e-9094-c8e080b5414e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:23:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Lock "46ffb192-ad11-416e-9094-c8e080b5414e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:23:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Acquiring lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:23:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:23:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:23:26 user nova-compute[74189]: INFO nova.compute.manager [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Terminating instance
Oct 25 21:23:26 user nova-compute[74189]: DEBUG nova.compute.manager [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:23:26 user nova-compute[74189]: DEBUG nova.network.neutron [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Successfully created port: e2b72ea5-94f6-47f7-a022-55462da4489b {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:23:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.243s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:26 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Checking if we can resize image /opt/stack/data/nova/instances/384e5528-a8d3-49f3-bc21-e7dbf3d14cb5/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:23:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/384e5528-a8d3-49f3-bc21-e7dbf3d14cb5/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-4258cc0c-d0c6-4013-ae91-4aaf1041c9da req-625cdcbd-5b95-4e6f-940e-8b54445c9e86 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-unplugged-35311a59-a404-4759-8125-ac222750d5fa {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4258cc0c-d0c6-4013-ae91-4aaf1041c9da req-625cdcbd-5b95-4e6f-940e-8b54445c9e86 service nova] Acquiring lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4258cc0c-d0c6-4013-ae91-4aaf1041c9da req-625cdcbd-5b95-4e6f-940e-8b54445c9e86 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4258cc0c-d0c6-4013-ae91-4aaf1041c9da req-625cdcbd-5b95-4e6f-940e-8b54445c9e86 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-4258cc0c-d0c6-4013-ae91-4aaf1041c9da req-625cdcbd-5b95-4e6f-940e-8b54445c9e86 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] No waiting events found dispatching network-vif-unplugged-35311a59-a404-4759-8125-ac222750d5fa {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-4258cc0c-d0c6-4013-ae91-4aaf1041c9da req-625cdcbd-5b95-4e6f-940e-8b54445c9e86 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-unplugged-35311a59-a404-4759-8125-ac222750d5fa for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/384e5528-a8d3-49f3-bc21-e7dbf3d14cb5/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Cannot resize image /opt/stack/data/nova/instances/384e5528-a8d3-49f3-bc21-e7dbf3d14cb5/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Ensure instance console log exists: /opt/stack/data/nova/instances/384e5528-a8d3-49f3-bc21-e7dbf3d14cb5/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-11249869-f10e-465b-95a2-ac4a3b3e7df7 req-5e8ed248-ac50-46b9-a141-4ed983e203d2 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-unplugged-f967dd2c-da19-4645-b52e-2d79f61baabe {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-11249869-f10e-465b-95a2-ac4a3b3e7df7 req-5e8ed248-ac50-46b9-a141-4ed983e203d2 service nova] Acquiring lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-11249869-f10e-465b-95a2-ac4a3b3e7df7 req-5e8ed248-ac50-46b9-a141-4ed983e203d2 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-11249869-f10e-465b-95a2-ac4a3b3e7df7 req-5e8ed248-ac50-46b9-a141-4ed983e203d2 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-11249869-f10e-465b-95a2-ac4a3b3e7df7 req-5e8ed248-ac50-46b9-a141-4ed983e203d2 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] No waiting events found dispatching network-vif-unplugged-f967dd2c-da19-4645-b52e-2d79f61baabe {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-11249869-f10e-465b-95a2-ac4a3b3e7df7 req-5e8ed248-ac50-46b9-a141-4ed983e203d2 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-unplugged-f967dd2c-da19-4645-b52e-2d79f61baabe for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-5db4858c-0649-4cbd-a250-dfdc439bfd30 req-32435aea-884b-4825-9e1e-330c639cf62c service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-unplugged-bf1d7d42-01d4-4d66-814b-00a055fd82a5 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-5db4858c-0649-4cbd-a250-dfdc439bfd30 req-32435aea-884b-4825-9e1e-330c639cf62c service nova] Acquiring lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-5db4858c-0649-4cbd-a250-dfdc439bfd30 req-32435aea-884b-4825-9e1e-330c639cf62c service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-5db4858c-0649-4cbd-a250-dfdc439bfd30 req-32435aea-884b-4825-9e1e-330c639cf62c service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-5db4858c-0649-4cbd-a250-dfdc439bfd30 req-32435aea-884b-4825-9e1e-330c639cf62c service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] No waiting events found dispatching network-vif-unplugged-bf1d7d42-01d4-4d66-814b-00a055fd82a5 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-5db4858c-0649-4cbd-a250-dfdc439bfd30 req-32435aea-884b-4825-9e1e-330c639cf62c service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-unplugged-bf1d7d42-01d4-4d66-814b-00a055fd82a5 for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG nova.network.neutron [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Successfully updated port: e2b72ea5-94f6-47f7-a022-55462da4489b {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "refresh_cache-384e5528-a8d3-49f3-bc21-e7dbf3d14cb5" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquired lock "refresh_cache-384e5528-a8d3-49f3-bc21-e7dbf3d14cb5" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG nova.network.neutron [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG nova.network.neutron [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG nova.network.neutron [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Updating instance_info_cache with network_info: [{"id": "e2b72ea5-94f6-47f7-a022-55462da4489b", "address": "fa:16:3e:3c:b4:38", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b72ea5-94", "ovs_interfaceid": "e2b72ea5-94f6-47f7-a022-55462da4489b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:23:28 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Instance destroyed successfully.
Oct 25 21:23:28 user nova-compute[74189]: DEBUG nova.objects.instance [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Lazy-loading 'resources' on Instance uuid 46ffb192-ad11-416e-9094-c8e080b5414e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920835665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-920835665',id=15,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7FZk64RryMLyk++QiCGXXc6F4kczfNZkLF/M8gV7fC8oRD+LglFRr9PqpSbI3FpMuDRig++iLTLZch4e1RR5Oy04z44+nk2RSdOAieaA1OaHo6pDDmUX+imOxyUbWyrg==',key_name='tempest-keypair-2022750063',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:22:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f78ddc9861f9455aa58a9a532548023a',ramdisk_id='',reservation_id='r-yuvohw46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-994959279',owner_user_name='tempest-TaggedBootDevicesTest_v242-994959279-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:22:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ccd825e31941ce9a876d85b607e02f',uuid=46ffb192-ad11-416e-9094-c8e080b5414e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35311a59-a404-4759-8125-ac222750d5fa", "address": "fa:16:3e:b5:8d:bc", "network": {"id": "477a555b-610a-4b4f-8e0e-efd52c856097", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1102892168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35311a59-a4", "ovs_interfaceid": "35311a59-a404-4759-8125-ac222750d5fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converting VIF {"id": "35311a59-a404-4759-8125-ac222750d5fa", "address": "fa:16:3e:b5:8d:bc", "network": {"id": "477a555b-610a-4b4f-8e0e-efd52c856097", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1102892168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35311a59-a4", "ovs_interfaceid": "35311a59-a404-4759-8125-ac222750d5fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:8d:bc,bridge_name='br-int',has_traffic_filtering=True,id=35311a59-a404-4759-8125-ac222750d5fa,network=Network(477a555b-610a-4b4f-8e0e-efd52c856097),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35311a59-a4') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG os_vif [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:8d:bc,bridge_name='br-int',has_traffic_filtering=True,id=35311a59-a404-4759-8125-ac222750d5fa,network=Network(477a555b-610a-4b4f-8e0e-efd52c856097),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35311a59-a4') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Releasing lock "refresh_cache-384e5528-a8d3-49f3-bc21-e7dbf3d14cb5" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG nova.compute.manager [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Instance network_info: |[{"id": "e2b72ea5-94f6-47f7-a022-55462da4489b", "address": "fa:16:3e:3c:b4:38", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b72ea5-94", "ovs_interfaceid": "e2b72ea5-94f6-47f7-a022-55462da4489b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35311a59-a4, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Start _get_guest_xml network_info=[{"id": "e2b72ea5-94f6-47f7-a022-55462da4489b", "address": "fa:16:3e:3c:b4:38", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b72ea5-94", "ovs_interfaceid": "e2b72ea5-94f6-47f7-a022-55462da4489b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:23:28 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:23:28 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:23:28 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:23:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1512350029',display_name='tempest-AttachVolumeNegativeTest-server-1512350029',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1512350029',id=20,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+YEUY1YHXW3JAMnFO6xYHmvwKUIw8ypLGhtk2EH7qo1Xjhm46LgT+eu3jufCZhleSf/mIOo/qByDRHQ1xlJdkkCG1PaEH7zQNdwoYHck1alrKuzhSAeCy2lkROjLq5zg==',key_name='tempest-keypair-1973341440',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a555d708aa644d586d5edad7db837b4',ramdisk_id='',reservation_id='r-kco2e0g4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-979681322',owner_user_name='tempest-AttachVolumeNegativeTest-979681322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:23:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2f19a398fd9486fbef04eebad62a0cb',uuid=384e5528-a8d3-49f3-bc21-e7dbf3d14cb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2b72ea5-94f6-47f7-a022-55462da4489b", "address": "fa:16:3e:3c:b4:38", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b72ea5-94", "ovs_interfaceid": "e2b72ea5-94f6-47f7-a022-55462da4489b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:23:28 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Converting VIF {"id": "e2b72ea5-94f6-47f7-a022-55462da4489b", "address": "fa:16:3e:3c:b4:38", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b72ea5-94", "ovs_interfaceid": "e2b72ea5-94f6-47f7-a022-55462da4489b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:b4:38,bridge_name='br-int',has_traffic_filtering=True,id=e2b72ea5-94f6-47f7-a022-55462da4489b,network=Network(5029031b-e67b-4f60-bc17-781cbdc88b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2b72ea5-94') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.objects.instance [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lazy-loading 'pci_devices' on Instance uuid 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=23bdceaf-5bf7-4b4b-99ed-d1a084722749) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:23:29 user nova-compute[74189]:   <uuid>384e5528-a8d3-49f3-bc21-e7dbf3d14cb5</uuid>
Oct 25 21:23:29 user nova-compute[74189]:   <name>instance-00000014</name>
Oct 25 21:23:29 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:23:29 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:23:29 user nova-compute[74189]:   <metadata>
Oct 25 21:23:29 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:23:29 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:23:29 user nova-compute[74189]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1512350029</nova:name>
Oct 25 21:23:29 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:23:28</nova:creationTime>
Oct 25 21:23:29 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:23:29 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:23:29 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:23:29 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:23:29 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:23:29 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:23:29 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:23:29 user nova-compute[74189]:       <nova:owner>
Oct 25 21:23:29 user nova-compute[74189]:         <nova:user uuid="a2f19a398fd9486fbef04eebad62a0cb">tempest-AttachVolumeNegativeTest-979681322-project-member</nova:user>
Oct 25 21:23:29 user nova-compute[74189]:         <nova:project uuid="4a555d708aa644d586d5edad7db837b4">tempest-AttachVolumeNegativeTest-979681322</nova:project>
Oct 25 21:23:29 user nova-compute[74189]:       </nova:owner>
Oct 25 21:23:29 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:23:29 user nova-compute[74189]:       <nova:ports>
Oct 25 21:23:29 user nova-compute[74189]:         <nova:port uuid="e2b72ea5-94f6-47f7-a022-55462da4489b">
Oct 25 21:23:29 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 21:23:29 user nova-compute[74189]:         </nova:port>
Oct 25 21:23:29 user nova-compute[74189]:       </nova:ports>
Oct 25 21:23:29 user nova-compute[74189]:     </nova:instance>
Oct 25 21:23:29 user nova-compute[74189]:   </metadata>
Oct 25 21:23:29 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:23:29 user nova-compute[74189]:     <system>
Oct 25 21:23:29 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:23:29 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:23:29 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:23:29 user nova-compute[74189]:       <entry name="serial">384e5528-a8d3-49f3-bc21-e7dbf3d14cb5</entry>
Oct 25 21:23:29 user nova-compute[74189]:       <entry name="uuid">384e5528-a8d3-49f3-bc21-e7dbf3d14cb5</entry>
Oct 25 21:23:29 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:23:29 user nova-compute[74189]:     </system>
Oct 25 21:23:29 user nova-compute[74189]:   </sysinfo>
Oct 25 21:23:29 user nova-compute[74189]:   <os>
Oct 25 21:23:29 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:23:29 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:23:29 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:23:29 user nova-compute[74189]:   </os>
Oct 25 21:23:29 user nova-compute[74189]:   <features>
Oct 25 21:23:29 user nova-compute[74189]:     <acpi/>
Oct 25 21:23:29 user nova-compute[74189]:     <apic/>
Oct 25 21:23:29 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:23:29 user nova-compute[74189]:   </features>
Oct 25 21:23:29 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:23:29 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:23:29 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:23:29 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:23:29 user nova-compute[74189]:   </clock>
Oct 25 21:23:29 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:23:29 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:23:29 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:23:29 user nova-compute[74189]:   </cpu>
Oct 25 21:23:29 user nova-compute[74189]:   <devices>
Oct 25 21:23:29 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:23:29 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:23:29 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/384e5528-a8d3-49f3-bc21-e7dbf3d14cb5/disk"/>
Oct 25 21:23:29 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:23:29 user nova-compute[74189]:     </disk>
Oct 25 21:23:29 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:23:29 user nova-compute[74189]:       <mac address="fa:16:3e:3c:b4:38"/>
Oct 25 21:23:29 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:23:29 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:23:29 user nova-compute[74189]:       <target dev="tape2b72ea5-94"/>
Oct 25 21:23:29 user nova-compute[74189]:     </interface>
Oct 25 21:23:29 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:23:29 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/384e5528-a8d3-49f3-bc21-e7dbf3d14cb5/console.log" append="off"/>
Oct 25 21:23:29 user nova-compute[74189]:     </serial>
Oct 25 21:23:29 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:23:29 user nova-compute[74189]:     <video>
Oct 25 21:23:29 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:23:29 user nova-compute[74189]:     </video>
Oct 25 21:23:29 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:23:29 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:23:29 user nova-compute[74189]:     </rng>
Oct 25 21:23:29 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:23:29 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:23:29 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:23:29 user nova-compute[74189]:     </memballoon>
Oct 25 21:23:29 user nova-compute[74189]:   </devices>
Oct 25 21:23:29 user nova-compute[74189]: </domain>
Oct 25 21:23:29 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:23:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1512350029',display_name='tempest-AttachVolumeNegativeTest-server-1512350029',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1512350029',id=20,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+YEUY1YHXW3JAMnFO6xYHmvwKUIw8ypLGhtk2EH7qo1Xjhm46LgT+eu3jufCZhleSf/mIOo/qByDRHQ1xlJdkkCG1PaEH7zQNdwoYHck1alrKuzhSAeCy2lkROjLq5zg==',key_name='tempest-keypair-1973341440',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a555d708aa644d586d5edad7db837b4',ramdisk_id='',reservation_id='r-kco2e0g4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-979681322',owner_user_name='tempest-AttachVolumeNegativeTest-979681322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:23:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2f19a398fd9486fbef04eebad62a0cb',uuid=384e5528-a8d3-49f3-bc21-e7dbf3d14cb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2b72ea5-94f6-47f7-a022-55462da4489b", "address": "fa:16:3e:3c:b4:38", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b72ea5-94", "ovs_interfaceid": "e2b72ea5-94f6-47f7-a022-55462da4489b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Converting VIF {"id": "e2b72ea5-94f6-47f7-a022-55462da4489b", "address": "fa:16:3e:3c:b4:38", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b72ea5-94", "ovs_interfaceid": "e2b72ea5-94f6-47f7-a022-55462da4489b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:b4:38,bridge_name='br-int',has_traffic_filtering=True,id=e2b72ea5-94f6-47f7-a022-55462da4489b,network=Network(5029031b-e67b-4f60-bc17-781cbdc88b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2b72ea5-94') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG os_vif [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:b4:38,bridge_name='br-int',has_traffic_filtering=True,id=e2b72ea5-94f6-47f7-a022-55462da4489b,network=Network(5029031b-e67b-4f60-bc17-781cbdc88b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2b72ea5-94') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '31455bf0-5479-5821-9da7-1b632eaf843a', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:23:29 user nova-compute[74189]: INFO os_vif [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:8d:bc,bridge_name='br-int',has_traffic_filtering=True,id=35311a59-a404-4759-8125-ac222750d5fa,network=Network(477a555b-610a-4b4f-8e0e-efd52c856097),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35311a59-a4')
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920835665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-920835665',id=15,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7FZk64RryMLyk++QiCGXXc6F4kczfNZkLF/M8gV7fC8oRD+LglFRr9PqpSbI3FpMuDRig++iLTLZch4e1RR5Oy04z44+nk2RSdOAieaA1OaHo6pDDmUX+imOxyUbWyrg==',key_name='tempest-keypair-2022750063',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:22:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f78ddc9861f9455aa58a9a532548023a',ramdisk_id='',reservation_id='r-yuvohw46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-994959279',owner_user_name='tempest-TaggedBootDevicesTest_v242-994959279-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:22:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ccd825e31941ce9a876d85b607e02f',uuid=46ffb192-ad11-416e-9094-c8e080b5414e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "address": "fa:16:3e:b2:20:8d", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1d7d42-01", "ovs_interfaceid": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converting VIF {"id": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "address": "fa:16:3e:b2:20:8d", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1d7d42-01", "ovs_interfaceid": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:20:8d,bridge_name='br-int',has_traffic_filtering=True,id=bf1d7d42-01d4-4d66-814b-00a055fd82a5,network=Network(cabdedc4-8ff4-4fab-9935-925c40f2a8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbf1d7d42-01') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG os_vif [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:20:8d,bridge_name='br-int',has_traffic_filtering=True,id=bf1d7d42-01d4-4d66-814b-00a055fd82a5,network=Network(cabdedc4-8ff4-4fab-9935-925c40f2a8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbf1d7d42-01') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf1d7d42-01, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-2985bcda-a90e-47b2-a413-2bad0b0fe81a req-c188a38a-4ded-4263-9f80-caecd1ff5922 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-plugged-35311a59-a404-4759-8125-ac222750d5fa {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2985bcda-a90e-47b2-a413-2bad0b0fe81a req-c188a38a-4ded-4263-9f80-caecd1ff5922 service nova] Acquiring lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2985bcda-a90e-47b2-a413-2bad0b0fe81a req-c188a38a-4ded-4263-9f80-caecd1ff5922 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2985bcda-a90e-47b2-a413-2bad0b0fe81a req-c188a38a-4ded-4263-9f80-caecd1ff5922 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-2985bcda-a90e-47b2-a413-2bad0b0fe81a req-c188a38a-4ded-4263-9f80-caecd1ff5922 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] No waiting events found dispatching network-vif-plugged-35311a59-a404-4759-8125-ac222750d5fa {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:23:29 user nova-compute[74189]: WARNING nova.compute.manager [req-2985bcda-a90e-47b2-a413-2bad0b0fe81a req-c188a38a-4ded-4263-9f80-caecd1ff5922 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received unexpected event network-vif-plugged-35311a59-a404-4759-8125-ac222750d5fa for instance with vm_state active and task_state deleting.
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-2985bcda-a90e-47b2-a413-2bad0b0fe81a req-c188a38a-4ded-4263-9f80-caecd1ff5922 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-unplugged-4caa88c4-c581-41eb-b8f8-a291aaef3ad4 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2985bcda-a90e-47b2-a413-2bad0b0fe81a req-c188a38a-4ded-4263-9f80-caecd1ff5922 service nova] Acquiring lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2985bcda-a90e-47b2-a413-2bad0b0fe81a req-c188a38a-4ded-4263-9f80-caecd1ff5922 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2985bcda-a90e-47b2-a413-2bad0b0fe81a req-c188a38a-4ded-4263-9f80-caecd1ff5922 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-2985bcda-a90e-47b2-a413-2bad0b0fe81a req-c188a38a-4ded-4263-9f80-caecd1ff5922 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] No waiting events found dispatching network-vif-unplugged-4caa88c4-c581-41eb-b8f8-a291aaef3ad4 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-2985bcda-a90e-47b2-a413-2bad0b0fe81a req-c188a38a-4ded-4263-9f80-caecd1ff5922 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-unplugged-4caa88c4-c581-41eb-b8f8-a291aaef3ad4 for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-2985bcda-a90e-47b2-a413-2bad0b0fe81a req-c188a38a-4ded-4263-9f80-caecd1ff5922 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-plugged-4caa88c4-c581-41eb-b8f8-a291aaef3ad4 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2985bcda-a90e-47b2-a413-2bad0b0fe81a req-c188a38a-4ded-4263-9f80-caecd1ff5922 service nova] Acquiring lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2985bcda-a90e-47b2-a413-2bad0b0fe81a req-c188a38a-4ded-4263-9f80-caecd1ff5922 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2985bcda-a90e-47b2-a413-2bad0b0fe81a req-c188a38a-4ded-4263-9f80-caecd1ff5922 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-2985bcda-a90e-47b2-a413-2bad0b0fe81a req-c188a38a-4ded-4263-9f80-caecd1ff5922 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] No waiting events found dispatching network-vif-plugged-4caa88c4-c581-41eb-b8f8-a291aaef3ad4 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:23:29 user nova-compute[74189]: WARNING nova.compute.manager [req-2985bcda-a90e-47b2-a413-2bad0b0fe81a req-c188a38a-4ded-4263-9f80-caecd1ff5922 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received unexpected event network-vif-plugged-4caa88c4-c581-41eb-b8f8-a291aaef3ad4 for instance with vm_state active and task_state deleting.
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-2985bcda-a90e-47b2-a413-2bad0b0fe81a req-c188a38a-4ded-4263-9f80-caecd1ff5922 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-unplugged-b60a817a-3478-48d7-b117-bee088bc7e86 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2985bcda-a90e-47b2-a413-2bad0b0fe81a req-c188a38a-4ded-4263-9f80-caecd1ff5922 service nova] Acquiring lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2985bcda-a90e-47b2-a413-2bad0b0fe81a req-c188a38a-4ded-4263-9f80-caecd1ff5922 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2985bcda-a90e-47b2-a413-2bad0b0fe81a req-c188a38a-4ded-4263-9f80-caecd1ff5922 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-2985bcda-a90e-47b2-a413-2bad0b0fe81a req-c188a38a-4ded-4263-9f80-caecd1ff5922 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] No waiting events found dispatching network-vif-unplugged-b60a817a-3478-48d7-b117-bee088bc7e86 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-2985bcda-a90e-47b2-a413-2bad0b0fe81a req-c188a38a-4ded-4263-9f80-caecd1ff5922 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-unplugged-b60a817a-3478-48d7-b117-bee088bc7e86 for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-2985bcda-a90e-47b2-a413-2bad0b0fe81a req-c188a38a-4ded-4263-9f80-caecd1ff5922 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-plugged-b60a817a-3478-48d7-b117-bee088bc7e86 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2985bcda-a90e-47b2-a413-2bad0b0fe81a req-c188a38a-4ded-4263-9f80-caecd1ff5922 service nova] Acquiring lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2985bcda-a90e-47b2-a413-2bad0b0fe81a req-c188a38a-4ded-4263-9f80-caecd1ff5922 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2985bcda-a90e-47b2-a413-2bad0b0fe81a req-c188a38a-4ded-4263-9f80-caecd1ff5922 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-2985bcda-a90e-47b2-a413-2bad0b0fe81a req-c188a38a-4ded-4263-9f80-caecd1ff5922 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] No waiting events found dispatching network-vif-plugged-b60a817a-3478-48d7-b117-bee088bc7e86 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:23:29 user nova-compute[74189]: WARNING nova.compute.manager [req-2985bcda-a90e-47b2-a413-2bad0b0fe81a req-c188a38a-4ded-4263-9f80-caecd1ff5922 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received unexpected event network-vif-plugged-b60a817a-3478-48d7-b117-bee088bc7e86 for instance with vm_state active and task_state deleting.
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2b72ea5-94, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape2b72ea5-94, col_values=(('qos', UUID('53744c4f-04b8-44dc-97bd-48b89cba5150')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape2b72ea5-94, col_values=(('external_ids', {'iface-id': 'e2b72ea5-94f6-47f7-a022-55462da4489b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:b4:38', 'vm-uuid': '384e5528-a8d3-49f3-bc21-e7dbf3d14cb5'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: INFO os_vif [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:b4:38,bridge_name='br-int',has_traffic_filtering=True,id=e2b72ea5-94f6-47f7-a022-55462da4489b,network=Network(5029031b-e67b-4f60-bc17-781cbdc88b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2b72ea5-94')
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=69941af7-64ee-42a1-85a7-618b45c13fe2) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: INFO os_vif [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:20:8d,bridge_name='br-int',has_traffic_filtering=True,id=bf1d7d42-01d4-4d66-814b-00a055fd82a5,network=Network(cabdedc4-8ff4-4fab-9935-925c40f2a8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbf1d7d42-01')
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920835665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-920835665',id=15,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7FZk64RryMLyk++QiCGXXc6F4kczfNZkLF/M8gV7fC8oRD+LglFRr9PqpSbI3FpMuDRig++iLTLZch4e1RR5Oy04z44+nk2RSdOAieaA1OaHo6pDDmUX+imOxyUbWyrg==',key_name='tempest-keypair-2022750063',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:22:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f78ddc9861f9455aa58a9a532548023a',ramdisk_id='',reservation_id='r-yuvohw46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-994959279',owner_user_name='tempest-TaggedBootDevicesTest_v242-994959279-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:22:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ccd825e31941ce9a876d85b607e02f',uuid=46ffb192-ad11-416e-9094-c8e080b5414e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f967dd2c-da19-4645-b52e-2d79f61baabe", "address": "fa:16:3e:d1:88:5b", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf967dd2c-da", "ovs_interfaceid": "f967dd2c-da19-4645-b52e-2d79f61baabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converting VIF {"id": "f967dd2c-da19-4645-b52e-2d79f61baabe", "address": "fa:16:3e:d1:88:5b", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf967dd2c-da", "ovs_interfaceid": "f967dd2c-da19-4645-b52e-2d79f61baabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:88:5b,bridge_name='br-int',has_traffic_filtering=True,id=f967dd2c-da19-4645-b52e-2d79f61baabe,network=Network(cabdedc4-8ff4-4fab-9935-925c40f2a8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf967dd2c-da') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG os_vif [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:88:5b,bridge_name='br-int',has_traffic_filtering=True,id=f967dd2c-da19-4645-b52e-2d79f61baabe,network=Network(cabdedc4-8ff4-4fab-9935-925c40f2a8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf967dd2c-da') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] No VIF found with MAC fa:16:3e:3c:b4:38, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf967dd2c-da, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cb818b4a-72f5-4944-a22c-c2343470b281) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-96e7a04d-f042-4a8d-8eb0-23b09088d155 req-9c6b21f2-4027-4aaf-81ed-63fc844584e1 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-plugged-f967dd2c-da19-4645-b52e-2d79f61baabe {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-96e7a04d-f042-4a8d-8eb0-23b09088d155 req-9c6b21f2-4027-4aaf-81ed-63fc844584e1 service nova] Acquiring lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-96e7a04d-f042-4a8d-8eb0-23b09088d155 req-9c6b21f2-4027-4aaf-81ed-63fc844584e1 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-96e7a04d-f042-4a8d-8eb0-23b09088d155 req-9c6b21f2-4027-4aaf-81ed-63fc844584e1 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-96e7a04d-f042-4a8d-8eb0-23b09088d155 req-9c6b21f2-4027-4aaf-81ed-63fc844584e1 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] No waiting events found dispatching network-vif-plugged-f967dd2c-da19-4645-b52e-2d79f61baabe {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:23:29 user nova-compute[74189]: WARNING nova.compute.manager [req-96e7a04d-f042-4a8d-8eb0-23b09088d155 req-9c6b21f2-4027-4aaf-81ed-63fc844584e1 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received unexpected event network-vif-plugged-f967dd2c-da19-4645-b52e-2d79f61baabe for instance with vm_state active and task_state deleting.
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-96e7a04d-f042-4a8d-8eb0-23b09088d155 req-9c6b21f2-4027-4aaf-81ed-63fc844584e1 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-unplugged-5f18e575-80eb-41e8-8615-bcbbe00ff9de {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-96e7a04d-f042-4a8d-8eb0-23b09088d155 req-9c6b21f2-4027-4aaf-81ed-63fc844584e1 service nova] Acquiring lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-96e7a04d-f042-4a8d-8eb0-23b09088d155 req-9c6b21f2-4027-4aaf-81ed-63fc844584e1 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-96e7a04d-f042-4a8d-8eb0-23b09088d155 req-9c6b21f2-4027-4aaf-81ed-63fc844584e1 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-96e7a04d-f042-4a8d-8eb0-23b09088d155 req-9c6b21f2-4027-4aaf-81ed-63fc844584e1 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] No waiting events found dispatching network-vif-unplugged-5f18e575-80eb-41e8-8615-bcbbe00ff9de {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-96e7a04d-f042-4a8d-8eb0-23b09088d155 req-9c6b21f2-4027-4aaf-81ed-63fc844584e1 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-unplugged-5f18e575-80eb-41e8-8615-bcbbe00ff9de for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-96e7a04d-f042-4a8d-8eb0-23b09088d155 req-9c6b21f2-4027-4aaf-81ed-63fc844584e1 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-plugged-5f18e575-80eb-41e8-8615-bcbbe00ff9de {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-96e7a04d-f042-4a8d-8eb0-23b09088d155 req-9c6b21f2-4027-4aaf-81ed-63fc844584e1 service nova] Acquiring lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-96e7a04d-f042-4a8d-8eb0-23b09088d155 req-9c6b21f2-4027-4aaf-81ed-63fc844584e1 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-96e7a04d-f042-4a8d-8eb0-23b09088d155 req-9c6b21f2-4027-4aaf-81ed-63fc844584e1 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-96e7a04d-f042-4a8d-8eb0-23b09088d155 req-9c6b21f2-4027-4aaf-81ed-63fc844584e1 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] No waiting events found dispatching network-vif-plugged-5f18e575-80eb-41e8-8615-bcbbe00ff9de {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:23:29 user nova-compute[74189]: WARNING nova.compute.manager [req-96e7a04d-f042-4a8d-8eb0-23b09088d155 req-9c6b21f2-4027-4aaf-81ed-63fc844584e1 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received unexpected event network-vif-plugged-5f18e575-80eb-41e8-8615-bcbbe00ff9de for instance with vm_state active and task_state deleting.
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-96e7a04d-f042-4a8d-8eb0-23b09088d155 req-9c6b21f2-4027-4aaf-81ed-63fc844584e1 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-unplugged-94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-96e7a04d-f042-4a8d-8eb0-23b09088d155 req-9c6b21f2-4027-4aaf-81ed-63fc844584e1 service nova] Acquiring lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-96e7a04d-f042-4a8d-8eb0-23b09088d155 req-9c6b21f2-4027-4aaf-81ed-63fc844584e1 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-96e7a04d-f042-4a8d-8eb0-23b09088d155 req-9c6b21f2-4027-4aaf-81ed-63fc844584e1 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-96e7a04d-f042-4a8d-8eb0-23b09088d155 req-9c6b21f2-4027-4aaf-81ed-63fc844584e1 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] No waiting events found dispatching network-vif-unplugged-94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-96e7a04d-f042-4a8d-8eb0-23b09088d155 req-9c6b21f2-4027-4aaf-81ed-63fc844584e1 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-unplugged-94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56 for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-96e7a04d-f042-4a8d-8eb0-23b09088d155 req-9c6b21f2-4027-4aaf-81ed-63fc844584e1 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-plugged-94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-96e7a04d-f042-4a8d-8eb0-23b09088d155 req-9c6b21f2-4027-4aaf-81ed-63fc844584e1 service nova] Acquiring lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-96e7a04d-f042-4a8d-8eb0-23b09088d155 req-9c6b21f2-4027-4aaf-81ed-63fc844584e1 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-96e7a04d-f042-4a8d-8eb0-23b09088d155 req-9c6b21f2-4027-4aaf-81ed-63fc844584e1 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-96e7a04d-f042-4a8d-8eb0-23b09088d155 req-9c6b21f2-4027-4aaf-81ed-63fc844584e1 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] No waiting events found dispatching network-vif-plugged-94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:23:29 user nova-compute[74189]: WARNING nova.compute.manager [req-96e7a04d-f042-4a8d-8eb0-23b09088d155 req-9c6b21f2-4027-4aaf-81ed-63fc844584e1 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received unexpected event network-vif-plugged-94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56 for instance with vm_state active and task_state deleting.
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: INFO os_vif [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:88:5b,bridge_name='br-int',has_traffic_filtering=True,id=f967dd2c-da19-4645-b52e-2d79f61baabe,network=Network(cabdedc4-8ff4-4fab-9935-925c40f2a8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf967dd2c-da')
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920835665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-920835665',id=15,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7FZk64RryMLyk++QiCGXXc6F4kczfNZkLF/M8gV7fC8oRD+LglFRr9PqpSbI3FpMuDRig++iLTLZch4e1RR5Oy04z44+nk2RSdOAieaA1OaHo6pDDmUX+imOxyUbWyrg==',key_name='tempest-keypair-2022750063',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:22:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f78ddc9861f9455aa58a9a532548023a',ramdisk_id='',reservation_id='r-yuvohw46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-994959279',owner_user_name='tempest-TaggedBootDevicesTest_v242-994959279-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:22:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ccd825e31941ce9a876d85b607e02f',uuid=46ffb192-ad11-416e-9094-c8e080b5414e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f18e575-80eb-41e8-8615-bcbbe00ff9de", "address": "fa:16:3e:c2:d7:0b", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f18e575-80", "ovs_interfaceid": "5f18e575-80eb-41e8-8615-bcbbe00ff9de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converting VIF {"id": "5f18e575-80eb-41e8-8615-bcbbe00ff9de", "address": "fa:16:3e:c2:d7:0b", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f18e575-80", "ovs_interfaceid": "5f18e575-80eb-41e8-8615-bcbbe00ff9de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:d7:0b,bridge_name='br-int',has_traffic_filtering=True,id=5f18e575-80eb-41e8-8615-bcbbe00ff9de,network=Network(cabdedc4-8ff4-4fab-9935-925c40f2a8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f18e575-80') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG os_vif [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:d7:0b,bridge_name='br-int',has_traffic_filtering=True,id=5f18e575-80eb-41e8-8615-bcbbe00ff9de,network=Network(cabdedc4-8ff4-4fab-9935-925c40f2a8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f18e575-80') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f18e575-80, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7feb899a-1f14-4344-8b75-8cf4bad02a5f) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-8857c9f9-9b3b-4e04-97cd-71e5dcb1face req-c0c0d135-ce63-441b-a2d8-884d5202c426 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-plugged-bf1d7d42-01d4-4d66-814b-00a055fd82a5 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8857c9f9-9b3b-4e04-97cd-71e5dcb1face req-c0c0d135-ce63-441b-a2d8-884d5202c426 service nova] Acquiring lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8857c9f9-9b3b-4e04-97cd-71e5dcb1face req-c0c0d135-ce63-441b-a2d8-884d5202c426 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8857c9f9-9b3b-4e04-97cd-71e5dcb1face req-c0c0d135-ce63-441b-a2d8-884d5202c426 service nova] Lock "46ffb192-ad11-416e-9094-c8e080b5414e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-8857c9f9-9b3b-4e04-97cd-71e5dcb1face req-c0c0d135-ce63-441b-a2d8-884d5202c426 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] No waiting events found dispatching network-vif-plugged-bf1d7d42-01d4-4d66-814b-00a055fd82a5 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:23:29 user nova-compute[74189]: WARNING nova.compute.manager [req-8857c9f9-9b3b-4e04-97cd-71e5dcb1face req-c0c0d135-ce63-441b-a2d8-884d5202c426 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received unexpected event network-vif-plugged-bf1d7d42-01d4-4d66-814b-00a055fd82a5 for instance with vm_state active and task_state deleting.
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-8857c9f9-9b3b-4e04-97cd-71e5dcb1face req-c0c0d135-ce63-441b-a2d8-884d5202c426 service nova] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Received event network-changed-e2b72ea5-94f6-47f7-a022-55462da4489b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-8857c9f9-9b3b-4e04-97cd-71e5dcb1face req-c0c0d135-ce63-441b-a2d8-884d5202c426 service nova] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Refreshing instance network info cache due to event network-changed-e2b72ea5-94f6-47f7-a022-55462da4489b. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8857c9f9-9b3b-4e04-97cd-71e5dcb1face req-c0c0d135-ce63-441b-a2d8-884d5202c426 service nova] Acquiring lock "refresh_cache-384e5528-a8d3-49f3-bc21-e7dbf3d14cb5" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8857c9f9-9b3b-4e04-97cd-71e5dcb1face req-c0c0d135-ce63-441b-a2d8-884d5202c426 service nova] Acquired lock "refresh_cache-384e5528-a8d3-49f3-bc21-e7dbf3d14cb5" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.network.neutron [req-8857c9f9-9b3b-4e04-97cd-71e5dcb1face req-c0c0d135-ce63-441b-a2d8-884d5202c426 service nova] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Refreshing network info cache for port e2b72ea5-94f6-47f7-a022-55462da4489b {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: INFO os_vif [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:d7:0b,bridge_name='br-int',has_traffic_filtering=True,id=5f18e575-80eb-41e8-8615-bcbbe00ff9de,network=Network(cabdedc4-8ff4-4fab-9935-925c40f2a8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f18e575-80')
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920835665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-920835665',id=15,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7FZk64RryMLyk++QiCGXXc6F4kczfNZkLF/M8gV7fC8oRD+LglFRr9PqpSbI3FpMuDRig++iLTLZch4e1RR5Oy04z44+nk2RSdOAieaA1OaHo6pDDmUX+imOxyUbWyrg==',key_name='tempest-keypair-2022750063',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:22:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f78ddc9861f9455aa58a9a532548023a',ramdisk_id='',reservation_id='r-yuvohw46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-994959279',owner_user_name='tempest-TaggedBootDevicesTest_v242-994959279-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:22:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ccd825e31941ce9a876d85b607e02f',uuid=46ffb192-ad11-416e-9094-c8e080b5414e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4caa88c4-c581-41eb-b8f8-a291aaef3ad4", "address": "fa:16:3e:24:e8:88", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4caa88c4-c5", "ovs_interfaceid": "4caa88c4-c581-41eb-b8f8-a291aaef3ad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converting VIF {"id": "4caa88c4-c581-41eb-b8f8-a291aaef3ad4", "address": "fa:16:3e:24:e8:88", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4caa88c4-c5", "ovs_interfaceid": "4caa88c4-c581-41eb-b8f8-a291aaef3ad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:e8:88,bridge_name='br-int',has_traffic_filtering=True,id=4caa88c4-c581-41eb-b8f8-a291aaef3ad4,network=Network(cabdedc4-8ff4-4fab-9935-925c40f2a8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4caa88c4-c5') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG os_vif [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:e8:88,bridge_name='br-int',has_traffic_filtering=True,id=4caa88c4-c581-41eb-b8f8-a291aaef3ad4,network=Network(cabdedc4-8ff4-4fab-9935-925c40f2a8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4caa88c4-c5') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4caa88c4-c5, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f711d2f2-4968-48aa-917e-8221d6d5f88c) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: INFO os_vif [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:e8:88,bridge_name='br-int',has_traffic_filtering=True,id=4caa88c4-c581-41eb-b8f8-a291aaef3ad4,network=Network(cabdedc4-8ff4-4fab-9935-925c40f2a8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4caa88c4-c5')
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920835665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-920835665',id=15,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7FZk64RryMLyk++QiCGXXc6F4kczfNZkLF/M8gV7fC8oRD+LglFRr9PqpSbI3FpMuDRig++iLTLZch4e1RR5Oy04z44+nk2RSdOAieaA1OaHo6pDDmUX+imOxyUbWyrg==',key_name='tempest-keypair-2022750063',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:22:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f78ddc9861f9455aa58a9a532548023a',ramdisk_id='',reservation_id='r-yuvohw46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-994959279',owner_user_name='tempest-TaggedBootDevicesTest_v242-994959279-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:22:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ccd825e31941ce9a876d85b607e02f',uuid=46ffb192-ad11-416e-9094-c8e080b5414e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b60a817a-3478-48d7-b117-bee088bc7e86", "address": "fa:16:3e:0f:4d:3e", "network": {"id": "68ea97b8-852c-464a-9ccb-b2dc55c63e47", "bridge": "br-int", "label": "tempest-device-tagging-net2-670429054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60a817a-34", "ovs_interfaceid": "b60a817a-3478-48d7-b117-bee088bc7e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converting VIF {"id": "b60a817a-3478-48d7-b117-bee088bc7e86", "address": "fa:16:3e:0f:4d:3e", "network": {"id": "68ea97b8-852c-464a-9ccb-b2dc55c63e47", "bridge": "br-int", "label": "tempest-device-tagging-net2-670429054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60a817a-34", "ovs_interfaceid": "b60a817a-3478-48d7-b117-bee088bc7e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:4d:3e,bridge_name='br-int',has_traffic_filtering=True,id=b60a817a-3478-48d7-b117-bee088bc7e86,network=Network(68ea97b8-852c-464a-9ccb-b2dc55c63e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb60a817a-34') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG os_vif [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:4d:3e,bridge_name='br-int',has_traffic_filtering=True,id=b60a817a-3478-48d7-b117-bee088bc7e86,network=Network(68ea97b8-852c-464a-9ccb-b2dc55c63e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb60a817a-34') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb60a817a-34, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3cf5594c-48a3-4734-b325-e486bf23fdd3) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: INFO os_vif [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:4d:3e,bridge_name='br-int',has_traffic_filtering=True,id=b60a817a-3478-48d7-b117-bee088bc7e86,network=Network(68ea97b8-852c-464a-9ccb-b2dc55c63e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb60a817a-34')
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T21:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-920835665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-920835665',id=15,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7FZk64RryMLyk++QiCGXXc6F4kczfNZkLF/M8gV7fC8oRD+LglFRr9PqpSbI3FpMuDRig++iLTLZch4e1RR5Oy04z44+nk2RSdOAieaA1OaHo6pDDmUX+imOxyUbWyrg==',key_name='tempest-keypair-2022750063',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:22:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f78ddc9861f9455aa58a9a532548023a',ramdisk_id='',reservation_id='r-yuvohw46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-994959279',owner_user_name='tempest-TaggedBootDevicesTest_v242-994959279-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:22:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ccd825e31941ce9a876d85b607e02f',uuid=46ffb192-ad11-416e-9094-c8e080b5414e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56", "address": "fa:16:3e:b0:f9:54", "network": {"id": "68ea97b8-852c-464a-9ccb-b2dc55c63e47", "bridge": "br-int", "label": "tempest-device-tagging-net2-670429054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e0f5a2-44", "ovs_interfaceid": "94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converting VIF {"id": "94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56", "address": "fa:16:3e:b0:f9:54", "network": {"id": "68ea97b8-852c-464a-9ccb-b2dc55c63e47", "bridge": "br-int", "label": "tempest-device-tagging-net2-670429054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e0f5a2-44", "ovs_interfaceid": "94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f9:54,bridge_name='br-int',has_traffic_filtering=True,id=94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56,network=Network(68ea97b8-852c-464a-9ccb-b2dc55c63e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94e0f5a2-44') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG os_vif [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f9:54,bridge_name='br-int',has_traffic_filtering=True,id=94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56,network=Network(68ea97b8-852c-464a-9ccb-b2dc55c63e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94e0f5a2-44') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94e0f5a2-44, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=45a10a11-4abd-47df-a6a0-6c8d37c1cdc9) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:29 user nova-compute[74189]: INFO os_vif [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f9:54,bridge_name='br-int',has_traffic_filtering=True,id=94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56,network=Network(68ea97b8-852c-464a-9ccb-b2dc55c63e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94e0f5a2-44')
Oct 25 21:23:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kRpGoDPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:23:29 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:23:29 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2df2b3c-f85f-455d-9953-de660d280ff2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:23:29 user nova-compute[74189]: No targets found.
Oct 25 21:23:29 user nova-compute[74189]: iSNS:
Oct 25 21:23:29 user nova-compute[74189]: No targets found.
Oct 25 21:23:29 user nova-compute[74189]: STATIC:
Oct 25 21:23:29 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603
Oct 25 21:23:29 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:23:29 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:23:29 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706
Oct 25 21:23:29 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:23:29 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:23:29 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee
Oct 25 21:23:29 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:23:29 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:23:29 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78
Oct 25 21:23:29 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:23:29 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:23:29 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1
Oct 25 21:23:29 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:23:29 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:23:29 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:23:29 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:23:29 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:23:29 user nova-compute[74189]: FIRMWARE:
Oct 25 21:23:29 user nova-compute[74189]: No targets found.
Oct 25 21:23:29 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:23:29 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:23:29 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[23aa8d48-714b-4f84-957f-d37a3371ac91]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a9678f-00ed-470b-bed0-5c9eba13f254]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:23:29 user nova-compute[74189]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee (non-flash)
Oct 25 21:23:29 user nova-compute[74189]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:23:29 user nova-compute[74189]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 (non-flash)
Oct 25 21:23:29 user nova-compute[74189]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 (non-flash)
Oct 25 21:23:29 user nova-compute[74189]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)
Oct 25 21:23:29 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:23:29 user nova-compute[74189]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee (non-flash)
Oct 25 21:23:29 user nova-compute[74189]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:23:29 user nova-compute[74189]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 (non-flash)
Oct 25 21:23:29 user nova-compute[74189]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 (non-flash)
Oct 25 21:23:29 user nova-compute[74189]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)
Oct 25 21:23:29 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3041db400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee'): ({'sdc'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Removing single pathed devices sdc {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69d1d3c-b523-44d8-a22c-f5e7ea4b1b3d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ac5187-8f75-466e-9841-92c4b5b50b11]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Flushing IO for device /dev/sdc {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf54cc3-e462-4b21-8f65-786e591986ee]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:23:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37de1c8-85bf-4d3a-a58b-5db9a7306346]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] SCSI volumes sdc have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5222ab01-561e-45db-a51d-5eaf58865347]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2033e789-02cf-4d85-acc8-c36948ee91ee]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee, portal: 172.16.0.220,3260]
Oct 25 21:23:30 user nova-compute[74189]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee, portal: 172.16.0.220,3260] successful.
Oct 25 21:23:30 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a545b3af-6d77-4506-b9c1-7c6d0320efee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b97e77-32b1-47c8-892a-bdb72cc77bfa]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] <== disconnect_volume: return (379ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'agWnbZlp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:23:30 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bf3424-5eff-4433-8c7a-82c6b0542ad9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:23:30 user nova-compute[74189]: No targets found.
Oct 25 21:23:30 user nova-compute[74189]: iSNS:
Oct 25 21:23:30 user nova-compute[74189]: No targets found.
Oct 25 21:23:30 user nova-compute[74189]: STATIC:
Oct 25 21:23:30 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603
Oct 25 21:23:30 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:23:30 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:23:30 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706
Oct 25 21:23:30 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:23:30 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:23:30 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78
Oct 25 21:23:30 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:23:30 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:23:30 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1
Oct 25 21:23:30 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:23:30 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:23:30 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:23:30 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:23:30 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:23:30 user nova-compute[74189]: FIRMWARE:
Oct 25 21:23:30 user nova-compute[74189]: No targets found.
Oct 25 21:23:30 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:23:30 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:23:30 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[24794c1e-aa2d-4548-b4f5-cf875c646247]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2105c57a-ca9e-4526-82e9-dfa30b930f92]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:23:30 user nova-compute[74189]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:23:30 user nova-compute[74189]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 (non-flash)
Oct 25 21:23:30 user nova-compute[74189]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 (non-flash)
Oct 25 21:23:30 user nova-compute[74189]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)
Oct 25 21:23:30 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:23:30 user nova-compute[74189]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:23:30 user nova-compute[74189]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 (non-flash)
Oct 25 21:23:30 user nova-compute[74189]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 (non-flash)
Oct 25 21:23:30 user nova-compute[74189]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)
Oct 25 21:23:30 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3041db400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706'): ({'sde'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Removing single pathed devices sde {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[955f6d47-baee-4712-ab3b-f248d958da3d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ad3695-7293-4da1-90c9-c4d3522b9403]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Flushing IO for device /dev/sde {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d3df9c-27ae-4a25-b9c1-c153c437cf47]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG nova.network.neutron [req-8857c9f9-9b3b-4e04-97cd-71e5dcb1face req-c0c0d135-ce63-441b-a2d8-884d5202c426 service nova] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Updated VIF entry in instance network info cache for port e2b72ea5-94f6-47f7-a022-55462da4489b. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG nova.network.neutron [req-8857c9f9-9b3b-4e04-97cd-71e5dcb1face req-c0c0d135-ce63-441b-a2d8-884d5202c426 service nova] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Updating instance_info_cache with network_info: [{"id": "e2b72ea5-94f6-47f7-a022-55462da4489b", "address": "fa:16:3e:3c:b4:38", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b72ea5-94", "ovs_interfaceid": "e2b72ea5-94f6-47f7-a022-55462da4489b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8857c9f9-9b3b-4e04-97cd-71e5dcb1face req-c0c0d135-ce63-441b-a2d8-884d5202c426 service nova] Releasing lock "refresh_cache-384e5528-a8d3-49f3-bc21-e7dbf3d14cb5" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b909b45-8805-42b4-aaca-a2e6b9804819]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] SCSI volumes sde have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c107bf7-7cb0-4cde-bff1-501011fe29cb]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d55503-a95a-42b9-81f2-444bf438d211]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706, portal: 172.16.0.220,3260]
Oct 25 21:23:30 user nova-compute[74189]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706, portal: 172.16.0.220,3260] successful.
Oct 25 21:23:30 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4460d0cc-0295-4c0b-9126-f84e0439c706 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[419a07c4-cdbc-4238-82b4-15e969f724f5]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] <== disconnect_volume: return (360ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yalSTDnC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:23:30 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[985a1471-88f8-49b1-8e9b-7d639039f364]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:23:30 user nova-compute[74189]: No targets found.
Oct 25 21:23:30 user nova-compute[74189]: iSNS:
Oct 25 21:23:30 user nova-compute[74189]: No targets found.
Oct 25 21:23:30 user nova-compute[74189]: STATIC:
Oct 25 21:23:30 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603
Oct 25 21:23:30 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:23:30 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:23:30 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78
Oct 25 21:23:30 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:23:30 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:23:30 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1
Oct 25 21:23:30 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:23:30 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:23:30 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:23:30 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:23:30 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:23:30 user nova-compute[74189]: FIRMWARE:
Oct 25 21:23:30 user nova-compute[74189]: No targets found.
Oct 25 21:23:30 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:23:30 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:23:30 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[598b5036-1111-4e27-bedb-e732ad5954a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefefba7-3ca1-44a8-93b1-7212636fa52a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:23:30 user nova-compute[74189]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:23:30 user nova-compute[74189]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 (non-flash)
Oct 25 21:23:30 user nova-compute[74189]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)
Oct 25 21:23:30 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:23:30 user nova-compute[74189]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:23:30 user nova-compute[74189]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 (non-flash)
Oct 25 21:23:30 user nova-compute[74189]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)
Oct 25 21:23:30 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe30436c310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603'): ({'sdf'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Removing single pathed devices sdf {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed526200-4f62-4d0e-b674-fb7cd48c9139]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.026s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7df1f46-2bd8-4953-a70f-9c526921fae7]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Flushing IO for device /dev/sdf {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4a7d5d-ff65-46b0-88ef-b2b3fe200814]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.060s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d420fb-6c3d-49c5-960c-36b0a6cfa6bc]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] SCSI volumes sdf have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[199f9d38-ede6-4e03-9a37-b5ef62ad774c]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9947e58-4b84-4e4e-bd59-3bec2464a8a9]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603, portal: 172.16.0.220,3260]
Oct 25 21:23:30 user nova-compute[74189]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603, portal: 172.16.0.220,3260] successful.
Oct 25 21:23:30 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba681370-9e8a-4b48-abd0-b23648598603 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[af32958e-3b74-4afd-8112-2e50b6c523b0]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] <== disconnect_volume: return (350ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:23:30 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:23:30 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Deleting instance files /opt/stack/data/nova/instances/46ffb192-ad11-416e-9094-c8e080b5414e_del
Oct 25 21:23:30 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Deletion of /opt/stack/data/nova/instances/46ffb192-ad11-416e-9094-c8e080b5414e_del complete
Oct 25 21:23:31 user nova-compute[74189]: INFO nova.compute.manager [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Took 4.27 seconds to destroy the instance on the hypervisor.
Oct 25 21:23:31 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:23:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:31 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:23:31 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:23:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:31 user nova-compute[74189]: DEBUG nova.compute.manager [req-26231a71-1795-4ae1-88d5-7cc554372eed req-db3ae624-1786-41de-afa7-4d94eca64b86 service nova] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Received event network-vif-plugged-e2b72ea5-94f6-47f7-a022-55462da4489b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:23:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-26231a71-1795-4ae1-88d5-7cc554372eed req-db3ae624-1786-41de-afa7-4d94eca64b86 service nova] Acquiring lock "384e5528-a8d3-49f3-bc21-e7dbf3d14cb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:23:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-26231a71-1795-4ae1-88d5-7cc554372eed req-db3ae624-1786-41de-afa7-4d94eca64b86 service nova] Lock "384e5528-a8d3-49f3-bc21-e7dbf3d14cb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:23:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-26231a71-1795-4ae1-88d5-7cc554372eed req-db3ae624-1786-41de-afa7-4d94eca64b86 service nova] Lock "384e5528-a8d3-49f3-bc21-e7dbf3d14cb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:23:31 user nova-compute[74189]: DEBUG nova.compute.manager [req-26231a71-1795-4ae1-88d5-7cc554372eed req-db3ae624-1786-41de-afa7-4d94eca64b86 service nova] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] No waiting events found dispatching network-vif-plugged-e2b72ea5-94f6-47f7-a022-55462da4489b {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:23:31 user nova-compute[74189]: WARNING nova.compute.manager [req-26231a71-1795-4ae1-88d5-7cc554372eed req-db3ae624-1786-41de-afa7-4d94eca64b86 service nova] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Received unexpected event network-vif-plugged-e2b72ea5-94f6-47f7-a022-55462da4489b for instance with vm_state building and task_state spawning.
Oct 25 21:23:31 user nova-compute[74189]: DEBUG nova.compute.manager [req-26231a71-1795-4ae1-88d5-7cc554372eed req-db3ae624-1786-41de-afa7-4d94eca64b86 service nova] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Received event network-vif-plugged-e2b72ea5-94f6-47f7-a022-55462da4489b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:23:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-26231a71-1795-4ae1-88d5-7cc554372eed req-db3ae624-1786-41de-afa7-4d94eca64b86 service nova] Acquiring lock "384e5528-a8d3-49f3-bc21-e7dbf3d14cb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:23:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-26231a71-1795-4ae1-88d5-7cc554372eed req-db3ae624-1786-41de-afa7-4d94eca64b86 service nova] Lock "384e5528-a8d3-49f3-bc21-e7dbf3d14cb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:23:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-26231a71-1795-4ae1-88d5-7cc554372eed req-db3ae624-1786-41de-afa7-4d94eca64b86 service nova] Lock "384e5528-a8d3-49f3-bc21-e7dbf3d14cb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:23:31 user nova-compute[74189]: DEBUG nova.compute.manager [req-26231a71-1795-4ae1-88d5-7cc554372eed req-db3ae624-1786-41de-afa7-4d94eca64b86 service nova] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] No waiting events found dispatching network-vif-plugged-e2b72ea5-94f6-47f7-a022-55462da4489b {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:23:31 user nova-compute[74189]: WARNING nova.compute.manager [req-26231a71-1795-4ae1-88d5-7cc554372eed req-db3ae624-1786-41de-afa7-4d94eca64b86 service nova] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Received unexpected event network-vif-plugged-e2b72ea5-94f6-47f7-a022-55462da4489b for instance with vm_state building and task_state spawning.
Oct 25 21:23:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-57654450-e901-4a81-b880-acddae027f76 req-8eb769e9-aefe-4c3a-88c7-94655b3ec24d service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-deleted-4caa88c4-c581-41eb-b8f8-a291aaef3ad4 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:23:33 user nova-compute[74189]: INFO nova.compute.manager [req-57654450-e901-4a81-b880-acddae027f76 req-8eb769e9-aefe-4c3a-88c7-94655b3ec24d service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Neutron deleted interface 4caa88c4-c581-41eb-b8f8-a291aaef3ad4; detaching it from the instance and deleting it from the info cache
Oct 25 21:23:33 user nova-compute[74189]: DEBUG nova.network.neutron [req-57654450-e901-4a81-b880-acddae027f76 req-8eb769e9-aefe-4c3a-88c7-94655b3ec24d service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Updating instance_info_cache with network_info: [{"id": "35311a59-a404-4759-8125-ac222750d5fa", "address": "fa:16:3e:b5:8d:bc", "network": {"id": "477a555b-610a-4b4f-8e0e-efd52c856097", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1102892168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35311a59-a4", "ovs_interfaceid": "35311a59-a404-4759-8125-ac222750d5fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "address": "fa:16:3e:b2:20:8d", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1d7d42-01", "ovs_interfaceid": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f967dd2c-da19-4645-b52e-2d79f61baabe", "address": "fa:16:3e:d1:88:5b", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf967dd2c-da", "ovs_interfaceid": "f967dd2c-da19-4645-b52e-2d79f61baabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f18e575-80eb-41e8-8615-bcbbe00ff9de", "address": "fa:16:3e:c2:d7:0b", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f18e575-80", "ovs_interfaceid": "5f18e575-80eb-41e8-8615-bcbbe00ff9de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b60a817a-3478-48d7-b117-bee088bc7e86", "address": "fa:16:3e:0f:4d:3e", "network": {"id": "68ea97b8-852c-464a-9ccb-b2dc55c63e47", "bridge": "br-int", "label": "tempest-device-tagging-net2-670429054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60a817a-34", "ovs_interfaceid": "b60a817a-3478-48d7-b117-bee088bc7e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56", "address": "fa:16:3e:b0:f9:54", "network": {"id": "68ea97b8-852c-464a-9ccb-b2dc55c63e47", "bridge": "br-int", "label": "tempest-device-tagging-net2-670429054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e0f5a2-44", "ovs_interfaceid": "94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:23:33 user nova-compute[74189]: DEBUG nova.compute.manager [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:23:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:23:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-57654450-e901-4a81-b880-acddae027f76 req-8eb769e9-aefe-4c3a-88c7-94655b3ec24d service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Detach interface failed, port_id=4caa88c4-c581-41eb-b8f8-a291aaef3ad4, reason: Instance 46ffb192-ad11-416e-9094-c8e080b5414e could not be found. {{(pid=74189) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 21:23:33 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Instance spawned successfully.
Oct 25 21:23:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:23:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:23:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:23:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:23:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:23:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:23:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:23:33 user nova-compute[74189]: INFO nova.compute.manager [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Took 7.04 seconds to spawn the instance on the hypervisor.
Oct 25 21:23:33 user nova-compute[74189]: DEBUG nova.compute.manager [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:23:33 user nova-compute[74189]: INFO nova.compute.manager [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Took 8.04 seconds to build instance.
Oct 25 21:23:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ba007cf8-8904-4044-8796-fee8d23fedb4 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "384e5528-a8d3-49f3-bc21-e7dbf3d14cb5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.163s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:23:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-2f75ae11-08e0-4752-aeeb-336a8d32cfd8 req-189ea922-119f-4741-b366-2df908b47aa0 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-deleted-b60a817a-3478-48d7-b117-bee088bc7e86 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:23:35 user nova-compute[74189]: INFO nova.compute.manager [req-2f75ae11-08e0-4752-aeeb-336a8d32cfd8 req-189ea922-119f-4741-b366-2df908b47aa0 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Neutron deleted interface b60a817a-3478-48d7-b117-bee088bc7e86; detaching it from the instance and deleting it from the info cache
Oct 25 21:23:35 user nova-compute[74189]: DEBUG nova.network.neutron [req-2f75ae11-08e0-4752-aeeb-336a8d32cfd8 req-189ea922-119f-4741-b366-2df908b47aa0 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Updating instance_info_cache with network_info: [{"id": "35311a59-a404-4759-8125-ac222750d5fa", "address": "fa:16:3e:b5:8d:bc", "network": {"id": "477a555b-610a-4b4f-8e0e-efd52c856097", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1102892168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35311a59-a4", "ovs_interfaceid": "35311a59-a404-4759-8125-ac222750d5fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "address": "fa:16:3e:b2:20:8d", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1d7d42-01", "ovs_interfaceid": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f967dd2c-da19-4645-b52e-2d79f61baabe", "address": "fa:16:3e:d1:88:5b", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf967dd2c-da", "ovs_interfaceid": "f967dd2c-da19-4645-b52e-2d79f61baabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f18e575-80eb-41e8-8615-bcbbe00ff9de", "address": "fa:16:3e:c2:d7:0b", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f18e575-80", "ovs_interfaceid": "5f18e575-80eb-41e8-8615-bcbbe00ff9de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56", "address": "fa:16:3e:b0:f9:54", "network": {"id": "68ea97b8-852c-464a-9ccb-b2dc55c63e47", "bridge": "br-int", "label": "tempest-device-tagging-net2-670429054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e0f5a2-44", "ovs_interfaceid": "94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:23:35 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:23:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-2f75ae11-08e0-4752-aeeb-336a8d32cfd8 req-189ea922-119f-4741-b366-2df908b47aa0 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Detach interface failed, port_id=b60a817a-3478-48d7-b117-bee088bc7e86, reason: Instance 46ffb192-ad11-416e-9094-c8e080b5414e could not be found. {{(pid=74189) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 21:23:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-2f75ae11-08e0-4752-aeeb-336a8d32cfd8 req-189ea922-119f-4741-b366-2df908b47aa0 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-deleted-5f18e575-80eb-41e8-8615-bcbbe00ff9de {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:23:35 user nova-compute[74189]: INFO nova.compute.manager [req-2f75ae11-08e0-4752-aeeb-336a8d32cfd8 req-189ea922-119f-4741-b366-2df908b47aa0 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Neutron deleted interface 5f18e575-80eb-41e8-8615-bcbbe00ff9de; detaching it from the instance and deleting it from the info cache
Oct 25 21:23:35 user nova-compute[74189]: DEBUG nova.network.neutron [req-2f75ae11-08e0-4752-aeeb-336a8d32cfd8 req-189ea922-119f-4741-b366-2df908b47aa0 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Updating instance_info_cache with network_info: [{"id": "35311a59-a404-4759-8125-ac222750d5fa", "address": "fa:16:3e:b5:8d:bc", "network": {"id": "477a555b-610a-4b4f-8e0e-efd52c856097", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1102892168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35311a59-a4", "ovs_interfaceid": "35311a59-a404-4759-8125-ac222750d5fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "address": "fa:16:3e:b2:20:8d", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1d7d42-01", "ovs_interfaceid": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f967dd2c-da19-4645-b52e-2d79f61baabe", "address": "fa:16:3e:d1:88:5b", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf967dd2c-da", "ovs_interfaceid": "f967dd2c-da19-4645-b52e-2d79f61baabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56", "address": "fa:16:3e:b0:f9:54", "network": {"id": "68ea97b8-852c-464a-9ccb-b2dc55c63e47", "bridge": "br-int", "label": "tempest-device-tagging-net2-670429054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e0f5a2-44", "ovs_interfaceid": "94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:23:35 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Took 4.11 seconds to deallocate network for instance.
Oct 25 21:23:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-2f75ae11-08e0-4752-aeeb-336a8d32cfd8 req-189ea922-119f-4741-b366-2df908b47aa0 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Detach interface failed, port_id=5f18e575-80eb-41e8-8615-bcbbe00ff9de, reason: Instance 46ffb192-ad11-416e-9094-c8e080b5414e could not be found. {{(pid=74189) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 21:23:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-2f75ae11-08e0-4752-aeeb-336a8d32cfd8 req-189ea922-119f-4741-b366-2df908b47aa0 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-deleted-35311a59-a404-4759-8125-ac222750d5fa {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:23:35 user nova-compute[74189]: INFO nova.compute.manager [req-2f75ae11-08e0-4752-aeeb-336a8d32cfd8 req-189ea922-119f-4741-b366-2df908b47aa0 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Neutron deleted interface 35311a59-a404-4759-8125-ac222750d5fa; detaching it from the instance and deleting it from the info cache
Oct 25 21:23:35 user nova-compute[74189]: DEBUG nova.network.neutron [req-2f75ae11-08e0-4752-aeeb-336a8d32cfd8 req-189ea922-119f-4741-b366-2df908b47aa0 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Updating instance_info_cache with network_info: [{"id": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "address": "fa:16:3e:b2:20:8d", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1d7d42-01", "ovs_interfaceid": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f967dd2c-da19-4645-b52e-2d79f61baabe", "address": "fa:16:3e:d1:88:5b", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf967dd2c-da", "ovs_interfaceid": "f967dd2c-da19-4645-b52e-2d79f61baabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56", "address": "fa:16:3e:b0:f9:54", "network": {"id": "68ea97b8-852c-464a-9ccb-b2dc55c63e47", "bridge": "br-int", "label": "tempest-device-tagging-net2-670429054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e0f5a2-44", "ovs_interfaceid": "94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:23:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-2f75ae11-08e0-4752-aeeb-336a8d32cfd8 req-189ea922-119f-4741-b366-2df908b47aa0 service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Detach interface failed, port_id=35311a59-a404-4759-8125-ac222750d5fa, reason: Instance 46ffb192-ad11-416e-9094-c8e080b5414e could not be found. {{(pid=74189) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 21:23:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "3702433e-ec0e-4359-bc0c-d3a189d83caa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:23:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "3702433e-ec0e-4359-bc0c-d3a189d83caa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:23:35 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:23:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:23:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:23:35 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:23:35 user nova-compute[74189]: INFO nova.compute.claims [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Claim successful on node user
Oct 25 21:23:35 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:23:35 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:23:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.534s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:23:36 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:23:36 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:23:36 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:23:36 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:23:36 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:23:36 user nova-compute[74189]: DEBUG nova.policy [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '77a27a7ebb4a458097c901871c378bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e893e8f3f58e4e15920d313b6391682c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:23:36 user nova-compute[74189]: INFO nova.virt.block_device [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Booting with volume snapshot 8905a38a-f198-4968-83d6-281335cf379d at /dev/vda
Oct 25 21:23:36 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Successfully created port: 6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9 {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:23:37 user nova-compute[74189]: DEBUG nova.compute.manager [req-21528a4d-3918-49be-af84-785546899e16 req-d6bea60c-5bb0-4e03-862b-b71b0f5f2cae service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Received event network-vif-deleted-94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:23:37 user nova-compute[74189]: INFO nova.compute.manager [req-21528a4d-3918-49be-af84-785546899e16 req-d6bea60c-5bb0-4e03-862b-b71b0f5f2cae service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Neutron deleted interface 94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56; detaching it from the instance and deleting it from the info cache
Oct 25 21:23:37 user nova-compute[74189]: DEBUG nova.network.neutron [req-21528a4d-3918-49be-af84-785546899e16 req-d6bea60c-5bb0-4e03-862b-b71b0f5f2cae service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Updating instance_info_cache with network_info: [{"id": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "address": "fa:16:3e:b2:20:8d", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1d7d42-01", "ovs_interfaceid": "bf1d7d42-01d4-4d66-814b-00a055fd82a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f967dd2c-da19-4645-b52e-2d79f61baabe", "address": "fa:16:3e:d1:88:5b", "network": {"id": "cabdedc4-8ff4-4fab-9935-925c40f2a8eb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1437584191", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f78ddc9861f9455aa58a9a532548023a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf967dd2c-da", "ovs_interfaceid": "f967dd2c-da19-4645-b52e-2d79f61baabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:23:37 user nova-compute[74189]: DEBUG nova.compute.manager [req-21528a4d-3918-49be-af84-785546899e16 req-d6bea60c-5bb0-4e03-862b-b71b0f5f2cae service nova] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Detach interface failed, port_id=94e0f5a2-44f9-47e1-8b7f-d0bf28b54f56, reason: Instance 46ffb192-ad11-416e-9094-c8e080b5414e could not be found. {{(pid=74189) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 21:23:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:37 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Successfully updated port: 6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9 {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:23:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "refresh_cache-3702433e-ec0e-4359-bc0c-d3a189d83caa" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:23:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquired lock "refresh_cache-3702433e-ec0e-4359-bc0c-d3a189d83caa" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:23:37 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:23:37 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:23:38 user nova-compute[74189]: INFO nova.compute.manager [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] [instance: 46ffb192-ad11-416e-9094-c8e080b5414e] Took 3.16 seconds to detach 3 volumes for instance.
Oct 25 21:23:38 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Updating instance_info_cache with network_info: [{"id": "6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9", "address": "fa:16:3e:46:cd:d6", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bfb9f88-cb", "ovs_interfaceid": "6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:23:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Releasing lock "refresh_cache-3702433e-ec0e-4359-bc0c-d3a189d83caa" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:23:38 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Instance network_info: |[{"id": "6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9", "address": "fa:16:3e:46:cd:d6", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bfb9f88-cb", "ovs_interfaceid": "6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:23:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:23:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:23:38 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:23:38 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:23:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.465s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:23:38 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Deleted allocations for instance 46ffb192-ad11-416e-9094-c8e080b5414e
Oct 25 21:23:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-69d84cb3-7d81-4d0c-bba2-54182eb3fb7c tempest-TaggedBootDevicesTest_v242-994959279 tempest-TaggedBootDevicesTest_v242-994959279-project-member] Lock "46ffb192-ad11-416e-9094-c8e080b5414e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.326s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:23:39 user nova-compute[74189]: DEBUG nova.compute.manager [req-bbb635be-1019-4f10-ad2e-3c18b6e9b638 req-a578856e-c411-40f8-8f02-f0b4930b7732 service nova] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Received event network-changed-6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:23:39 user nova-compute[74189]: DEBUG nova.compute.manager [req-bbb635be-1019-4f10-ad2e-3c18b6e9b638 req-a578856e-c411-40f8-8f02-f0b4930b7732 service nova] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Refreshing instance network info cache due to event network-changed-6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:23:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bbb635be-1019-4f10-ad2e-3c18b6e9b638 req-a578856e-c411-40f8-8f02-f0b4930b7732 service nova] Acquiring lock "refresh_cache-3702433e-ec0e-4359-bc0c-d3a189d83caa" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:23:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bbb635be-1019-4f10-ad2e-3c18b6e9b638 req-a578856e-c411-40f8-8f02-f0b4930b7732 service nova] Acquired lock "refresh_cache-3702433e-ec0e-4359-bc0c-d3a189d83caa" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:23:39 user nova-compute[74189]: DEBUG nova.network.neutron [req-bbb635be-1019-4f10-ad2e-3c18b6e9b638 req-a578856e-c411-40f8-8f02-f0b4930b7732 service nova] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Refreshing network info cache for port 6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:23:39 user nova-compute[74189]: DEBUG nova.network.neutron [req-bbb635be-1019-4f10-ad2e-3c18b6e9b638 req-a578856e-c411-40f8-8f02-f0b4930b7732 service nova] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Updated VIF entry in instance network info cache for port 6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:23:39 user nova-compute[74189]: DEBUG nova.network.neutron [req-bbb635be-1019-4f10-ad2e-3c18b6e9b638 req-a578856e-c411-40f8-8f02-f0b4930b7732 service nova] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Updating instance_info_cache with network_info: [{"id": "6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9", "address": "fa:16:3e:46:cd:d6", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bfb9f88-cb", "ovs_interfaceid": "6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:23:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bbb635be-1019-4f10-ad2e-3c18b6e9b638 req-a578856e-c411-40f8-8f02-f0b4930b7732 service nova] Releasing lock "refresh_cache-3702433e-ec0e-4359-bc0c-d3a189d83caa" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:23:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:42 user nova-compute[74189]: DEBUG os_brick.utils [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:23:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:42 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b266ff-251d-48b1-83d7-ff10b4b52e1e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:42 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf575b2-b275-4120-9d6a-178a7aeed045]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:42 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[af182339-4d7c-451e-9e4b-475089fad362]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:42 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c12b4e9-56c9-478b-9d5c-bb3213ea4a98]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:23:42 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:23:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:23:42 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:23:42 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3097a47-ac76-4e76-a05d-d6df59ae5471]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:42 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:23:42 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:23:42 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:23:42 user nova-compute[74189]: DEBUG os_brick.utils [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:23:42 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Updating existing volume attachment record: 40f65ea9-5343-401d-b269-4cd61846ddfe {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:23:42 user nova-compute[74189]: DEBUG nova.compute.manager [req-1d49b373-104f-49ea-b952-5fa2db2bb1ea req-0badd841-117c-4dc6-8dd9-ba4f38de1bbd service nova] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Received event network-changed-8eb6e9e2-60c6-463d-8525-b768933a94df {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:23:42 user nova-compute[74189]: DEBUG nova.compute.manager [req-1d49b373-104f-49ea-b952-5fa2db2bb1ea req-0badd841-117c-4dc6-8dd9-ba4f38de1bbd service nova] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Refreshing instance network info cache due to event network-changed-8eb6e9e2-60c6-463d-8525-b768933a94df. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:23:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1d49b373-104f-49ea-b952-5fa2db2bb1ea req-0badd841-117c-4dc6-8dd9-ba4f38de1bbd service nova] Acquiring lock "refresh_cache-932fe8ac-fdde-45c6-aa32-9bf866f19a4e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:23:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1d49b373-104f-49ea-b952-5fa2db2bb1ea req-0badd841-117c-4dc6-8dd9-ba4f38de1bbd service nova] Acquired lock "refresh_cache-932fe8ac-fdde-45c6-aa32-9bf866f19a4e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:23:42 user nova-compute[74189]: DEBUG nova.network.neutron [req-1d49b373-104f-49ea-b952-5fa2db2bb1ea req-0badd841-117c-4dc6-8dd9-ba4f38de1bbd service nova] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Refreshing network info cache for port 8eb6e9e2-60c6-463d-8525-b768933a94df {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:23:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:43 user nova-compute[74189]: DEBUG nova.network.neutron [req-1d49b373-104f-49ea-b952-5fa2db2bb1ea req-0badd841-117c-4dc6-8dd9-ba4f38de1bbd service nova] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Updated VIF entry in instance network info cache for port 8eb6e9e2-60c6-463d-8525-b768933a94df. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:23:43 user nova-compute[74189]: DEBUG nova.network.neutron [req-1d49b373-104f-49ea-b952-5fa2db2bb1ea req-0badd841-117c-4dc6-8dd9-ba4f38de1bbd service nova] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Updating instance_info_cache with network_info: [{"id": "8eb6e9e2-60c6-463d-8525-b768933a94df", "address": "fa:16:3e:e8:de:d0", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb6e9e2-60", "ovs_interfaceid": "8eb6e9e2-60c6-463d-8525-b768933a94df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:23:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1d49b373-104f-49ea-b952-5fa2db2bb1ea req-0badd841-117c-4dc6-8dd9-ba4f38de1bbd service nova] Releasing lock "refresh_cache-932fe8ac-fdde-45c6-aa32-9bf866f19a4e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:23:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDraZkpJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:23:47 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:23:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:23:47 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:23:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:23:47 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:23:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4daed1af-bc66-4696-bfe4-9420d6b2e427]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:23:47 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[692b27bb-4b7a-4afb-80f0-a78d54febad7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f] added
Oct 25 21:23:47 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2105cef-ed3a-46c1-a0cd-17e771eb636a]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[416d0401-20ec-4bdc-8837-290a683465d9]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qDraZkpJ {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qDraZkpJ" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b8cab3-87d8-4521-a58c-0b8307ddba75]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qDraZkpJ'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8cdf78-60dc-48aa-bf9b-c1987481dbd4]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7302a1-939f-4273-911b-ba9fe221e337]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:23:47 user nova-compute[74189]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:23:47 user nova-compute[74189]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)
Oct 25 21:23:47 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:23:47 user nova-compute[74189]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:23:47 user nova-compute[74189]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)
Oct 25 21:23:47 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[102683cf-5659-4691-96ca-8a151dc0b546]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f, portal: 172.16.0.220,3260]
Oct 25 21:23:47 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f, portal: 172.16.0.220,3260] successful.
Oct 25 21:23:47 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d481148-414f-4dde-915f-93fdc7cfd7d7]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[38178067-de15-40d6-ba5c-e54451b6f313]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:23:47 user nova-compute[74189]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:23:47 user nova-compute[74189]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)
Oct 25 21:23:47 user nova-compute[74189]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:23:47 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:23:47 user nova-compute[74189]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:23:47 user nova-compute[74189]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)
Oct 25 21:23:47 user nova-compute[74189]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:23:47 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.373s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5872299-4cb6-4b4c-9ebe-12a9500ef5d0]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: None {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:23:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:48 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:23:48 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDraZkpJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:23:48 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:23:48 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '23133616331336462', 'path': '/dev/sdc'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:23:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133616331336462', 'path': '/dev/sdc'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:23:48 user nova-compute[74189]: DEBUG nova.objects.instance [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lazy-loading 'flavor' on Instance uuid de6b6789-b328-4c3b-8d24-07774d5dbe6d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:23:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 21:23:48 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:23:48 user nova-compute[74189]:   <source dev="/dev/sdc"/>
Oct 25 21:23:48 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:23:48 user nova-compute[74189]:   <serial>5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f</serial>
Oct 25 21:23:48 user nova-compute[74189]: </disk>
Oct 25 21:23:48 user nova-compute[74189]:  {{(pid=74189) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 21:23:49 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:23:49 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:23:49 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] No VIF found with MAC fa:16:3e:df:d0:7a, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:23:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2554d2f7-5f51-43b7-a734-a33b682065c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.284s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:23:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-973f0f36-75d6-4faa-8712-42546bdaad42 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:23:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-973f0f36-75d6-4faa-8712-42546bdaad42 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:23:50 user nova-compute[74189]: DEBUG nova.compute.manager [None req-973f0f36-75d6-4faa-8712-42546bdaad42 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:23:50 user nova-compute[74189]: DEBUG nova.compute.manager [None req-973f0f36-75d6-4faa-8712-42546bdaad42 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74189) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 25 21:23:50 user nova-compute[74189]: DEBUG nova.objects.instance [None req-973f0f36-75d6-4faa-8712-42546bdaad42 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lazy-loading 'flavor' on Instance uuid de6b6789-b328-4c3b-8d24-07774d5dbe6d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:23:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:50 user nova-compute[74189]: DEBUG nova.compute.manager [req-14d78743-a050-4528-827f-215b2185699b req-d4e19d6d-ee6f-455c-80f7-6cd01f7de7f2 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Received event network-vif-unplugged-b0bbbcbc-085e-476f-b600-f1d684f23beb {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:23:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-14d78743-a050-4528-827f-215b2185699b req-d4e19d6d-ee6f-455c-80f7-6cd01f7de7f2 service nova] Acquiring lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:23:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-14d78743-a050-4528-827f-215b2185699b req-d4e19d6d-ee6f-455c-80f7-6cd01f7de7f2 service nova] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:23:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-14d78743-a050-4528-827f-215b2185699b req-d4e19d6d-ee6f-455c-80f7-6cd01f7de7f2 service nova] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:23:50 user nova-compute[74189]: DEBUG nova.compute.manager [req-14d78743-a050-4528-827f-215b2185699b req-d4e19d6d-ee6f-455c-80f7-6cd01f7de7f2 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] No waiting events found dispatching network-vif-unplugged-b0bbbcbc-085e-476f-b600-f1d684f23beb {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:23:50 user nova-compute[74189]: WARNING nova.compute.manager [req-14d78743-a050-4528-827f-215b2185699b req-d4e19d6d-ee6f-455c-80f7-6cd01f7de7f2 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Received unexpected event network-vif-unplugged-b0bbbcbc-085e-476f-b600-f1d684f23beb for instance with vm_state active and task_state powering-off.
Oct 25 21:23:51 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Instance destroyed successfully.
Oct 25 21:23:51 user nova-compute[74189]: DEBUG nova.compute.manager [None req-973f0f36-75d6-4faa-8712-42546bdaad42 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:23:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-973f0f36-75d6-4faa-8712-42546bdaad42 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.992s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:23:53 user nova-compute[74189]: DEBUG nova.compute.manager [req-cfc908a6-5280-4fac-b842-b28a90c843f0 req-dbfb36a9-06d2-4a3b-bf4a-66078c067d08 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Received event network-vif-plugged-b0bbbcbc-085e-476f-b600-f1d684f23beb {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:23:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-cfc908a6-5280-4fac-b842-b28a90c843f0 req-dbfb36a9-06d2-4a3b-bf4a-66078c067d08 service nova] Acquiring lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:23:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-cfc908a6-5280-4fac-b842-b28a90c843f0 req-dbfb36a9-06d2-4a3b-bf4a-66078c067d08 service nova] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:23:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-cfc908a6-5280-4fac-b842-b28a90c843f0 req-dbfb36a9-06d2-4a3b-bf4a-66078c067d08 service nova] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:23:53 user nova-compute[74189]: DEBUG nova.compute.manager [req-cfc908a6-5280-4fac-b842-b28a90c843f0 req-dbfb36a9-06d2-4a3b-bf4a-66078c067d08 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] No waiting events found dispatching network-vif-plugged-b0bbbcbc-085e-476f-b600-f1d684f23beb {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:23:53 user nova-compute[74189]: WARNING nova.compute.manager [req-cfc908a6-5280-4fac-b842-b28a90c843f0 req-dbfb36a9-06d2-4a3b-bf4a-66078c067d08 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Received unexpected event network-vif-plugged-b0bbbcbc-085e-476f-b600-f1d684f23beb for instance with vm_state stopped and task_state None.
Oct 25 21:23:53 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:53 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:53 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:23:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:00 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:24:01 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:24:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:24:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:24:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:24:01 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:24:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:02 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:24:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:24:03 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Creating image(s)
Oct 25 21:24:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Did not create local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Ensure instance console log exists: /opt/stack/data/nova/instances/3702433e-ec0e-4359-bc0c-d3a189d83caa/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Start _get_guest_xml network_info=[{"id": "6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9", "address": "fa:16:3e:46:cd:d6", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bfb9f88-cb", "ovs_interfaceid": "6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'smHRfTwO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3702433e-ec0e-4359-bc0c-d3a189d83caa', 'attached_at': '', 'detached_at': '', 'volume_id': 'ed9cd674-0c70-4842-88dd-6ef626b26612', 'serial': 'ed9cd674-0c70-4842-88dd-6ef626b26612'}, 'attachment_id': '40f65ea9-5343-401d-b269-4cd61846ddfe', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:24:03 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:24:03 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:24:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'smHRfTwO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:24:03 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:24:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:24:03 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:24:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:24:03 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612 -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1135fc19-6089-4c54-a458-373523af6c55]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:24:03 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612 -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b68a4c5-97cd-4668-a4c1-be7da10c8010]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612] added
Oct 25 21:24:03 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e96c96-b21a-4962-96b2-b2ff72e3443f]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb9351d-80ff-4c9c-a2d9-96076cb5285b]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v smHRfTwO {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v smHRfTwO" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af5f2a8-d33b-47c6-aabb-f73fc30bc8de]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'smHRfTwO'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[159ad2de-4205-484c-aa5b-1531e2b4c8de]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3a4ada-0807-4fa4-9156-d1765964407b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:24:03 user nova-compute[74189]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:24:03 user nova-compute[74189]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)
Oct 25 21:24:03 user nova-compute[74189]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:24:03 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:24:03 user nova-compute[74189]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:24:03 user nova-compute[74189]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)
Oct 25 21:24:03 user nova-compute[74189]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:24:03 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612 -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a77fc6-83c6-4eb6-8b3b-07d1540be43e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612, portal: 172.16.0.220,3260]
Oct 25 21:24:03 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612, portal: 172.16.0.220,3260] successful.
Oct 25 21:24:03 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2712cd33-26ee-48f8-b349-3087106dea01]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[52221952-6b3d-4add-a5c3-e9ea9022fbba]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:24:03 user nova-compute[74189]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:24:03 user nova-compute[74189]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)
Oct 25 21:24:03 user nova-compute[74189]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:24:03 user nova-compute[74189]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612 (non-flash)
Oct 25 21:24:03 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:24:03 user nova-compute[74189]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:24:03 user nova-compute[74189]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)
Oct 25 21:24:03 user nova-compute[74189]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:24:03 user nova-compute[74189]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612 (non-flash)
Oct 25 21:24:03 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.132s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc00ef3a-595c-479b-aa84-23d75104e6cd]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:24:04 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:24:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'smHRfTwO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:24:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/680e134e-5e0d-464f-9e30-460010348795/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/680e134e-5e0d-464f-9e30-460010348795/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/680e134e-5e0d-464f-9e30-460010348795/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/680e134e-5e0d-464f-9e30-460010348795/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:24:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/384e5528-a8d3-49f3-bc21-e7dbf3d14cb5/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/384e5528-a8d3-49f3-bc21-e7dbf3d14cb5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/384e5528-a8d3-49f3-bc21-e7dbf3d14cb5/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.552s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] <== connect_volume: return (1554ms) {'type': 'block', 'scsi_wwn': '26235666533303736', 'path': '/dev/sde'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235666533303736', 'path': '/dev/sde'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/384e5528-a8d3-49f3-bc21-e7dbf3d14cb5/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:23:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1136017570',display_name='tempest-TestVolumeBootPattern-server-1136017570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1136017570',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e893e8f3f58e4e15920d313b6391682c',ramdisk_id='',reservation_id='r-1v987hh3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1934687878',owner_user_name='tempest-TestVolumeBootPattern-1934687878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:23:36Z,user_data=None,user_id='77a27a7ebb4a458097c901871c378bc8',uuid=3702433e-ec0e-4359-bc0c-d3a189d83caa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9", "address": "fa:16:3e:46:cd:d6", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bfb9f88-cb", "ovs_interfaceid": "6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converting VIF {"id": "6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9", "address": "fa:16:3e:46:cd:d6", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bfb9f88-cb", "ovs_interfaceid": "6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:cd:d6,bridge_name='br-int',has_traffic_filtering=True,id=6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bfb9f88-cb') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lazy-loading 'pci_devices' on Instance uuid 3702433e-ec0e-4359-bc0c-d3a189d83caa {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:24:05 user nova-compute[74189]:   <uuid>3702433e-ec0e-4359-bc0c-d3a189d83caa</uuid>
Oct 25 21:24:05 user nova-compute[74189]:   <name>instance-00000015</name>
Oct 25 21:24:05 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:24:05 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:24:05 user nova-compute[74189]:   <metadata>
Oct 25 21:24:05 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:24:05 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:24:05 user nova-compute[74189]:       <nova:name>tempest-TestVolumeBootPattern-server-1136017570</nova:name>
Oct 25 21:24:05 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:24:03</nova:creationTime>
Oct 25 21:24:05 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:24:05 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:24:05 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:24:05 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:24:05 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:24:05 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:24:05 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:24:05 user nova-compute[74189]:       <nova:owner>
Oct 25 21:24:05 user nova-compute[74189]:         <nova:user uuid="77a27a7ebb4a458097c901871c378bc8">tempest-TestVolumeBootPattern-1934687878-project-member</nova:user>
Oct 25 21:24:05 user nova-compute[74189]:         <nova:project uuid="e893e8f3f58e4e15920d313b6391682c">tempest-TestVolumeBootPattern-1934687878</nova:project>
Oct 25 21:24:05 user nova-compute[74189]:       </nova:owner>
Oct 25 21:24:05 user nova-compute[74189]:       <nova:ports>
Oct 25 21:24:05 user nova-compute[74189]:         <nova:port uuid="6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9">
Oct 25 21:24:05 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 25 21:24:05 user nova-compute[74189]:         </nova:port>
Oct 25 21:24:05 user nova-compute[74189]:       </nova:ports>
Oct 25 21:24:05 user nova-compute[74189]:     </nova:instance>
Oct 25 21:24:05 user nova-compute[74189]:   </metadata>
Oct 25 21:24:05 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:24:05 user nova-compute[74189]:     <system>
Oct 25 21:24:05 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:24:05 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:24:05 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:24:05 user nova-compute[74189]:       <entry name="serial">3702433e-ec0e-4359-bc0c-d3a189d83caa</entry>
Oct 25 21:24:05 user nova-compute[74189]:       <entry name="uuid">3702433e-ec0e-4359-bc0c-d3a189d83caa</entry>
Oct 25 21:24:05 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:24:05 user nova-compute[74189]:     </system>
Oct 25 21:24:05 user nova-compute[74189]:   </sysinfo>
Oct 25 21:24:05 user nova-compute[74189]:   <os>
Oct 25 21:24:05 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:24:05 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:24:05 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:24:05 user nova-compute[74189]:   </os>
Oct 25 21:24:05 user nova-compute[74189]:   <features>
Oct 25 21:24:05 user nova-compute[74189]:     <acpi/>
Oct 25 21:24:05 user nova-compute[74189]:     <apic/>
Oct 25 21:24:05 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:24:05 user nova-compute[74189]:   </features>
Oct 25 21:24:05 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:24:05 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:24:05 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:24:05 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:24:05 user nova-compute[74189]:   </clock>
Oct 25 21:24:05 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:24:05 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:24:05 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:24:05 user nova-compute[74189]:   </cpu>
Oct 25 21:24:05 user nova-compute[74189]:   <devices>
Oct 25 21:24:05 user nova-compute[74189]:     <disk type="block" device="disk">
Oct 25 21:24:05 user nova-compute[74189]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:24:05 user nova-compute[74189]:       <source dev="/dev/sde"/>
Oct 25 21:24:05 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:24:05 user nova-compute[74189]:       <serial>ed9cd674-0c70-4842-88dd-6ef626b26612</serial>
Oct 25 21:24:05 user nova-compute[74189]:     </disk>
Oct 25 21:24:05 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:24:05 user nova-compute[74189]:       <mac address="fa:16:3e:46:cd:d6"/>
Oct 25 21:24:05 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:24:05 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:24:05 user nova-compute[74189]:       <target dev="tap6bfb9f88-cb"/>
Oct 25 21:24:05 user nova-compute[74189]:     </interface>
Oct 25 21:24:05 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:24:05 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/3702433e-ec0e-4359-bc0c-d3a189d83caa/console.log" append="off"/>
Oct 25 21:24:05 user nova-compute[74189]:     </serial>
Oct 25 21:24:05 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:24:05 user nova-compute[74189]:     <video>
Oct 25 21:24:05 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:24:05 user nova-compute[74189]:     </video>
Oct 25 21:24:05 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:24:05 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:24:05 user nova-compute[74189]:     </rng>
Oct 25 21:24:05 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:24:05 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:24:05 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:24:05 user nova-compute[74189]:     </memballoon>
Oct 25 21:24:05 user nova-compute[74189]:   </devices>
Oct 25 21:24:05 user nova-compute[74189]: </domain>
Oct 25 21:24:05 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:23:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1136017570',display_name='tempest-TestVolumeBootPattern-server-1136017570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1136017570',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e893e8f3f58e4e15920d313b6391682c',ramdisk_id='',reservation_id='r-1v987hh3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1934687878',owner_user_name='tempest-TestVolumeBootPattern-1934687878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:23:36Z,user_data=None,user_id='77a27a7ebb4a458097c901871c378bc8',uuid=3702433e-ec0e-4359-bc0c-d3a189d83caa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9", "address": "fa:16:3e:46:cd:d6", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bfb9f88-cb", "ovs_interfaceid": "6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converting VIF {"id": "6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9", "address": "fa:16:3e:46:cd:d6", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bfb9f88-cb", "ovs_interfaceid": "6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:cd:d6,bridge_name='br-int',has_traffic_filtering=True,id=6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bfb9f88-cb') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG os_vif [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:cd:d6,bridge_name='br-int',has_traffic_filtering=True,id=6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bfb9f88-cb') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '771104c6-08dc-5d43-9258-ac0bda75fe70', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:24:05 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:24:05 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:24:05 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=7864MB free_disk=25.299095153808594GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6bfb9f88-cb, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6bfb9f88-cb, col_values=(('qos', UUID('01ec8150-6918-4c8e-a089-880dcdcdf32c')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6bfb9f88-cb, col_values=(('external_ids', {'iface-id': '6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:cd:d6', 'vm-uuid': '3702433e-ec0e-4359-bc0c-d3a189d83caa'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:05 user nova-compute[74189]: INFO os_vif [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:cd:d6,bridge_name='br-int',has_traffic_filtering=True,id=6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bfb9f88-cb')
Oct 25 21:24:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] No VIF found with MAC fa:16:3e:46:cd:d6, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance d7c3a99a-ab38-4e88-896d-94ae51a09a48 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance af1d7b3c-9950-4b74-8f15-b31011ccfa24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 680e134e-5e0d-464f-9e30-460010348795 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance de6b6789-b328-4c3b-8d24-07774d5dbe6d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 932fe8ac-fdde-45c6-aa32-9bf866f19a4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 75071d8a-2ce2-43b5-99f6-23853399dc97 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3702433e-ec0e-4359-bc0c-d3a189d83caa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:24:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.488s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:24:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:07 user nova-compute[74189]: DEBUG nova.compute.manager [req-f66e4792-2279-4652-aa0d-ae43ca669df5 req-2d195d36-11b2-40ca-aab4-ab7d715ca00e service nova] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Received event network-vif-plugged-6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:24:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f66e4792-2279-4652-aa0d-ae43ca669df5 req-2d195d36-11b2-40ca-aab4-ab7d715ca00e service nova] Acquiring lock "3702433e-ec0e-4359-bc0c-d3a189d83caa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:24:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f66e4792-2279-4652-aa0d-ae43ca669df5 req-2d195d36-11b2-40ca-aab4-ab7d715ca00e service nova] Lock "3702433e-ec0e-4359-bc0c-d3a189d83caa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:24:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f66e4792-2279-4652-aa0d-ae43ca669df5 req-2d195d36-11b2-40ca-aab4-ab7d715ca00e service nova] Lock "3702433e-ec0e-4359-bc0c-d3a189d83caa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:24:07 user nova-compute[74189]: DEBUG nova.compute.manager [req-f66e4792-2279-4652-aa0d-ae43ca669df5 req-2d195d36-11b2-40ca-aab4-ab7d715ca00e service nova] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] No waiting events found dispatching network-vif-plugged-6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:24:07 user nova-compute[74189]: WARNING nova.compute.manager [req-f66e4792-2279-4652-aa0d-ae43ca669df5 req-2d195d36-11b2-40ca-aab4-ab7d715ca00e service nova] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Received unexpected event network-vif-plugged-6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9 for instance with vm_state building and task_state spawning.
Oct 25 21:24:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:07 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:24:07 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:24:07 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:24:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-af1d7b3c-9950-4b74-8f15-b31011ccfa24" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:24:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-af1d7b3c-9950-4b74-8f15-b31011ccfa24" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:24:08 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:24:08 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Updating instance_info_cache with network_info: [{"id": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "address": "fa:16:3e:03:8e:2f", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4cdb73-9d", "ovs_interfaceid": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:24:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-af1d7b3c-9950-4b74-8f15-b31011ccfa24" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:24:08 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:24:08 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:24:08 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:24:08 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:24:08 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:24:08 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:24:09 user nova-compute[74189]: DEBUG nova.compute.manager [req-7c86c7df-4d0f-4c16-9c5a-d7376b788c0b req-fcc9b994-2c6c-45be-8e8d-e87f7ec714d4 service nova] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Received event network-vif-plugged-6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:24:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7c86c7df-4d0f-4c16-9c5a-d7376b788c0b req-fcc9b994-2c6c-45be-8e8d-e87f7ec714d4 service nova] Acquiring lock "3702433e-ec0e-4359-bc0c-d3a189d83caa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:24:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7c86c7df-4d0f-4c16-9c5a-d7376b788c0b req-fcc9b994-2c6c-45be-8e8d-e87f7ec714d4 service nova] Lock "3702433e-ec0e-4359-bc0c-d3a189d83caa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:24:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7c86c7df-4d0f-4c16-9c5a-d7376b788c0b req-fcc9b994-2c6c-45be-8e8d-e87f7ec714d4 service nova] Lock "3702433e-ec0e-4359-bc0c-d3a189d83caa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:24:09 user nova-compute[74189]: DEBUG nova.compute.manager [req-7c86c7df-4d0f-4c16-9c5a-d7376b788c0b req-fcc9b994-2c6c-45be-8e8d-e87f7ec714d4 service nova] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] No waiting events found dispatching network-vif-plugged-6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:24:09 user nova-compute[74189]: WARNING nova.compute.manager [req-7c86c7df-4d0f-4c16-9c5a-d7376b788c0b req-fcc9b994-2c6c-45be-8e8d-e87f7ec714d4 service nova] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Received unexpected event network-vif-plugged-6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9 for instance with vm_state building and task_state spawning.
Oct 25 21:24:09 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:24:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:24:09 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Instance spawned successfully.
Oct 25 21:24:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:24:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:24:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:24:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:24:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:24:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:24:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:24:09 user nova-compute[74189]: INFO nova.compute.manager [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Took 6.01 seconds to spawn the instance on the hypervisor.
Oct 25 21:24:09 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:24:09 user nova-compute[74189]: INFO nova.compute.manager [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Took 33.98 seconds to build instance.
Oct 25 21:24:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a38b3d53-0dc0-4cb7-b490-3fcfa212de28 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "3702433e-ec0e-4359-bc0c-d3a189d83caa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.093s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:24:09 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:24:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquiring lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:24:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:24:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquiring lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:24:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:24:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:24:14 user nova-compute[74189]: INFO nova.compute.manager [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Terminating instance
Oct 25 21:24:14 user nova-compute[74189]: DEBUG nova.compute.manager [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:24:14 user nova-compute[74189]: DEBUG nova.compute.manager [req-f37bb815-0308-43c7-9b4f-6b98f9f9ffb1 req-b70e98d9-cc83-43ca-86cc-9cbd4d7b9462 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Received event network-changed-54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:24:14 user nova-compute[74189]: DEBUG nova.compute.manager [req-f37bb815-0308-43c7-9b4f-6b98f9f9ffb1 req-b70e98d9-cc83-43ca-86cc-9cbd4d7b9462 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Refreshing instance network info cache due to event network-changed-54123e00-9921-4807-b1f7-79073453a82f. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:24:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f37bb815-0308-43c7-9b4f-6b98f9f9ffb1 req-b70e98d9-cc83-43ca-86cc-9cbd4d7b9462 service nova] Acquiring lock "refresh_cache-75071d8a-2ce2-43b5-99f6-23853399dc97" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:24:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f37bb815-0308-43c7-9b4f-6b98f9f9ffb1 req-b70e98d9-cc83-43ca-86cc-9cbd4d7b9462 service nova] Acquired lock "refresh_cache-75071d8a-2ce2-43b5-99f6-23853399dc97" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:24:14 user nova-compute[74189]: DEBUG nova.network.neutron [req-f37bb815-0308-43c7-9b4f-6b98f9f9ffb1 req-b70e98d9-cc83-43ca-86cc-9cbd4d7b9462 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Refreshing network info cache for port 54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:24:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG nova.compute.manager [req-83f1d8fc-b20e-4d51-b260-2279873af638 req-46ee9328-2dd2-4f0d-8a44-cb74217eaa26 service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Received event network-vif-unplugged-c6a0280f-def7-4677-910c-7a3a3c6b57df {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-83f1d8fc-b20e-4d51-b260-2279873af638 req-46ee9328-2dd2-4f0d-8a44-cb74217eaa26 service nova] Acquiring lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-83f1d8fc-b20e-4d51-b260-2279873af638 req-46ee9328-2dd2-4f0d-8a44-cb74217eaa26 service nova] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-83f1d8fc-b20e-4d51-b260-2279873af638 req-46ee9328-2dd2-4f0d-8a44-cb74217eaa26 service nova] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG nova.compute.manager [req-83f1d8fc-b20e-4d51-b260-2279873af638 req-46ee9328-2dd2-4f0d-8a44-cb74217eaa26 service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] No waiting events found dispatching network-vif-unplugged-c6a0280f-def7-4677-910c-7a3a3c6b57df {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG nova.compute.manager [req-83f1d8fc-b20e-4d51-b260-2279873af638 req-46ee9328-2dd2-4f0d-8a44-cb74217eaa26 service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Received event network-vif-unplugged-c6a0280f-def7-4677-910c-7a3a3c6b57df for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:15 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Instance destroyed successfully.
Oct 25 21:24:15 user nova-compute[74189]: DEBUG nova.objects.instance [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lazy-loading 'resources' on Instance uuid 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:15:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2127723699',display_name='tempest-ServerActionsTestOtherB-server-2127723699',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2127723699',id=3,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjedofMSVtj00tqk1jqFMH5AZ5Pyw9+9WP37zpM0w2hcAIIw4fFannJXo68FjlEI0XSKwz6/AZjg4uhqhEM0AXh7nvdUT82CEMoJ2RGXuMes6AOS513uwlo8CUT17ABSg==',key_name='tempest-keypair-611941333',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:22:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e426fbc4bb374115a46d927092d62423',ramdisk_id='',reservation_id='r-q0q32lk1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-40176194',owner_user_name='tempest-ServerActionsTestOtherB-40176194-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:22:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e81aaad00624abdafe04f6c8de4c5c0',uuid=5d21b93a-b312-4c1b-9e43-ffb4b729c7d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "address": "fa:16:3e:92:dc:7e", "network": {"id": "197dd483-54ad-4b81-a0d0-26c633b3a101", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1141346509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e426fbc4bb374115a46d927092d62423", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a0280f-de", "ovs_interfaceid": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Converting VIF {"id": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "address": "fa:16:3e:92:dc:7e", "network": {"id": "197dd483-54ad-4b81-a0d0-26c633b3a101", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1141346509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e426fbc4bb374115a46d927092d62423", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a0280f-de", "ovs_interfaceid": "c6a0280f-def7-4677-910c-7a3a3c6b57df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:dc:7e,bridge_name='br-int',has_traffic_filtering=True,id=c6a0280f-def7-4677-910c-7a3a3c6b57df,network=Network(197dd483-54ad-4b81-a0d0-26c633b3a101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6a0280f-de') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG os_vif [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:dc:7e,bridge_name='br-int',has_traffic_filtering=True,id=c6a0280f-def7-4677-910c-7a3a3c6b57df,network=Network(197dd483-54ad-4b81-a0d0-26c633b3a101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6a0280f-de') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6a0280f-de, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9793da21-2349-476b-be77-0f79348e630a) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:15 user nova-compute[74189]: INFO os_vif [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:dc:7e,bridge_name='br-int',has_traffic_filtering=True,id=c6a0280f-def7-4677-910c-7a3a3c6b57df,network=Network(197dd483-54ad-4b81-a0d0-26c633b3a101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6a0280f-de')
Oct 25 21:24:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDQlxprB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:24:15 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:24:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff857c80-4df8-4b83-b0ae-7071728dd825]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:24:15 user nova-compute[74189]: No targets found.
Oct 25 21:24:15 user nova-compute[74189]: iSNS:
Oct 25 21:24:15 user nova-compute[74189]: No targets found.
Oct 25 21:24:15 user nova-compute[74189]: STATIC:
Oct 25 21:24:15 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78
Oct 25 21:24:15 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:24:15 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:24:15 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1
Oct 25 21:24:15 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:24:15 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:24:15 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612
Oct 25 21:24:15 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:24:15 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:24:15 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f
Oct 25 21:24:15 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:24:15 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:24:15 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:24:15 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:24:15 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:24:15 user nova-compute[74189]: FIRMWARE:
Oct 25 21:24:15 user nova-compute[74189]: No targets found.
Oct 25 21:24:15 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:24:15 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:24:15 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da8b356-c68d-404a-b0e7-82d2e834073b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c901ea41-c56f-430a-a93d-d7616a7dd3ed]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:24:15 user nova-compute[74189]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:24:15 user nova-compute[74189]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)
Oct 25 21:24:15 user nova-compute[74189]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:24:15 user nova-compute[74189]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612 (non-flash)
Oct 25 21:24:15 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:24:15 user nova-compute[74189]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 (non-flash)
Oct 25 21:24:15 user nova-compute[74189]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)
Oct 25 21:24:15 user nova-compute[74189]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:24:15 user nova-compute[74189]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612 (non-flash)
Oct 25 21:24:15 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2e4243130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78'): ({'sdd'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Removing single pathed devices sdd {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG nova.network.neutron [req-f37bb815-0308-43c7-9b4f-6b98f9f9ffb1 req-b70e98d9-cc83-43ca-86cc-9cbd4d7b9462 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Updated VIF entry in instance network info cache for port 54123e00-9921-4807-b1f7-79073453a82f. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG nova.network.neutron [req-f37bb815-0308-43c7-9b4f-6b98f9f9ffb1 req-b70e98d9-cc83-43ca-86cc-9cbd4d7b9462 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Updating instance_info_cache with network_info: [{"id": "54123e00-9921-4807-b1f7-79073453a82f", "address": "fa:16:3e:02:6a:1d", "network": {"id": "3159e1a7-f60f-4768-9e06-a92287d19dd6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-119288589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046417147a924afdbc8b72333c362261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54123e00-99", "ovs_interfaceid": "54123e00-9921-4807-b1f7-79073453a82f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7751a3bc-fd9f-49db-b39e-3a3227deb2e2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f37bb815-0308-43c7-9b4f-6b98f9f9ffb1 req-b70e98d9-cc83-43ca-86cc-9cbd4d7b9462 service nova] Releasing lock "refresh_cache-75071d8a-2ce2-43b5-99f6-23853399dc97" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a608e9e-dc95-4d7f-98eb-ee894133c4e5]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Flushing IO for device /dev/sdd {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9884f59e-aac4-407d-9dde-a8869a496c5d]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cd13c6-19bd-4bbb-a90b-a5cc78a426c9]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] SCSI volumes sdd have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f5df68-718e-4b8d-9c28-04fedafa3c07]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:24:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:16 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfe1ba5-9505-47bf-b4aa-a433372c45c6]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:24:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78, portal: 172.16.0.220,3260]
Oct 25 21:24:16 user nova-compute[74189]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78, portal: 172.16.0.220,3260] successful.
Oct 25 21:24:16 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:24:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed35ad-5534-47eb-93f6-2393d45d9e78 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:16 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[10974322-8ecc-411f-bd64-ced34f9eaab0]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:24:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:24:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:24:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] <== disconnect_volume: return (316ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:24:16 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:24:16 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Deleting instance files /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3_del
Oct 25 21:24:16 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Deletion of /opt/stack/data/nova/instances/5d21b93a-b312-4c1b-9e43-ffb4b729c7d3_del complete
Oct 25 21:24:16 user nova-compute[74189]: INFO nova.compute.manager [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Took 1.38 seconds to destroy the instance on the hypervisor.
Oct 25 21:24:16 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:24:16 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:24:16 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:24:16 user nova-compute[74189]: DEBUG nova.compute.manager [None req-b0c63bba-1f18-49b0-bf90-2d2660e423fe tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:24:16 user nova-compute[74189]: INFO nova.compute.manager [None req-b0c63bba-1f18-49b0-bf90-2d2660e423fe tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] instance snapshotting
Oct 25 21:24:16 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-b0c63bba-1f18-49b0-bf90-2d2660e423fe tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Beginning live snapshot process
Oct 25 21:24:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b0c63bba-1f18-49b0-bf90-2d2660e423fe tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk --force-share --output=json -f qcow2 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b0c63bba-1f18-49b0-bf90-2d2660e423fe tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk --force-share --output=json -f qcow2" returned: 0 in 0.218s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b0c63bba-1f18-49b0-bf90-2d2660e423fe tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk --force-share --output=json -f qcow2 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:16 user nova-compute[74189]: DEBUG nova.compute.manager [req-298ff639-9b76-4f4f-a466-2fb03361b268 req-ec85c88e-8604-4bd0-8523-c8f84868a1e3 service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Received event network-vif-deleted-c6a0280f-def7-4677-910c-7a3a3c6b57df {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:24:16 user nova-compute[74189]: INFO nova.compute.manager [req-298ff639-9b76-4f4f-a466-2fb03361b268 req-ec85c88e-8604-4bd0-8523-c8f84868a1e3 service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Neutron deleted interface c6a0280f-def7-4677-910c-7a3a3c6b57df; detaching it from the instance and deleting it from the info cache
Oct 25 21:24:16 user nova-compute[74189]: DEBUG nova.network.neutron [req-298ff639-9b76-4f4f-a466-2fb03361b268 req-ec85c88e-8604-4bd0-8523-c8f84868a1e3 service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:24:16 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:24:16 user nova-compute[74189]: DEBUG nova.compute.manager [req-298ff639-9b76-4f4f-a466-2fb03361b268 req-ec85c88e-8604-4bd0-8523-c8f84868a1e3 service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Detach interface failed, port_id=c6a0280f-def7-4677-910c-7a3a3c6b57df, reason: Instance 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3 could not be found. {{(pid=74189) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 21:24:16 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Took 0.80 seconds to deallocate network for instance.
Oct 25 21:24:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b0c63bba-1f18-49b0-bf90-2d2660e423fe tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk --force-share --output=json -f qcow2" returned: 0 in 0.242s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b0c63bba-1f18-49b0-bf90-2d2660e423fe tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b0c63bba-1f18-49b0-bf90-2d2660e423fe tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.233s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b0c63bba-1f18-49b0-bf90-2d2660e423fe tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpr2w2lvxj/15d647df6948491a94427ee8cad5483a.delta 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b0c63bba-1f18-49b0-bf90-2d2660e423fe tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpr2w2lvxj/15d647df6948491a94427ee8cad5483a.delta 1073741824" returned: 0 in 0.062s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:17 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-b0c63bba-1f18-49b0-bf90-2d2660e423fe tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 25 21:24:17 user nova-compute[74189]: DEBUG nova.compute.manager [req-e6a367b1-4f2c-4a30-aaaf-9ac7ffe6f8c1 req-c87cab97-5d39-4952-9aa5-04ada161a767 service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Received event network-vif-plugged-c6a0280f-def7-4677-910c-7a3a3c6b57df {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:24:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e6a367b1-4f2c-4a30-aaaf-9ac7ffe6f8c1 req-c87cab97-5d39-4952-9aa5-04ada161a767 service nova] Acquiring lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:24:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e6a367b1-4f2c-4a30-aaaf-9ac7ffe6f8c1 req-c87cab97-5d39-4952-9aa5-04ada161a767 service nova] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:24:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e6a367b1-4f2c-4a30-aaaf-9ac7ffe6f8c1 req-c87cab97-5d39-4952-9aa5-04ada161a767 service nova] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:24:17 user nova-compute[74189]: DEBUG nova.compute.manager [req-e6a367b1-4f2c-4a30-aaaf-9ac7ffe6f8c1 req-c87cab97-5d39-4952-9aa5-04ada161a767 service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] No waiting events found dispatching network-vif-plugged-c6a0280f-def7-4677-910c-7a3a3c6b57df {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:24:17 user nova-compute[74189]: WARNING nova.compute.manager [req-e6a367b1-4f2c-4a30-aaaf-9ac7ffe6f8c1 req-c87cab97-5d39-4952-9aa5-04ada161a767 service nova] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Received unexpected event network-vif-plugged-c6a0280f-def7-4677-910c-7a3a3c6b57df for instance with vm_state active and task_state deleting.
Oct 25 21:24:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:18 user nova-compute[74189]: INFO nova.compute.manager [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] [instance: 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3] Took 1.14 seconds to detach 1 volumes for instance.
Oct 25 21:24:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:24:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:24:18 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-b0c63bba-1f18-49b0-bf90-2d2660e423fe tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74189) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 21:24:18 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:24:18 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:24:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.568s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:24:18 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-b0c63bba-1f18-49b0-bf90-2d2660e423fe tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] COPY block job progress, current cursor: 75366400 final cursor: 75563008 {{(pid=74189) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 21:24:18 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Deleted allocations for instance 5d21b93a-b312-4c1b-9e43-ffb4b729c7d3
Oct 25 21:24:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-27828ad9-ee41-466a-9b52-e60ae91e5fec tempest-ServerActionsTestOtherB-40176194 tempest-ServerActionsTestOtherB-40176194-project-member] Lock "5d21b93a-b312-4c1b-9e43-ffb4b729c7d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.089s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:24:19 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-b0c63bba-1f18-49b0-bf90-2d2660e423fe tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74189) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 21:24:19 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-b0c63bba-1f18-49b0-bf90-2d2660e423fe tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 25 21:24:19 user nova-compute[74189]: DEBUG nova.privsep.utils [None req-b0c63bba-1f18-49b0-bf90-2d2660e423fe tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74189) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 21:24:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b0c63bba-1f18-49b0-bf90-2d2660e423fe tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpr2w2lvxj/15d647df6948491a94427ee8cad5483a.delta /opt/stack/data/nova/instances/snapshots/tmpr2w2lvxj/15d647df6948491a94427ee8cad5483a {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b0c63bba-1f18-49b0-bf90-2d2660e423fe tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpr2w2lvxj/15d647df6948491a94427ee8cad5483a.delta /opt/stack/data/nova/instances/snapshots/tmpr2w2lvxj/15d647df6948491a94427ee8cad5483a" returned: 0 in 0.689s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:20 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-b0c63bba-1f18-49b0-bf90-2d2660e423fe tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Snapshot extracted, beginning image upload
Oct 25 21:24:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:22 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-b0c63bba-1f18-49b0-bf90-2d2660e423fe tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Snapshot image upload complete
Oct 25 21:24:22 user nova-compute[74189]: INFO nova.compute.manager [None req-b0c63bba-1f18-49b0-bf90-2d2660e423fe tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Took 6.51 seconds to snapshot the instance on the hypervisor.
Oct 25 21:24:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "0b4f80c4-98cc-440a-aac7-cd423b71a231" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:24:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "0b4f80c4-98cc-440a-aac7-cd423b71a231" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:24:26 user nova-compute[74189]: DEBUG nova.compute.manager [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:24:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:24:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:24:26 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:24:26 user nova-compute[74189]: INFO nova.compute.claims [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Claim successful on node user
Oct 25 21:24:27 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:24:27 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:24:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.557s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:24:27 user nova-compute[74189]: DEBUG nova.compute.manager [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:24:27 user nova-compute[74189]: DEBUG nova.compute.manager [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:24:27 user nova-compute[74189]: DEBUG nova.network.neutron [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:24:27 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:24:27 user nova-compute[74189]: DEBUG nova.compute.manager [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:24:27 user nova-compute[74189]: DEBUG nova.policy [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc377c1beaab443683a6d776f2f734ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acbb4f93936848a8949477ad124bf98e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:24:27 user nova-compute[74189]: DEBUG nova.compute.manager [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:24:27 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:24:27 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Creating image(s)
Oct 25 21:24:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "/opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:24:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "/opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:24:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "/opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:24:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.204s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:24:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:24:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.184s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk 1073741824" returned: 0 in 0.094s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:24:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:28 user nova-compute[74189]: DEBUG nova.network.neutron [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Successfully created port: ea4ece99-327d-46c3-9b70-762c2ceafa61 {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:24:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.262s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:28 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:24:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:24:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:24:28 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Cannot resize image /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:24:28 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:24:28 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Ensure instance console log exists: /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:24:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:24:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:24:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.network.neutron [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Successfully updated port: ea4ece99-327d-46c3-9b70-762c2ceafa61 {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "refresh_cache-0b4f80c4-98cc-440a-aac7-cd423b71a231" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquired lock "refresh_cache-0b4f80c4-98cc-440a-aac7-cd423b71a231" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.network.neutron [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-2aabaf38-106e-4efe-abed-6bf8b8cb5222 req-769f848a-55e9-434f-b65a-a319a4309e42 service nova] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Received event network-changed-ea4ece99-327d-46c3-9b70-762c2ceafa61 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-2aabaf38-106e-4efe-abed-6bf8b8cb5222 req-769f848a-55e9-434f-b65a-a319a4309e42 service nova] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Refreshing instance network info cache due to event network-changed-ea4ece99-327d-46c3-9b70-762c2ceafa61. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2aabaf38-106e-4efe-abed-6bf8b8cb5222 req-769f848a-55e9-434f-b65a-a319a4309e42 service nova] Acquiring lock "refresh_cache-0b4f80c4-98cc-440a-aac7-cd423b71a231" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.network.neutron [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.network.neutron [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Updating instance_info_cache with network_info: [{"id": "ea4ece99-327d-46c3-9b70-762c2ceafa61", "address": "fa:16:3e:3f:e7:2a", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4ece99-32", "ovs_interfaceid": "ea4ece99-327d-46c3-9b70-762c2ceafa61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Releasing lock "refresh_cache-0b4f80c4-98cc-440a-aac7-cd423b71a231" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.compute.manager [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Instance network_info: |[{"id": "ea4ece99-327d-46c3-9b70-762c2ceafa61", "address": "fa:16:3e:3f:e7:2a", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4ece99-32", "ovs_interfaceid": "ea4ece99-327d-46c3-9b70-762c2ceafa61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2aabaf38-106e-4efe-abed-6bf8b8cb5222 req-769f848a-55e9-434f-b65a-a319a4309e42 service nova] Acquired lock "refresh_cache-0b4f80c4-98cc-440a-aac7-cd423b71a231" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.network.neutron [req-2aabaf38-106e-4efe-abed-6bf8b8cb5222 req-769f848a-55e9-434f-b65a-a319a4309e42 service nova] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Refreshing network info cache for port ea4ece99-327d-46c3-9b70-762c2ceafa61 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Start _get_guest_xml network_info=[{"id": "ea4ece99-327d-46c3-9b70-762c2ceafa61", "address": "fa:16:3e:3f:e7:2a", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4ece99-32", "ovs_interfaceid": "ea4ece99-327d-46c3-9b70-762c2ceafa61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:24:29 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:24:29 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:24:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-837784140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-837784140',id=22,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='acbb4f93936848a8949477ad124bf98e',ramdisk_id='',reservation_id='r-jebb70wk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-571481303',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:24:28Z,user_data=None,user_id='fc377c1beaab443683a6d776f2f734ff',uuid=0b4f80c4-98cc-440a-aac7-cd423b71a231,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea4ece99-327d-46c3-9b70-762c2ceafa61", "address": "fa:16:3e:3f:e7:2a", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4ece99-32", "ovs_interfaceid": "ea4ece99-327d-46c3-9b70-762c2ceafa61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Converting VIF {"id": "ea4ece99-327d-46c3-9b70-762c2ceafa61", "address": "fa:16:3e:3f:e7:2a", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4ece99-32", "ovs_interfaceid": "ea4ece99-327d-46c3-9b70-762c2ceafa61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:e7:2a,bridge_name='br-int',has_traffic_filtering=True,id=ea4ece99-327d-46c3-9b70-762c2ceafa61,network=Network(f202171f-dfd8-4a19-9321-788318413ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea4ece99-32') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.objects.instance [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b4f80c4-98cc-440a-aac7-cd423b71a231 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:24:29 user nova-compute[74189]:   <uuid>0b4f80c4-98cc-440a-aac7-cd423b71a231</uuid>
Oct 25 21:24:29 user nova-compute[74189]:   <name>instance-00000016</name>
Oct 25 21:24:29 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:24:29 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:24:29 user nova-compute[74189]:   <metadata>
Oct 25 21:24:29 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:24:29 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:24:29 user nova-compute[74189]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-837784140</nova:name>
Oct 25 21:24:29 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:24:29</nova:creationTime>
Oct 25 21:24:29 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:24:29 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:24:29 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:24:29 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:24:29 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:24:29 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:24:29 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:24:29 user nova-compute[74189]:       <nova:owner>
Oct 25 21:24:29 user nova-compute[74189]:         <nova:user uuid="fc377c1beaab443683a6d776f2f734ff">tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member</nova:user>
Oct 25 21:24:29 user nova-compute[74189]:         <nova:project uuid="acbb4f93936848a8949477ad124bf98e">tempest-ServerBootFromVolumeStableRescueTest-571481303</nova:project>
Oct 25 21:24:29 user nova-compute[74189]:       </nova:owner>
Oct 25 21:24:29 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:24:29 user nova-compute[74189]:       <nova:ports>
Oct 25 21:24:29 user nova-compute[74189]:         <nova:port uuid="ea4ece99-327d-46c3-9b70-762c2ceafa61">
Oct 25 21:24:29 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 25 21:24:29 user nova-compute[74189]:         </nova:port>
Oct 25 21:24:29 user nova-compute[74189]:       </nova:ports>
Oct 25 21:24:29 user nova-compute[74189]:     </nova:instance>
Oct 25 21:24:29 user nova-compute[74189]:   </metadata>
Oct 25 21:24:29 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:24:29 user nova-compute[74189]:     <system>
Oct 25 21:24:29 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:24:29 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:24:29 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:24:29 user nova-compute[74189]:       <entry name="serial">0b4f80c4-98cc-440a-aac7-cd423b71a231</entry>
Oct 25 21:24:29 user nova-compute[74189]:       <entry name="uuid">0b4f80c4-98cc-440a-aac7-cd423b71a231</entry>
Oct 25 21:24:29 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:24:29 user nova-compute[74189]:     </system>
Oct 25 21:24:29 user nova-compute[74189]:   </sysinfo>
Oct 25 21:24:29 user nova-compute[74189]:   <os>
Oct 25 21:24:29 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:24:29 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:24:29 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:24:29 user nova-compute[74189]:   </os>
Oct 25 21:24:29 user nova-compute[74189]:   <features>
Oct 25 21:24:29 user nova-compute[74189]:     <acpi/>
Oct 25 21:24:29 user nova-compute[74189]:     <apic/>
Oct 25 21:24:29 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:24:29 user nova-compute[74189]:   </features>
Oct 25 21:24:29 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:24:29 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:24:29 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:24:29 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:24:29 user nova-compute[74189]:   </clock>
Oct 25 21:24:29 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:24:29 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:24:29 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:24:29 user nova-compute[74189]:   </cpu>
Oct 25 21:24:29 user nova-compute[74189]:   <devices>
Oct 25 21:24:29 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:24:29 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:24:29 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk"/>
Oct 25 21:24:29 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:24:29 user nova-compute[74189]:     </disk>
Oct 25 21:24:29 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:24:29 user nova-compute[74189]:       <mac address="fa:16:3e:3f:e7:2a"/>
Oct 25 21:24:29 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:24:29 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:24:29 user nova-compute[74189]:       <target dev="tapea4ece99-32"/>
Oct 25 21:24:29 user nova-compute[74189]:     </interface>
Oct 25 21:24:29 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:24:29 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/console.log" append="off"/>
Oct 25 21:24:29 user nova-compute[74189]:     </serial>
Oct 25 21:24:29 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:24:29 user nova-compute[74189]:     <video>
Oct 25 21:24:29 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:24:29 user nova-compute[74189]:     </video>
Oct 25 21:24:29 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:24:29 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:24:29 user nova-compute[74189]:     </rng>
Oct 25 21:24:29 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:24:29 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:24:29 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:24:29 user nova-compute[74189]:     </memballoon>
Oct 25 21:24:29 user nova-compute[74189]:   </devices>
Oct 25 21:24:29 user nova-compute[74189]: </domain>
Oct 25 21:24:29 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:24:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-837784140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-837784140',id=22,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='acbb4f93936848a8949477ad124bf98e',ramdisk_id='',reservation_id='r-jebb70wk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-571481303',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:24:28Z,user_data=None,user_id='fc377c1beaab443683a6d776f2f734ff',uuid=0b4f80c4-98cc-440a-aac7-cd423b71a231,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea4ece99-327d-46c3-9b70-762c2ceafa61", "address": "fa:16:3e:3f:e7:2a", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4ece99-32", "ovs_interfaceid": "ea4ece99-327d-46c3-9b70-762c2ceafa61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Converting VIF {"id": "ea4ece99-327d-46c3-9b70-762c2ceafa61", "address": "fa:16:3e:3f:e7:2a", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4ece99-32", "ovs_interfaceid": "ea4ece99-327d-46c3-9b70-762c2ceafa61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:e7:2a,bridge_name='br-int',has_traffic_filtering=True,id=ea4ece99-327d-46c3-9b70-762c2ceafa61,network=Network(f202171f-dfd8-4a19-9321-788318413ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea4ece99-32') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG os_vif [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:e7:2a,bridge_name='br-int',has_traffic_filtering=True,id=ea4ece99-327d-46c3-9b70-762c2ceafa61,network=Network(f202171f-dfd8-4a19-9321-788318413ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea4ece99-32') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '300438a3-a3fb-5a7a-9627-4567279044ec', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea4ece99-32, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea4ece99-32, col_values=(('qos', UUID('8a95ad1d-66bd-40b6-ba01-249ca3c87265')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea4ece99-32, col_values=(('external_ids', {'iface-id': 'ea4ece99-327d-46c3-9b70-762c2ceafa61', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:e7:2a', 'vm-uuid': '0b4f80c4-98cc-440a-aac7-cd423b71a231'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:29 user nova-compute[74189]: INFO os_vif [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:e7:2a,bridge_name='br-int',has_traffic_filtering=True,id=ea4ece99-327d-46c3-9b70-762c2ceafa61,network=Network(f202171f-dfd8-4a19-9321-788318413ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea4ece99-32')
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] No VIF found with MAC fa:16:3e:3f:e7:2a, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.network.neutron [req-2aabaf38-106e-4efe-abed-6bf8b8cb5222 req-769f848a-55e9-434f-b65a-a319a4309e42 service nova] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Updated VIF entry in instance network info cache for port ea4ece99-327d-46c3-9b70-762c2ceafa61. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:24:29 user nova-compute[74189]: DEBUG nova.network.neutron [req-2aabaf38-106e-4efe-abed-6bf8b8cb5222 req-769f848a-55e9-434f-b65a-a319a4309e42 service nova] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Updating instance_info_cache with network_info: [{"id": "ea4ece99-327d-46c3-9b70-762c2ceafa61", "address": "fa:16:3e:3f:e7:2a", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4ece99-32", "ovs_interfaceid": "ea4ece99-327d-46c3-9b70-762c2ceafa61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:24:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2aabaf38-106e-4efe-abed-6bf8b8cb5222 req-769f848a-55e9-434f-b65a-a319a4309e42 service nova] Releasing lock "refresh_cache-0b4f80c4-98cc-440a-aac7-cd423b71a231" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:24:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:31 user nova-compute[74189]: DEBUG nova.compute.manager [req-563f7c52-a988-4b00-9765-470179036ff9 req-9bac3ab7-b932-4b4f-8b2c-b74155f81d3e service nova] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Received event network-vif-plugged-ea4ece99-327d-46c3-9b70-762c2ceafa61 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:24:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-563f7c52-a988-4b00-9765-470179036ff9 req-9bac3ab7-b932-4b4f-8b2c-b74155f81d3e service nova] Acquiring lock "0b4f80c4-98cc-440a-aac7-cd423b71a231-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:24:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-563f7c52-a988-4b00-9765-470179036ff9 req-9bac3ab7-b932-4b4f-8b2c-b74155f81d3e service nova] Lock "0b4f80c4-98cc-440a-aac7-cd423b71a231-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:24:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-563f7c52-a988-4b00-9765-470179036ff9 req-9bac3ab7-b932-4b4f-8b2c-b74155f81d3e service nova] Lock "0b4f80c4-98cc-440a-aac7-cd423b71a231-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:24:31 user nova-compute[74189]: DEBUG nova.compute.manager [req-563f7c52-a988-4b00-9765-470179036ff9 req-9bac3ab7-b932-4b4f-8b2c-b74155f81d3e service nova] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] No waiting events found dispatching network-vif-plugged-ea4ece99-327d-46c3-9b70-762c2ceafa61 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:24:31 user nova-compute[74189]: WARNING nova.compute.manager [req-563f7c52-a988-4b00-9765-470179036ff9 req-9bac3ab7-b932-4b4f-8b2c-b74155f81d3e service nova] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Received unexpected event network-vif-plugged-ea4ece99-327d-46c3-9b70-762c2ceafa61 for instance with vm_state building and task_state spawning.
Oct 25 21:24:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-79c93c72-b1ba-4577-acd2-fd8ca5c66368 req-ab5b89d9-a2d9-4dd5-a224-048d20f2df78 service nova] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Received event network-vif-plugged-ea4ece99-327d-46c3-9b70-762c2ceafa61 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:24:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-79c93c72-b1ba-4577-acd2-fd8ca5c66368 req-ab5b89d9-a2d9-4dd5-a224-048d20f2df78 service nova] Acquiring lock "0b4f80c4-98cc-440a-aac7-cd423b71a231-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:24:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-79c93c72-b1ba-4577-acd2-fd8ca5c66368 req-ab5b89d9-a2d9-4dd5-a224-048d20f2df78 service nova] Lock "0b4f80c4-98cc-440a-aac7-cd423b71a231-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:24:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-79c93c72-b1ba-4577-acd2-fd8ca5c66368 req-ab5b89d9-a2d9-4dd5-a224-048d20f2df78 service nova] Lock "0b4f80c4-98cc-440a-aac7-cd423b71a231-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:24:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-79c93c72-b1ba-4577-acd2-fd8ca5c66368 req-ab5b89d9-a2d9-4dd5-a224-048d20f2df78 service nova] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] No waiting events found dispatching network-vif-plugged-ea4ece99-327d-46c3-9b70-762c2ceafa61 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:24:33 user nova-compute[74189]: WARNING nova.compute.manager [req-79c93c72-b1ba-4577-acd2-fd8ca5c66368 req-ab5b89d9-a2d9-4dd5-a224-048d20f2df78 service nova] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Received unexpected event network-vif-plugged-ea4ece99-327d-46c3-9b70-762c2ceafa61 for instance with vm_state building and task_state spawning.
Oct 25 21:24:33 user nova-compute[74189]: DEBUG nova.compute.manager [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:24:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:24:33 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Instance spawned successfully.
Oct 25 21:24:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:24:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:24:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:24:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:24:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:24:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:24:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:24:33 user nova-compute[74189]: INFO nova.compute.manager [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Took 6.16 seconds to spawn the instance on the hypervisor.
Oct 25 21:24:33 user nova-compute[74189]: DEBUG nova.compute.manager [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:24:34 user nova-compute[74189]: INFO nova.compute.manager [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Took 7.16 seconds to build instance.
Oct 25 21:24:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-af60a7c8-b402-4266-b3e0-b49220d75a4a tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "0b4f80c4-98cc-440a-aac7-cd423b71a231" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.328s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:24:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:53 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:24:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Acquiring lock "f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Lock "f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:01 user nova-compute[74189]: DEBUG nova.compute.manager [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:25:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:01 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:25:01 user nova-compute[74189]: INFO nova.compute.claims [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Claim successful on node user
Oct 25 21:25:01 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:25:01 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:25:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:02 user nova-compute[74189]: DEBUG nova.compute.manager [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:25:02 user nova-compute[74189]: DEBUG nova.compute.manager [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:25:02 user nova-compute[74189]: DEBUG nova.network.neutron [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:25:02 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:25:02 user nova-compute[74189]: DEBUG nova.compute.manager [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:25:02 user nova-compute[74189]: DEBUG nova.policy [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '581bc72458b64b3184021d2b39c96bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc56f5ca1b142d199c360c89d552569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:25:02 user nova-compute[74189]: DEBUG nova.compute.manager [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:25:02 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:25:02 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Creating image(s)
Oct 25 21:25:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Acquiring lock "/opt/stack/data/nova/instances/f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Lock "/opt/stack/data/nova/instances/f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Lock "/opt/stack/data/nova/instances/f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.464s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:02 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:25:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.210s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d/disk 1073741824" returned: 0 in 0.056s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.203s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:03 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:25:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:03 user nova-compute[74189]: DEBUG nova.network.neutron [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Successfully created port: b3fce63c-7b53-4a74-ad26-0e547a9643a0 {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:25:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:03 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Cannot resize image /opt/stack/data/nova/instances/f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:25:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:25:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Ensure instance console log exists: /opt/stack/data/nova/instances/f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:25:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:03 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:25:03 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:25:03 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:25:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:03 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:25:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:04 user nova-compute[74189]: DEBUG nova.network.neutron [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Successfully updated port: b3fce63c-7b53-4a74-ad26-0e547a9643a0 {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:25:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Acquiring lock "refresh_cache-f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:25:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Acquired lock "refresh_cache-f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:25:04 user nova-compute[74189]: DEBUG nova.network.neutron [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:25:04 user nova-compute[74189]: DEBUG nova.compute.manager [req-8915dd9c-2a05-40c4-99c1-f7f64c277b59 req-254a2b5f-bdde-4627-a050-49724bed7645 service nova] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Received event network-changed-b3fce63c-7b53-4a74-ad26-0e547a9643a0 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:25:04 user nova-compute[74189]: DEBUG nova.compute.manager [req-8915dd9c-2a05-40c4-99c1-f7f64c277b59 req-254a2b5f-bdde-4627-a050-49724bed7645 service nova] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Refreshing instance network info cache due to event network-changed-b3fce63c-7b53-4a74-ad26-0e547a9643a0. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:25:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8915dd9c-2a05-40c4-99c1-f7f64c277b59 req-254a2b5f-bdde-4627-a050-49724bed7645 service nova] Acquiring lock "refresh_cache-f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:25:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:04 user nova-compute[74189]: DEBUG nova.network.neutron [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:25:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG nova.network.neutron [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Updating instance_info_cache with network_info: [{"id": "b3fce63c-7b53-4a74-ad26-0e547a9643a0", "address": "fa:16:3e:27:ed:f4", "network": {"id": "a10206fb-faee-4e14-9b44-b5e9274f7c92", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-96164946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fc56f5ca1b142d199c360c89d552569", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fce63c-7b", "ovs_interfaceid": "b3fce63c-7b53-4a74-ad26-0e547a9643a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Releasing lock "refresh_cache-f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG nova.compute.manager [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Instance network_info: |[{"id": "b3fce63c-7b53-4a74-ad26-0e547a9643a0", "address": "fa:16:3e:27:ed:f4", "network": {"id": "a10206fb-faee-4e14-9b44-b5e9274f7c92", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-96164946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fc56f5ca1b142d199c360c89d552569", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fce63c-7b", "ovs_interfaceid": "b3fce63c-7b53-4a74-ad26-0e547a9643a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8915dd9c-2a05-40c4-99c1-f7f64c277b59 req-254a2b5f-bdde-4627-a050-49724bed7645 service nova] Acquired lock "refresh_cache-f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG nova.network.neutron [req-8915dd9c-2a05-40c4-99c1-f7f64c277b59 req-254a2b5f-bdde-4627-a050-49724bed7645 service nova] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Refreshing network info cache for port b3fce63c-7b53-4a74-ad26-0e547a9643a0 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Start _get_guest_xml network_info=[{"id": "b3fce63c-7b53-4a74-ad26-0e547a9643a0", "address": "fa:16:3e:27:ed:f4", "network": {"id": "a10206fb-faee-4e14-9b44-b5e9274f7c92", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-96164946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fc56f5ca1b142d199c360c89d552569", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fce63c-7b", "ovs_interfaceid": "b3fce63c-7b53-4a74-ad26-0e547a9643a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:25:05 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:25:05 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:25:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:25:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1896830380',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1896830380',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1896830',id=23,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmdmBlruzeO69b8Enhlo/WWJ0YMqZf3SEYOGNZgxbWOywXnXBY/txc7D1d00anmQoDKjG8hFHQyPcD7dAMqs7daE2pOCU7qcWVUQzQTxtvJrYb3LxLj5ggpAb+3qXxJAA==',key_name='tempest-keypair-103280081',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fc56f5ca1b142d199c360c89d552569',ramdisk_id='',reservation_id='r-lmknv7mt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-758874110',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:25:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='581bc72458b64b3184021d2b39c96bac',uuid=f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3fce63c-7b53-4a74-ad26-0e547a9643a0", "address": "fa:16:3e:27:ed:f4", "network": {"id": "a10206fb-faee-4e14-9b44-b5e9274f7c92", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-96164946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fc56f5ca1b142d199c360c89d552569", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fce63c-7b", "ovs_interfaceid": "b3fce63c-7b53-4a74-ad26-0e547a9643a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Converting VIF {"id": "b3fce63c-7b53-4a74-ad26-0e547a9643a0", "address": "fa:16:3e:27:ed:f4", "network": {"id": "a10206fb-faee-4e14-9b44-b5e9274f7c92", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-96164946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fc56f5ca1b142d199c360c89d552569", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fce63c-7b", "ovs_interfaceid": "b3fce63c-7b53-4a74-ad26-0e547a9643a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:ed:f4,bridge_name='br-int',has_traffic_filtering=True,id=b3fce63c-7b53-4a74-ad26-0e547a9643a0,network=Network(a10206fb-faee-4e14-9b44-b5e9274f7c92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3fce63c-7b') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG nova.objects.instance [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Lazy-loading 'pci_devices' on Instance uuid f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:25:05 user nova-compute[74189]:   <uuid>f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d</uuid>
Oct 25 21:25:05 user nova-compute[74189]:   <name>instance-00000017</name>
Oct 25 21:25:05 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:25:05 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:25:05 user nova-compute[74189]:   <metadata>
Oct 25 21:25:05 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:25:05 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:25:05 user nova-compute[74189]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1896830380</nova:name>
Oct 25 21:25:05 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:25:05</nova:creationTime>
Oct 25 21:25:05 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:25:05 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:25:05 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:25:05 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:25:05 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:25:05 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:25:05 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:25:05 user nova-compute[74189]:       <nova:owner>
Oct 25 21:25:05 user nova-compute[74189]:         <nova:user uuid="581bc72458b64b3184021d2b39c96bac">tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member</nova:user>
Oct 25 21:25:05 user nova-compute[74189]:         <nova:project uuid="7fc56f5ca1b142d199c360c89d552569">tempest-TestServerVolumeAttachScenarioOldVersion-758874110</nova:project>
Oct 25 21:25:05 user nova-compute[74189]:       </nova:owner>
Oct 25 21:25:05 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:25:05 user nova-compute[74189]:       <nova:ports>
Oct 25 21:25:05 user nova-compute[74189]:         <nova:port uuid="b3fce63c-7b53-4a74-ad26-0e547a9643a0">
Oct 25 21:25:05 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 25 21:25:05 user nova-compute[74189]:         </nova:port>
Oct 25 21:25:05 user nova-compute[74189]:       </nova:ports>
Oct 25 21:25:05 user nova-compute[74189]:     </nova:instance>
Oct 25 21:25:05 user nova-compute[74189]:   </metadata>
Oct 25 21:25:05 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:25:05 user nova-compute[74189]:     <system>
Oct 25 21:25:05 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:25:05 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:25:05 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:25:05 user nova-compute[74189]:       <entry name="serial">f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d</entry>
Oct 25 21:25:05 user nova-compute[74189]:       <entry name="uuid">f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d</entry>
Oct 25 21:25:05 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:25:05 user nova-compute[74189]:     </system>
Oct 25 21:25:05 user nova-compute[74189]:   </sysinfo>
Oct 25 21:25:05 user nova-compute[74189]:   <os>
Oct 25 21:25:05 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:25:05 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:25:05 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:25:05 user nova-compute[74189]:   </os>
Oct 25 21:25:05 user nova-compute[74189]:   <features>
Oct 25 21:25:05 user nova-compute[74189]:     <acpi/>
Oct 25 21:25:05 user nova-compute[74189]:     <apic/>
Oct 25 21:25:05 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:25:05 user nova-compute[74189]:   </features>
Oct 25 21:25:05 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:25:05 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:25:05 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:25:05 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:25:05 user nova-compute[74189]:   </clock>
Oct 25 21:25:05 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:25:05 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:25:05 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:25:05 user nova-compute[74189]:   </cpu>
Oct 25 21:25:05 user nova-compute[74189]:   <devices>
Oct 25 21:25:05 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:25:05 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:25:05 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d/disk"/>
Oct 25 21:25:05 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:25:05 user nova-compute[74189]:     </disk>
Oct 25 21:25:05 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:25:05 user nova-compute[74189]:       <mac address="fa:16:3e:27:ed:f4"/>
Oct 25 21:25:05 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:25:05 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:25:05 user nova-compute[74189]:       <target dev="tapb3fce63c-7b"/>
Oct 25 21:25:05 user nova-compute[74189]:     </interface>
Oct 25 21:25:05 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:25:05 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d/console.log" append="off"/>
Oct 25 21:25:05 user nova-compute[74189]:     </serial>
Oct 25 21:25:05 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:25:05 user nova-compute[74189]:     <video>
Oct 25 21:25:05 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:25:05 user nova-compute[74189]:     </video>
Oct 25 21:25:05 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:25:05 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:25:05 user nova-compute[74189]:     </rng>
Oct 25 21:25:05 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:25:05 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:25:05 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:25:05 user nova-compute[74189]:     </memballoon>
Oct 25 21:25:05 user nova-compute[74189]:   </devices>
Oct 25 21:25:05 user nova-compute[74189]: </domain>
Oct 25 21:25:05 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:25:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1896830380',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1896830380',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1896830',id=23,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmdmBlruzeO69b8Enhlo/WWJ0YMqZf3SEYOGNZgxbWOywXnXBY/txc7D1d00anmQoDKjG8hFHQyPcD7dAMqs7daE2pOCU7qcWVUQzQTxtvJrYb3LxLj5ggpAb+3qXxJAA==',key_name='tempest-keypair-103280081',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fc56f5ca1b142d199c360c89d552569',ramdisk_id='',reservation_id='r-lmknv7mt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-758874110',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:25:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='581bc72458b64b3184021d2b39c96bac',uuid=f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3fce63c-7b53-4a74-ad26-0e547a9643a0", "address": "fa:16:3e:27:ed:f4", "network": {"id": "a10206fb-faee-4e14-9b44-b5e9274f7c92", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-96164946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fc56f5ca1b142d199c360c89d552569", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fce63c-7b", "ovs_interfaceid": "b3fce63c-7b53-4a74-ad26-0e547a9643a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Converting VIF {"id": "b3fce63c-7b53-4a74-ad26-0e547a9643a0", "address": "fa:16:3e:27:ed:f4", "network": {"id": "a10206fb-faee-4e14-9b44-b5e9274f7c92", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-96164946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fc56f5ca1b142d199c360c89d552569", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fce63c-7b", "ovs_interfaceid": "b3fce63c-7b53-4a74-ad26-0e547a9643a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:ed:f4,bridge_name='br-int',has_traffic_filtering=True,id=b3fce63c-7b53-4a74-ad26-0e547a9643a0,network=Network(a10206fb-faee-4e14-9b44-b5e9274f7c92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3fce63c-7b') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG os_vif [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:ed:f4,bridge_name='br-int',has_traffic_filtering=True,id=b3fce63c-7b53-4a74-ad26-0e547a9643a0,network=Network(a10206fb-faee-4e14-9b44-b5e9274f7c92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3fce63c-7b') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '16b35bf9-cef7-5bd1-a8ef-056e8c3455c4', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3fce63c-7b, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3fce63c-7b, col_values=(('qos', UUID('1e93912b-d2ac-4f76-a819-97f66eda2970')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3fce63c-7b, col_values=(('external_ids', {'iface-id': 'b3fce63c-7b53-4a74-ad26-0e547a9643a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:ed:f4', 'vm-uuid': 'f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:05 user nova-compute[74189]: INFO os_vif [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:ed:f4,bridge_name='br-int',has_traffic_filtering=True,id=b3fce63c-7b53-4a74-ad26-0e547a9643a0,network=Network(a10206fb-faee-4e14-9b44-b5e9274f7c92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3fce63c-7b')
Oct 25 21:25:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] No VIF found with MAC fa:16:3e:27:ed:f4, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG nova.network.neutron [req-8915dd9c-2a05-40c4-99c1-f7f64c277b59 req-254a2b5f-bdde-4627-a050-49724bed7645 service nova] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Updated VIF entry in instance network info cache for port b3fce63c-7b53-4a74-ad26-0e547a9643a0. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG nova.network.neutron [req-8915dd9c-2a05-40c4-99c1-f7f64c277b59 req-254a2b5f-bdde-4627-a050-49724bed7645 service nova] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Updating instance_info_cache with network_info: [{"id": "b3fce63c-7b53-4a74-ad26-0e547a9643a0", "address": "fa:16:3e:27:ed:f4", "network": {"id": "a10206fb-faee-4e14-9b44-b5e9274f7c92", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-96164946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fc56f5ca1b142d199c360c89d552569", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fce63c-7b", "ovs_interfaceid": "b3fce63c-7b53-4a74-ad26-0e547a9643a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8915dd9c-2a05-40c4-99c1-f7f64c277b59 req-254a2b5f-bdde-4627-a050-49724bed7645 service nova] Releasing lock "refresh_cache-f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/680e134e-5e0d-464f-9e30-460010348795/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/680e134e-5e0d-464f-9e30-460010348795/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/680e134e-5e0d-464f-9e30-460010348795/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/680e134e-5e0d-464f-9e30-460010348795/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:06 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:25:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/384e5528-a8d3-49f3-bc21-e7dbf3d14cb5/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/384e5528-a8d3-49f3-bc21-e7dbf3d14cb5/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/384e5528-a8d3-49f3-bc21-e7dbf3d14cb5/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/384e5528-a8d3-49f3-bc21-e7dbf3d14cb5/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:09 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:09 user nova-compute[74189]: DEBUG nova.compute.manager [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:25:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:25:09 user nova-compute[74189]: DEBUG nova.compute.manager [req-cd9053a3-f341-439c-ac0c-127d0599d67b req-94d53f8a-d1e3-4b84-b540-f6a1408ca373 service nova] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Received event network-vif-plugged-b3fce63c-7b53-4a74-ad26-0e547a9643a0 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:25:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-cd9053a3-f341-439c-ac0c-127d0599d67b req-94d53f8a-d1e3-4b84-b540-f6a1408ca373 service nova] Acquiring lock "f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-cd9053a3-f341-439c-ac0c-127d0599d67b req-94d53f8a-d1e3-4b84-b540-f6a1408ca373 service nova] Lock "f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-cd9053a3-f341-439c-ac0c-127d0599d67b req-94d53f8a-d1e3-4b84-b540-f6a1408ca373 service nova] Lock "f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:09 user nova-compute[74189]: DEBUG nova.compute.manager [req-cd9053a3-f341-439c-ac0c-127d0599d67b req-94d53f8a-d1e3-4b84-b540-f6a1408ca373 service nova] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] No waiting events found dispatching network-vif-plugged-b3fce63c-7b53-4a74-ad26-0e547a9643a0 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:25:09 user nova-compute[74189]: WARNING nova.compute.manager [req-cd9053a3-f341-439c-ac0c-127d0599d67b req-94d53f8a-d1e3-4b84-b540-f6a1408ca373 service nova] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Received unexpected event network-vif-plugged-b3fce63c-7b53-4a74-ad26-0e547a9643a0 for instance with vm_state building and task_state spawning.
Oct 25 21:25:09 user nova-compute[74189]: DEBUG nova.compute.manager [req-9b2edc4c-5676-4f74-aff6-7f3d228d5d76 req-d5c3ef12-6030-423a-8369-f0be229f1b80 service nova] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Received event network-vif-plugged-b3fce63c-7b53-4a74-ad26-0e547a9643a0 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:25:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9b2edc4c-5676-4f74-aff6-7f3d228d5d76 req-d5c3ef12-6030-423a-8369-f0be229f1b80 service nova] Acquiring lock "f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9b2edc4c-5676-4f74-aff6-7f3d228d5d76 req-d5c3ef12-6030-423a-8369-f0be229f1b80 service nova] Lock "f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9b2edc4c-5676-4f74-aff6-7f3d228d5d76 req-d5c3ef12-6030-423a-8369-f0be229f1b80 service nova] Lock "f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:09 user nova-compute[74189]: DEBUG nova.compute.manager [req-9b2edc4c-5676-4f74-aff6-7f3d228d5d76 req-d5c3ef12-6030-423a-8369-f0be229f1b80 service nova] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] No waiting events found dispatching network-vif-plugged-b3fce63c-7b53-4a74-ad26-0e547a9643a0 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:25:09 user nova-compute[74189]: WARNING nova.compute.manager [req-9b2edc4c-5676-4f74-aff6-7f3d228d5d76 req-d5c3ef12-6030-423a-8369-f0be229f1b80 service nova] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Received unexpected event network-vif-plugged-b3fce63c-7b53-4a74-ad26-0e547a9643a0 for instance with vm_state building and task_state spawning.
Oct 25 21:25:09 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Instance spawned successfully.
Oct 25 21:25:09 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:25:09 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:25:09 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=7740MB free_disk=25.23537826538086GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:25:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:25:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:25:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:25:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:25:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:25:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:25:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:25:09 user nova-compute[74189]: INFO nova.compute.manager [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Took 7.36 seconds to spawn the instance on the hypervisor.
Oct 25 21:25:09 user nova-compute[74189]: DEBUG nova.compute.manager [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:25:09 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance d7c3a99a-ab38-4e88-896d-94ae51a09a48 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:25:09 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance af1d7b3c-9950-4b74-8f15-b31011ccfa24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:25:09 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 680e134e-5e0d-464f-9e30-460010348795 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:25:09 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance de6b6789-b328-4c3b-8d24-07774d5dbe6d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:25:09 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 932fe8ac-fdde-45c6-aa32-9bf866f19a4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:25:09 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 75071d8a-2ce2-43b5-99f6-23853399dc97 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:25:09 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:25:09 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3702433e-ec0e-4359-bc0c-d3a189d83caa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:25:09 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 0b4f80c4-98cc-440a-aac7-cd423b71a231 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:25:09 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:25:09 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:25:09 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:25:09 user nova-compute[74189]: INFO nova.compute.manager [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Took 8.29 seconds to build instance.
Oct 25 21:25:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b1db8708-148d-4494-beb7-a5a592e84ac3 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Lock "f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.408s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:10 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:25:10 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:25:10 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:25:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.619s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:11 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:25:11 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:25:11 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:25:11 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-680e134e-5e0d-464f-9e30-460010348795" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:25:11 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-680e134e-5e0d-464f-9e30-460010348795" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:25:11 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 680e134e-5e0d-464f-9e30-460010348795] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:25:11 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 680e134e-5e0d-464f-9e30-460010348795] Updating instance_info_cache with network_info: [{"id": "41682423-a7e4-44c2-9936-24fe7a965bf9", "address": "fa:16:3e:a3:82:56", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41682423-a7", "ovs_interfaceid": "41682423-a7e4-44c2-9936-24fe7a965bf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:25:11 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-680e134e-5e0d-464f-9e30-460010348795" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:25:11 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 680e134e-5e0d-464f-9e30-460010348795] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:25:11 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:25:11 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:25:11 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:25:11 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:25:11 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:25:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:17 user nova-compute[74189]: DEBUG nova.compute.manager [req-1d65ffa9-aabd-4d7a-a96e-2a90bbec9722 req-ac9a9ffe-fcd8-4b1b-a4a5-4a5f71ea9b8f service nova] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Received event network-changed-e2b72ea5-94f6-47f7-a022-55462da4489b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:25:17 user nova-compute[74189]: DEBUG nova.compute.manager [req-1d65ffa9-aabd-4d7a-a96e-2a90bbec9722 req-ac9a9ffe-fcd8-4b1b-a4a5-4a5f71ea9b8f service nova] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Refreshing instance network info cache due to event network-changed-e2b72ea5-94f6-47f7-a022-55462da4489b. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:25:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1d65ffa9-aabd-4d7a-a96e-2a90bbec9722 req-ac9a9ffe-fcd8-4b1b-a4a5-4a5f71ea9b8f service nova] Acquiring lock "refresh_cache-384e5528-a8d3-49f3-bc21-e7dbf3d14cb5" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:25:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1d65ffa9-aabd-4d7a-a96e-2a90bbec9722 req-ac9a9ffe-fcd8-4b1b-a4a5-4a5f71ea9b8f service nova] Acquired lock "refresh_cache-384e5528-a8d3-49f3-bc21-e7dbf3d14cb5" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:25:17 user nova-compute[74189]: DEBUG nova.network.neutron [req-1d65ffa9-aabd-4d7a-a96e-2a90bbec9722 req-ac9a9ffe-fcd8-4b1b-a4a5-4a5f71ea9b8f service nova] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Refreshing network info cache for port e2b72ea5-94f6-47f7-a022-55462da4489b {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:25:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d78802ea-a5a6-4093-af37-a3978e60579c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "384e5528-a8d3-49f3-bc21-e7dbf3d14cb5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d78802ea-a5a6-4093-af37-a3978e60579c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "384e5528-a8d3-49f3-bc21-e7dbf3d14cb5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d78802ea-a5a6-4093-af37-a3978e60579c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "384e5528-a8d3-49f3-bc21-e7dbf3d14cb5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d78802ea-a5a6-4093-af37-a3978e60579c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "384e5528-a8d3-49f3-bc21-e7dbf3d14cb5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d78802ea-a5a6-4093-af37-a3978e60579c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "384e5528-a8d3-49f3-bc21-e7dbf3d14cb5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:17 user nova-compute[74189]: INFO nova.compute.manager [None req-d78802ea-a5a6-4093-af37-a3978e60579c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Terminating instance
Oct 25 21:25:17 user nova-compute[74189]: DEBUG nova.compute.manager [None req-d78802ea-a5a6-4093-af37-a3978e60579c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:25:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:17 user nova-compute[74189]: DEBUG nova.network.neutron [req-1d65ffa9-aabd-4d7a-a96e-2a90bbec9722 req-ac9a9ffe-fcd8-4b1b-a4a5-4a5f71ea9b8f service nova] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Updated VIF entry in instance network info cache for port e2b72ea5-94f6-47f7-a022-55462da4489b. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:25:17 user nova-compute[74189]: DEBUG nova.network.neutron [req-1d65ffa9-aabd-4d7a-a96e-2a90bbec9722 req-ac9a9ffe-fcd8-4b1b-a4a5-4a5f71ea9b8f service nova] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Updating instance_info_cache with network_info: [{"id": "e2b72ea5-94f6-47f7-a022-55462da4489b", "address": "fa:16:3e:3c:b4:38", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b72ea5-94", "ovs_interfaceid": "e2b72ea5-94f6-47f7-a022-55462da4489b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:25:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1d65ffa9-aabd-4d7a-a96e-2a90bbec9722 req-ac9a9ffe-fcd8-4b1b-a4a5-4a5f71ea9b8f service nova] Releasing lock "refresh_cache-384e5528-a8d3-49f3-bc21-e7dbf3d14cb5" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:25:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:18 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Instance destroyed successfully.
Oct 25 21:25:18 user nova-compute[74189]: DEBUG nova.objects.instance [None req-d78802ea-a5a6-4093-af37-a3978e60579c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lazy-loading 'resources' on Instance uuid 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:25:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:18 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-d78802ea-a5a6-4093-af37-a3978e60579c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:23:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1512350029',display_name='tempest-AttachVolumeNegativeTest-server-1512350029',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1512350029',id=20,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+YEUY1YHXW3JAMnFO6xYHmvwKUIw8ypLGhtk2EH7qo1Xjhm46LgT+eu3jufCZhleSf/mIOo/qByDRHQ1xlJdkkCG1PaEH7zQNdwoYHck1alrKuzhSAeCy2lkROjLq5zg==',key_name='tempest-keypair-1973341440',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:23:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a555d708aa644d586d5edad7db837b4',ramdisk_id='',reservation_id='r-kco2e0g4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-979681322',owner_user_name='tempest-AttachVolumeNegativeTest-979681322-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:23:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2f19a398fd9486fbef04eebad62a0cb',uuid=384e5528-a8d3-49f3-bc21-e7dbf3d14cb5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2b72ea5-94f6-47f7-a022-55462da4489b", "address": "fa:16:3e:3c:b4:38", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b72ea5-94", "ovs_interfaceid": "e2b72ea5-94f6-47f7-a022-55462da4489b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:25:18 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-d78802ea-a5a6-4093-af37-a3978e60579c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Converting VIF {"id": "e2b72ea5-94f6-47f7-a022-55462da4489b", "address": "fa:16:3e:3c:b4:38", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b72ea5-94", "ovs_interfaceid": "e2b72ea5-94f6-47f7-a022-55462da4489b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:25:18 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-d78802ea-a5a6-4093-af37-a3978e60579c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:b4:38,bridge_name='br-int',has_traffic_filtering=True,id=e2b72ea5-94f6-47f7-a022-55462da4489b,network=Network(5029031b-e67b-4f60-bc17-781cbdc88b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2b72ea5-94') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:25:18 user nova-compute[74189]: DEBUG os_vif [None req-d78802ea-a5a6-4093-af37-a3978e60579c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:b4:38,bridge_name='br-int',has_traffic_filtering=True,id=e2b72ea5-94f6-47f7-a022-55462da4489b,network=Network(5029031b-e67b-4f60-bc17-781cbdc88b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2b72ea5-94') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:25:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2b72ea5-94, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:25:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:25:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=53744c4f-04b8-44dc-97bd-48b89cba5150) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:25:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:25:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:18 user nova-compute[74189]: INFO os_vif [None req-d78802ea-a5a6-4093-af37-a3978e60579c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:b4:38,bridge_name='br-int',has_traffic_filtering=True,id=e2b72ea5-94f6-47f7-a022-55462da4489b,network=Network(5029031b-e67b-4f60-bc17-781cbdc88b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2b72ea5-94')
Oct 25 21:25:18 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-d78802ea-a5a6-4093-af37-a3978e60579c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Deleting instance files /opt/stack/data/nova/instances/384e5528-a8d3-49f3-bc21-e7dbf3d14cb5_del
Oct 25 21:25:18 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-d78802ea-a5a6-4093-af37-a3978e60579c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Deletion of /opt/stack/data/nova/instances/384e5528-a8d3-49f3-bc21-e7dbf3d14cb5_del complete
Oct 25 21:25:18 user nova-compute[74189]: INFO nova.compute.manager [None req-d78802ea-a5a6-4093-af37-a3978e60579c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Took 0.81 seconds to destroy the instance on the hypervisor.
Oct 25 21:25:18 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-d78802ea-a5a6-4093-af37-a3978e60579c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:25:18 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:25:18 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:25:19 user nova-compute[74189]: DEBUG nova.compute.manager [req-fa6ab0fe-52f3-4c42-b812-197b7bbff885 req-d5913a64-4c13-400a-8803-99cfd93c70f4 service nova] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Received event network-vif-unplugged-e2b72ea5-94f6-47f7-a022-55462da4489b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:25:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-fa6ab0fe-52f3-4c42-b812-197b7bbff885 req-d5913a64-4c13-400a-8803-99cfd93c70f4 service nova] Acquiring lock "384e5528-a8d3-49f3-bc21-e7dbf3d14cb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-fa6ab0fe-52f3-4c42-b812-197b7bbff885 req-d5913a64-4c13-400a-8803-99cfd93c70f4 service nova] Lock "384e5528-a8d3-49f3-bc21-e7dbf3d14cb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-fa6ab0fe-52f3-4c42-b812-197b7bbff885 req-d5913a64-4c13-400a-8803-99cfd93c70f4 service nova] Lock "384e5528-a8d3-49f3-bc21-e7dbf3d14cb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:19 user nova-compute[74189]: DEBUG nova.compute.manager [req-fa6ab0fe-52f3-4c42-b812-197b7bbff885 req-d5913a64-4c13-400a-8803-99cfd93c70f4 service nova] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] No waiting events found dispatching network-vif-unplugged-e2b72ea5-94f6-47f7-a022-55462da4489b {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:25:19 user nova-compute[74189]: DEBUG nova.compute.manager [req-fa6ab0fe-52f3-4c42-b812-197b7bbff885 req-d5913a64-4c13-400a-8803-99cfd93c70f4 service nova] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Received event network-vif-unplugged-e2b72ea5-94f6-47f7-a022-55462da4489b for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:25:19 user nova-compute[74189]: DEBUG nova.compute.manager [req-fa6ab0fe-52f3-4c42-b812-197b7bbff885 req-d5913a64-4c13-400a-8803-99cfd93c70f4 service nova] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Received event network-vif-plugged-e2b72ea5-94f6-47f7-a022-55462da4489b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:25:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-fa6ab0fe-52f3-4c42-b812-197b7bbff885 req-d5913a64-4c13-400a-8803-99cfd93c70f4 service nova] Acquiring lock "384e5528-a8d3-49f3-bc21-e7dbf3d14cb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-fa6ab0fe-52f3-4c42-b812-197b7bbff885 req-d5913a64-4c13-400a-8803-99cfd93c70f4 service nova] Lock "384e5528-a8d3-49f3-bc21-e7dbf3d14cb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-fa6ab0fe-52f3-4c42-b812-197b7bbff885 req-d5913a64-4c13-400a-8803-99cfd93c70f4 service nova] Lock "384e5528-a8d3-49f3-bc21-e7dbf3d14cb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:19 user nova-compute[74189]: DEBUG nova.compute.manager [req-fa6ab0fe-52f3-4c42-b812-197b7bbff885 req-d5913a64-4c13-400a-8803-99cfd93c70f4 service nova] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] No waiting events found dispatching network-vif-plugged-e2b72ea5-94f6-47f7-a022-55462da4489b {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:25:19 user nova-compute[74189]: WARNING nova.compute.manager [req-fa6ab0fe-52f3-4c42-b812-197b7bbff885 req-d5913a64-4c13-400a-8803-99cfd93c70f4 service nova] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Received unexpected event network-vif-plugged-e2b72ea5-94f6-47f7-a022-55462da4489b for instance with vm_state active and task_state deleting.
Oct 25 21:25:19 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:25:19 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Took 1.12 seconds to deallocate network for instance.
Oct 25 21:25:19 user nova-compute[74189]: DEBUG nova.compute.manager [req-f8010b9a-3be1-4dd8-b16d-f8190a8d90f0 req-8768f640-8140-40cb-a194-ea12889eb78e service nova] [instance: 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5] Received event network-vif-deleted-e2b72ea5-94f6-47f7-a022-55462da4489b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:25:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d78802ea-a5a6-4093-af37-a3978e60579c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d78802ea-a5a6-4093-af37-a3978e60579c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:19 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-d78802ea-a5a6-4093-af37-a3978e60579c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:25:19 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-d78802ea-a5a6-4093-af37-a3978e60579c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:25:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d78802ea-a5a6-4093-af37-a3978e60579c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:19 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-d78802ea-a5a6-4093-af37-a3978e60579c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Deleted allocations for instance 384e5528-a8d3-49f3-bc21-e7dbf3d14cb5
Oct 25 21:25:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d78802ea-a5a6-4093-af37-a3978e60579c tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "384e5528-a8d3-49f3-bc21-e7dbf3d14cb5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.598s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "3702433e-ec0e-4359-bc0c-d3a189d83caa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "3702433e-ec0e-4359-bc0c-d3a189d83caa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "3702433e-ec0e-4359-bc0c-d3a189d83caa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "3702433e-ec0e-4359-bc0c-d3a189d83caa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "3702433e-ec0e-4359-bc0c-d3a189d83caa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:26 user nova-compute[74189]: INFO nova.compute.manager [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Terminating instance
Oct 25 21:25:26 user nova-compute[74189]: DEBUG nova.compute.manager [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:25:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:26 user nova-compute[74189]: DEBUG nova.compute.manager [req-0e4629cd-bcaa-4f71-9e5e-c56c523c6bc5 req-d19d69ad-441c-4d4f-aeea-1c8397baf9ca service nova] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Received event network-vif-unplugged-6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:25:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0e4629cd-bcaa-4f71-9e5e-c56c523c6bc5 req-d19d69ad-441c-4d4f-aeea-1c8397baf9ca service nova] Acquiring lock "3702433e-ec0e-4359-bc0c-d3a189d83caa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0e4629cd-bcaa-4f71-9e5e-c56c523c6bc5 req-d19d69ad-441c-4d4f-aeea-1c8397baf9ca service nova] Lock "3702433e-ec0e-4359-bc0c-d3a189d83caa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0e4629cd-bcaa-4f71-9e5e-c56c523c6bc5 req-d19d69ad-441c-4d4f-aeea-1c8397baf9ca service nova] Lock "3702433e-ec0e-4359-bc0c-d3a189d83caa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:26 user nova-compute[74189]: DEBUG nova.compute.manager [req-0e4629cd-bcaa-4f71-9e5e-c56c523c6bc5 req-d19d69ad-441c-4d4f-aeea-1c8397baf9ca service nova] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] No waiting events found dispatching network-vif-unplugged-6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:25:26 user nova-compute[74189]: DEBUG nova.compute.manager [req-0e4629cd-bcaa-4f71-9e5e-c56c523c6bc5 req-d19d69ad-441c-4d4f-aeea-1c8397baf9ca service nova] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Received event network-vif-unplugged-6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9 for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:25:27 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Instance destroyed successfully.
Oct 25 21:25:27 user nova-compute[74189]: DEBUG nova.objects.instance [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lazy-loading 'resources' on Instance uuid 3702433e-ec0e-4359-bc0c-d3a189d83caa {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:23:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1136017570',display_name='tempest-TestVolumeBootPattern-server-1136017570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1136017570',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:24:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e893e8f3f58e4e15920d313b6391682c',ramdisk_id='',reservation_id='r-1v987hh3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1934687878',owner_user_name='tempest-TestVolumeBootPattern-1934687878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:24:09Z,user_data=None,user_id='77a27a7ebb4a458097c901871c378bc8',uuid=3702433e-ec0e-4359-bc0c-d3a189d83caa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9", "address": "fa:16:3e:46:cd:d6", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bfb9f88-cb", "ovs_interfaceid": "6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converting VIF {"id": "6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9", "address": "fa:16:3e:46:cd:d6", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bfb9f88-cb", "ovs_interfaceid": "6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:cd:d6,bridge_name='br-int',has_traffic_filtering=True,id=6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bfb9f88-cb') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG os_vif [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:cd:d6,bridge_name='br-int',has_traffic_filtering=True,id=6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bfb9f88-cb') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6bfb9f88-cb, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=01ec8150-6918-4c8e-a089-880dcdcdf32c) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:27 user nova-compute[74189]: INFO os_vif [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:cd:d6,bridge_name='br-int',has_traffic_filtering=True,id=6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bfb9f88-cb')
Oct 25 21:25:27 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'smHRfTwO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:25:27 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:25:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e3e775-088b-4000-ac48-f4f905025aee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:25:27 user nova-compute[74189]: No targets found.
Oct 25 21:25:27 user nova-compute[74189]: iSNS:
Oct 25 21:25:27 user nova-compute[74189]: No targets found.
Oct 25 21:25:27 user nova-compute[74189]: STATIC:
Oct 25 21:25:27 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1
Oct 25 21:25:27 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:25:27 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:25:27 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612
Oct 25 21:25:27 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:25:27 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:25:27 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f
Oct 25 21:25:27 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:25:27 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:25:27 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:25:27 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:25:27 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:25:27 user nova-compute[74189]: FIRMWARE:
Oct 25 21:25:27 user nova-compute[74189]: No targets found.
Oct 25 21:25:27 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:25:27 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:25:27 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef49afb-bd77-458a-87fa-1752cc4c265f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb58ec77-0185-42b8-8156-42c6324ea301]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:25:27 user nova-compute[74189]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)
Oct 25 21:25:27 user nova-compute[74189]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:25:27 user nova-compute[74189]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612 (non-flash)
Oct 25 21:25:27 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:25:27 user nova-compute[74189]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)
Oct 25 21:25:27 user nova-compute[74189]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:25:27 user nova-compute[74189]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612 (non-flash)
Oct 25 21:25:27 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2e43e9cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612'): ({'sde'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Removing single pathed devices sde {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa3be5b-f6f4-45d7-a095-769a4d682061]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4260008-245e-4b4d-bbdf-363e2e7ec378]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Flushing IO for device /dev/sde {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f772f3-e43d-4c46-b1b9-6cd83d593bf2]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[198bc42b-652a-4c29-9d0b-173d9ac79734]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] SCSI volumes sde have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO6804b9ee-b5fe3076fcf568fe', '/dev/disk/by-id/scsi-26235666533303736', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6804b9ee') {{(pid=85079) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc9c513-6fd6-4374-b003-265dd7b2b455]: (4, None) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b57de1c-b361-4cbf-84f4-4c314620166a]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612 -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6c79b8-61e6-4046-8131-0a64cc434572]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612, portal: 172.16.0.220,3260]
Oct 25 21:25:27 user nova-compute[74189]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612, portal: 172.16.0.220,3260] successful.
Oct 25 21:25:27 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612 -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed9cd674-0c70-4842-88dd-6ef626b26612 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[559e3b9c-4390-47e8-b762-c2349cc9527e]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] <== disconnect_volume: return (362ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:25:27 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Deleting instance files /opt/stack/data/nova/instances/3702433e-ec0e-4359-bc0c-d3a189d83caa_del
Oct 25 21:25:27 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Deletion of /opt/stack/data/nova/instances/3702433e-ec0e-4359-bc0c-d3a189d83caa_del complete
Oct 25 21:25:27 user nova-compute[74189]: INFO nova.compute.manager [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Took 1.32 seconds to destroy the instance on the hypervisor.
Oct 25 21:25:27 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:25:27 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:25:28 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:25:28 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Took 0.55 seconds to deallocate network for instance.
Oct 25 21:25:28 user nova-compute[74189]: DEBUG nova.compute.manager [req-cfb8be0c-06a2-475b-a5d4-ea48d648eed5 req-09d00b85-2444-4944-97ee-2e3a6dac18d4 service nova] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Received event network-vif-deleted-6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:25:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:28 user nova-compute[74189]: DEBUG nova.compute.manager [req-bc2372c5-419f-4fac-9c6f-76ac9d43a831 req-684c0a88-9306-4656-a4ac-998b5d5748de service nova] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Received event network-vif-plugged-6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:25:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bc2372c5-419f-4fac-9c6f-76ac9d43a831 req-684c0a88-9306-4656-a4ac-998b5d5748de service nova] Acquiring lock "3702433e-ec0e-4359-bc0c-d3a189d83caa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bc2372c5-419f-4fac-9c6f-76ac9d43a831 req-684c0a88-9306-4656-a4ac-998b5d5748de service nova] Lock "3702433e-ec0e-4359-bc0c-d3a189d83caa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bc2372c5-419f-4fac-9c6f-76ac9d43a831 req-684c0a88-9306-4656-a4ac-998b5d5748de service nova] Lock "3702433e-ec0e-4359-bc0c-d3a189d83caa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:28 user nova-compute[74189]: DEBUG nova.compute.manager [req-bc2372c5-419f-4fac-9c6f-76ac9d43a831 req-684c0a88-9306-4656-a4ac-998b5d5748de service nova] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] No waiting events found dispatching network-vif-plugged-6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:25:28 user nova-compute[74189]: WARNING nova.compute.manager [req-bc2372c5-419f-4fac-9c6f-76ac9d43a831 req-684c0a88-9306-4656-a4ac-998b5d5748de service nova] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Received unexpected event network-vif-plugged-6bfb9f88-cb5e-4b03-9ea3-bffc1cc32cd9 for instance with vm_state active and task_state deleting.
Oct 25 21:25:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:29 user nova-compute[74189]: INFO nova.compute.manager [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Took 0.94 seconds to detach 1 volumes for instance.
Oct 25 21:25:29 user nova-compute[74189]: DEBUG nova.compute.manager [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 3702433e-ec0e-4359-bc0c-d3a189d83caa] Deleting volume: ed9cd674-0c70-4842-88dd-6ef626b26612 {{(pid=74189) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 25 21:25:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:29 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:25:29 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:25:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.512s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:29 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Deleted allocations for instance 3702433e-ec0e-4359-bc0c-d3a189d83caa
Oct 25 21:25:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9950fef1-de4b-4f08-b40e-493bd84c1c39 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "3702433e-ec0e-4359-bc0c-d3a189d83caa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.665s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "a57b1185-270e-40d0-a55e-986960826169" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "a57b1185-270e-40d0-a55e-986960826169" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:34 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:25:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:34 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:25:34 user nova-compute[74189]: INFO nova.compute.claims [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Claim successful on node user
Oct 25 21:25:35 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:25:35 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:25:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.547s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:35 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:25:35 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:25:35 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:25:35 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:25:35 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:25:35 user nova-compute[74189]: DEBUG nova.policy [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6fb9b5c36f049c1af4ae44e11267264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45f8868c6a04e31ad1617ee6e9438a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:25:35 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:25:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:25:35 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Creating image(s)
Oct 25 21:25:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "/opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "/opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "/opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.220s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.205s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk 1073741824" returned: 0 in 0.066s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.210s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:36 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:25:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:36 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Cannot resize image /opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:25:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:25:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Ensure instance console log exists: /opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:25:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:36 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Successfully created port: ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Successfully updated port: ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "refresh_cache-a57b1185-270e-40d0-a55e-986960826169" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquired lock "refresh_cache-a57b1185-270e-40d0-a55e-986960826169" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG nova.compute.manager [req-96e81dcf-eb5b-4263-a6b1-e453e01e80ae req-8dabfddd-8ef8-4180-97f4-65be070364b6 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received event network-changed-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG nova.compute.manager [req-96e81dcf-eb5b-4263-a6b1-e453e01e80ae req-8dabfddd-8ef8-4180-97f4-65be070364b6 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Refreshing instance network info cache due to event network-changed-ecc4dd08-df4f-445b-81eb-b3946804aef8. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-96e81dcf-eb5b-4263-a6b1-e453e01e80ae req-8dabfddd-8ef8-4180-97f4-65be070364b6 service nova] Acquiring lock "refresh_cache-a57b1185-270e-40d0-a55e-986960826169" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Updating instance_info_cache with network_info: [{"id": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "address": "fa:16:3e:6b:ad:c5", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc4dd08-df", "ovs_interfaceid": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Releasing lock "refresh_cache-a57b1185-270e-40d0-a55e-986960826169" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Instance network_info: |[{"id": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "address": "fa:16:3e:6b:ad:c5", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc4dd08-df", "ovs_interfaceid": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-96e81dcf-eb5b-4263-a6b1-e453e01e80ae req-8dabfddd-8ef8-4180-97f4-65be070364b6 service nova] Acquired lock "refresh_cache-a57b1185-270e-40d0-a55e-986960826169" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG nova.network.neutron [req-96e81dcf-eb5b-4263-a6b1-e453e01e80ae req-8dabfddd-8ef8-4180-97f4-65be070364b6 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Refreshing network info cache for port ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Start _get_guest_xml network_info=[{"id": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "address": "fa:16:3e:6b:ad:c5", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc4dd08-df", "ovs_interfaceid": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:25:37 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:25:37 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:25:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:25:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1746373749',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1746373749',id=24,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeVfbHlnrfHPlWJf0qQWN3RmoyGnlwESQMNATRyDnsaQDNhoQQ5AFt+AOrCNT1My52XNyl/wmtAhCjs522VgUQ0PcCWFwer2/z8cWlMfT4+vBhmGaYJddvSyq52kAg4Cg==',key_name='tempest-keypair-784432470',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e45f8868c6a04e31ad1617ee6e9438a2',ramdisk_id='',reservation_id='r-6cje6qbe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-846255404',owner_user_name='tempest-AttachVolumeShelveTestJSON-846255404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:25:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6fb9b5c36f049c1af4ae44e11267264',uuid=a57b1185-270e-40d0-a55e-986960826169,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "address": "fa:16:3e:6b:ad:c5", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc4dd08-df", "ovs_interfaceid": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Converting VIF {"id": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "address": "fa:16:3e:6b:ad:c5", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc4dd08-df", "ovs_interfaceid": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ad:c5,bridge_name='br-int',has_traffic_filtering=True,id=ecc4dd08-df4f-445b-81eb-b3946804aef8,network=Network(09d8bdf6-f255-479c-aa38-55d468abf1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc4dd08-df') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lazy-loading 'pci_devices' on Instance uuid a57b1185-270e-40d0-a55e-986960826169 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "7eff6940-9675-4c89-bd28-378a5db4369f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "7eff6940-9675-4c89-bd28-378a5db4369f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:25:37 user nova-compute[74189]:   <uuid>a57b1185-270e-40d0-a55e-986960826169</uuid>
Oct 25 21:25:37 user nova-compute[74189]:   <name>instance-00000018</name>
Oct 25 21:25:37 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:25:37 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:25:37 user nova-compute[74189]:   <metadata>
Oct 25 21:25:37 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:25:37 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:25:37 user nova-compute[74189]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1746373749</nova:name>
Oct 25 21:25:37 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:25:37</nova:creationTime>
Oct 25 21:25:37 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:25:37 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:25:37 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:25:37 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:25:37 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:25:37 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:25:37 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:25:37 user nova-compute[74189]:       <nova:owner>
Oct 25 21:25:37 user nova-compute[74189]:         <nova:user uuid="e6fb9b5c36f049c1af4ae44e11267264">tempest-AttachVolumeShelveTestJSON-846255404-project-member</nova:user>
Oct 25 21:25:37 user nova-compute[74189]:         <nova:project uuid="e45f8868c6a04e31ad1617ee6e9438a2">tempest-AttachVolumeShelveTestJSON-846255404</nova:project>
Oct 25 21:25:37 user nova-compute[74189]:       </nova:owner>
Oct 25 21:25:37 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:25:37 user nova-compute[74189]:       <nova:ports>
Oct 25 21:25:37 user nova-compute[74189]:         <nova:port uuid="ecc4dd08-df4f-445b-81eb-b3946804aef8">
Oct 25 21:25:37 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 25 21:25:37 user nova-compute[74189]:         </nova:port>
Oct 25 21:25:37 user nova-compute[74189]:       </nova:ports>
Oct 25 21:25:37 user nova-compute[74189]:     </nova:instance>
Oct 25 21:25:37 user nova-compute[74189]:   </metadata>
Oct 25 21:25:37 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:25:37 user nova-compute[74189]:     <system>
Oct 25 21:25:37 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:25:37 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:25:37 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:25:37 user nova-compute[74189]:       <entry name="serial">a57b1185-270e-40d0-a55e-986960826169</entry>
Oct 25 21:25:37 user nova-compute[74189]:       <entry name="uuid">a57b1185-270e-40d0-a55e-986960826169</entry>
Oct 25 21:25:37 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:25:37 user nova-compute[74189]:     </system>
Oct 25 21:25:37 user nova-compute[74189]:   </sysinfo>
Oct 25 21:25:37 user nova-compute[74189]:   <os>
Oct 25 21:25:37 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:25:37 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:25:37 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:25:37 user nova-compute[74189]:   </os>
Oct 25 21:25:37 user nova-compute[74189]:   <features>
Oct 25 21:25:37 user nova-compute[74189]:     <acpi/>
Oct 25 21:25:37 user nova-compute[74189]:     <apic/>
Oct 25 21:25:37 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:25:37 user nova-compute[74189]:   </features>
Oct 25 21:25:37 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:25:37 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:25:37 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:25:37 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:25:37 user nova-compute[74189]:   </clock>
Oct 25 21:25:37 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:25:37 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:25:37 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:25:37 user nova-compute[74189]:   </cpu>
Oct 25 21:25:37 user nova-compute[74189]:   <devices>
Oct 25 21:25:37 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:25:37 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:25:37 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk"/>
Oct 25 21:25:37 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:25:37 user nova-compute[74189]:     </disk>
Oct 25 21:25:37 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:25:37 user nova-compute[74189]:       <mac address="fa:16:3e:6b:ad:c5"/>
Oct 25 21:25:37 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:25:37 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:25:37 user nova-compute[74189]:       <target dev="tapecc4dd08-df"/>
Oct 25 21:25:37 user nova-compute[74189]:     </interface>
Oct 25 21:25:37 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:25:37 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/console.log" append="off"/>
Oct 25 21:25:37 user nova-compute[74189]:     </serial>
Oct 25 21:25:37 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:25:37 user nova-compute[74189]:     <video>
Oct 25 21:25:37 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:25:37 user nova-compute[74189]:     </video>
Oct 25 21:25:37 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:25:37 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:25:37 user nova-compute[74189]:     </rng>
Oct 25 21:25:37 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:25:37 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:25:37 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:25:37 user nova-compute[74189]:     </memballoon>
Oct 25 21:25:37 user nova-compute[74189]:   </devices>
Oct 25 21:25:37 user nova-compute[74189]: </domain>
Oct 25 21:25:37 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:25:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1746373749',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1746373749',id=24,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeVfbHlnrfHPlWJf0qQWN3RmoyGnlwESQMNATRyDnsaQDNhoQQ5AFt+AOrCNT1My52XNyl/wmtAhCjs522VgUQ0PcCWFwer2/z8cWlMfT4+vBhmGaYJddvSyq52kAg4Cg==',key_name='tempest-keypair-784432470',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e45f8868c6a04e31ad1617ee6e9438a2',ramdisk_id='',reservation_id='r-6cje6qbe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-846255404',owner_user_name='tempest-AttachVolumeShelveTestJSON-846255404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:25:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6fb9b5c36f049c1af4ae44e11267264',uuid=a57b1185-270e-40d0-a55e-986960826169,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "address": "fa:16:3e:6b:ad:c5", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc4dd08-df", "ovs_interfaceid": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Converting VIF {"id": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "address": "fa:16:3e:6b:ad:c5", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc4dd08-df", "ovs_interfaceid": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ad:c5,bridge_name='br-int',has_traffic_filtering=True,id=ecc4dd08-df4f-445b-81eb-b3946804aef8,network=Network(09d8bdf6-f255-479c-aa38-55d468abf1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc4dd08-df') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG os_vif [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ad:c5,bridge_name='br-int',has_traffic_filtering=True,id=ecc4dd08-df4f-445b-81eb-b3946804aef8,network=Network(09d8bdf6-f255-479c-aa38-55d468abf1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc4dd08-df') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ccf8dcc-52ec-5308-b3c0-c1df06186a62', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapecc4dd08-df, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapecc4dd08-df, col_values=(('qos', UUID('28bd3bef-7dea-4b5e-b9f8-f45c17d8dc1f')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:25:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapecc4dd08-df, col_values=(('external_ids', {'iface-id': 'ecc4dd08-df4f-445b-81eb-b3946804aef8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:ad:c5', 'vm-uuid': 'a57b1185-270e-40d0-a55e-986960826169'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:25:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:25:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:38 user nova-compute[74189]: INFO os_vif [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ad:c5,bridge_name='br-int',has_traffic_filtering=True,id=ecc4dd08-df4f-445b-81eb-b3946804aef8,network=Network(09d8bdf6-f255-479c-aa38-55d468abf1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc4dd08-df')
Oct 25 21:25:38 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:25:38 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] No VIF found with MAC fa:16:3e:6b:ad:c5, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:25:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:38 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:25:38 user nova-compute[74189]: INFO nova.compute.claims [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Claim successful on node user
Oct 25 21:25:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:38 user nova-compute[74189]: DEBUG nova.network.neutron [req-96e81dcf-eb5b-4263-a6b1-e453e01e80ae req-8dabfddd-8ef8-4180-97f4-65be070364b6 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Updated VIF entry in instance network info cache for port ecc4dd08-df4f-445b-81eb-b3946804aef8. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:25:38 user nova-compute[74189]: DEBUG nova.network.neutron [req-96e81dcf-eb5b-4263-a6b1-e453e01e80ae req-8dabfddd-8ef8-4180-97f4-65be070364b6 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Updating instance_info_cache with network_info: [{"id": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "address": "fa:16:3e:6b:ad:c5", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc4dd08-df", "ovs_interfaceid": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:25:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-96e81dcf-eb5b-4263-a6b1-e453e01e80ae req-8dabfddd-8ef8-4180-97f4-65be070364b6 service nova] Releasing lock "refresh_cache-a57b1185-270e-40d0-a55e-986960826169" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:25:38 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:25:38 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:25:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:38 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:25:38 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:25:38 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:25:38 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:25:38 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:25:38 user nova-compute[74189]: DEBUG nova.policy [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b34817b1868f40a38a32a51d0e970d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4815aedea48841188ed8797a0eb51925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:25:38 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:25:38 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:25:38 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Creating image(s)
Oct 25 21:25:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "/opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "/opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "/opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:39 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.208s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:39 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:39 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.208s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:39 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:39 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk 1073741824" returned: 0 in 0.062s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:39 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:39 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.262s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:39 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:25:39 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:39 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Successfully created port: b05a2001-02cd-45af-9242-3d6246edcd0b {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:25:39 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:39 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Cannot resize image /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:25:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:25:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Ensure instance console log exists: /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:25:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:39 user nova-compute[74189]: DEBUG nova.compute.manager [req-3823a7f2-dd49-46a1-bc69-ab757d0c20a4 req-ee63361d-825c-498e-9b89-53994e2784aa service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received event network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:25:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3823a7f2-dd49-46a1-bc69-ab757d0c20a4 req-ee63361d-825c-498e-9b89-53994e2784aa service nova] Acquiring lock "a57b1185-270e-40d0-a55e-986960826169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3823a7f2-dd49-46a1-bc69-ab757d0c20a4 req-ee63361d-825c-498e-9b89-53994e2784aa service nova] Lock "a57b1185-270e-40d0-a55e-986960826169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3823a7f2-dd49-46a1-bc69-ab757d0c20a4 req-ee63361d-825c-498e-9b89-53994e2784aa service nova] Lock "a57b1185-270e-40d0-a55e-986960826169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:39 user nova-compute[74189]: DEBUG nova.compute.manager [req-3823a7f2-dd49-46a1-bc69-ab757d0c20a4 req-ee63361d-825c-498e-9b89-53994e2784aa service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] No waiting events found dispatching network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:25:39 user nova-compute[74189]: WARNING nova.compute.manager [req-3823a7f2-dd49-46a1-bc69-ab757d0c20a4 req-ee63361d-825c-498e-9b89-53994e2784aa service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received unexpected event network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 for instance with vm_state building and task_state spawning.
Oct 25 21:25:40 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Successfully updated port: b05a2001-02cd-45af-9242-3d6246edcd0b {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:25:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "refresh_cache-7eff6940-9675-4c89-bd28-378a5db4369f" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:25:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquired lock "refresh_cache-7eff6940-9675-4c89-bd28-378a5db4369f" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:25:40 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:25:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:40 user nova-compute[74189]: DEBUG nova.compute.manager [req-ac9597f4-8662-4a38-9b4f-228f3b7aff9d req-e3bfc9ea-0066-4adf-93c8-e5a567565544 service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Received event network-changed-b05a2001-02cd-45af-9242-3d6246edcd0b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:25:40 user nova-compute[74189]: DEBUG nova.compute.manager [req-ac9597f4-8662-4a38-9b4f-228f3b7aff9d req-e3bfc9ea-0066-4adf-93c8-e5a567565544 service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Refreshing instance network info cache due to event network-changed-b05a2001-02cd-45af-9242-3d6246edcd0b. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:25:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ac9597f4-8662-4a38-9b4f-228f3b7aff9d req-e3bfc9ea-0066-4adf-93c8-e5a567565544 service nova] Acquiring lock "refresh_cache-7eff6940-9675-4c89-bd28-378a5db4369f" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:25:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:40 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Updating instance_info_cache with network_info: [{"id": "b05a2001-02cd-45af-9242-3d6246edcd0b", "address": "fa:16:3e:a4:7d:bb", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb05a2001-02", "ovs_interfaceid": "b05a2001-02cd-45af-9242-3d6246edcd0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Releasing lock "refresh_cache-7eff6940-9675-4c89-bd28-378a5db4369f" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Instance network_info: |[{"id": "b05a2001-02cd-45af-9242-3d6246edcd0b", "address": "fa:16:3e:a4:7d:bb", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb05a2001-02", "ovs_interfaceid": "b05a2001-02cd-45af-9242-3d6246edcd0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ac9597f4-8662-4a38-9b4f-228f3b7aff9d req-e3bfc9ea-0066-4adf-93c8-e5a567565544 service nova] Acquired lock "refresh_cache-7eff6940-9675-4c89-bd28-378a5db4369f" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.network.neutron [req-ac9597f4-8662-4a38-9b4f-228f3b7aff9d req-e3bfc9ea-0066-4adf-93c8-e5a567565544 service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Refreshing network info cache for port b05a2001-02cd-45af-9242-3d6246edcd0b {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Start _get_guest_xml network_info=[{"id": "b05a2001-02cd-45af-9242-3d6246edcd0b", "address": "fa:16:3e:a4:7d:bb", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb05a2001-02", "ovs_interfaceid": "b05a2001-02cd-45af-9242-3d6246edcd0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:25:41 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:25:41 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:25:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1322492588',display_name='tempest-tempest.common.compute-instance-1322492588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1322492588',id=25,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5j6CMFPtaQ+NzS5oVZzUHGOr//XCKKpYtJKLFlY6kOEcPffJeLFPf99va1dycVwlGqutcJsn1c271d+g8r5i8+XkpVYF0aKK7TyDm32HptGHWvYJyfbjsyYyV3AGqK6Q==',key_name='tempest-keypair-1752245754',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4815aedea48841188ed8797a0eb51925',ramdisk_id='',reservation_id='r-o280pvx3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1355855048',owner_user_name='tempest-ServerActionsTestOtherA-1355855048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:25:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b34817b1868f40a38a32a51d0e970d51',uuid=7eff6940-9675-4c89-bd28-378a5db4369f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b05a2001-02cd-45af-9242-3d6246edcd0b", "address": "fa:16:3e:a4:7d:bb", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb05a2001-02", "ovs_interfaceid": "b05a2001-02cd-45af-9242-3d6246edcd0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Converting VIF {"id": "b05a2001-02cd-45af-9242-3d6246edcd0b", "address": "fa:16:3e:a4:7d:bb", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb05a2001-02", "ovs_interfaceid": "b05a2001-02cd-45af-9242-3d6246edcd0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7d:bb,bridge_name='br-int',has_traffic_filtering=True,id=b05a2001-02cd-45af-9242-3d6246edcd0b,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb05a2001-02') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lazy-loading 'pci_devices' on Instance uuid 7eff6940-9675-4c89-bd28-378a5db4369f {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:25:41 user nova-compute[74189]:   <uuid>7eff6940-9675-4c89-bd28-378a5db4369f</uuid>
Oct 25 21:25:41 user nova-compute[74189]:   <name>instance-00000019</name>
Oct 25 21:25:41 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:25:41 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:25:41 user nova-compute[74189]:   <metadata>
Oct 25 21:25:41 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:25:41 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:25:41 user nova-compute[74189]:       <nova:name>tempest-tempest.common.compute-instance-1322492588</nova:name>
Oct 25 21:25:41 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:25:41</nova:creationTime>
Oct 25 21:25:41 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:25:41 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:25:41 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:25:41 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:25:41 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:25:41 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:25:41 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:25:41 user nova-compute[74189]:       <nova:owner>
Oct 25 21:25:41 user nova-compute[74189]:         <nova:user uuid="b34817b1868f40a38a32a51d0e970d51">tempest-ServerActionsTestOtherA-1355855048-project-member</nova:user>
Oct 25 21:25:41 user nova-compute[74189]:         <nova:project uuid="4815aedea48841188ed8797a0eb51925">tempest-ServerActionsTestOtherA-1355855048</nova:project>
Oct 25 21:25:41 user nova-compute[74189]:       </nova:owner>
Oct 25 21:25:41 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:25:41 user nova-compute[74189]:       <nova:ports>
Oct 25 21:25:41 user nova-compute[74189]:         <nova:port uuid="b05a2001-02cd-45af-9242-3d6246edcd0b">
Oct 25 21:25:41 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 21:25:41 user nova-compute[74189]:         </nova:port>
Oct 25 21:25:41 user nova-compute[74189]:       </nova:ports>
Oct 25 21:25:41 user nova-compute[74189]:     </nova:instance>
Oct 25 21:25:41 user nova-compute[74189]:   </metadata>
Oct 25 21:25:41 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:25:41 user nova-compute[74189]:     <system>
Oct 25 21:25:41 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:25:41 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:25:41 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:25:41 user nova-compute[74189]:       <entry name="serial">7eff6940-9675-4c89-bd28-378a5db4369f</entry>
Oct 25 21:25:41 user nova-compute[74189]:       <entry name="uuid">7eff6940-9675-4c89-bd28-378a5db4369f</entry>
Oct 25 21:25:41 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:25:41 user nova-compute[74189]:     </system>
Oct 25 21:25:41 user nova-compute[74189]:   </sysinfo>
Oct 25 21:25:41 user nova-compute[74189]:   <os>
Oct 25 21:25:41 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:25:41 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:25:41 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:25:41 user nova-compute[74189]:   </os>
Oct 25 21:25:41 user nova-compute[74189]:   <features>
Oct 25 21:25:41 user nova-compute[74189]:     <acpi/>
Oct 25 21:25:41 user nova-compute[74189]:     <apic/>
Oct 25 21:25:41 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:25:41 user nova-compute[74189]:   </features>
Oct 25 21:25:41 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:25:41 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:25:41 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:25:41 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:25:41 user nova-compute[74189]:   </clock>
Oct 25 21:25:41 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:25:41 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:25:41 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:25:41 user nova-compute[74189]:   </cpu>
Oct 25 21:25:41 user nova-compute[74189]:   <devices>
Oct 25 21:25:41 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:25:41 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:25:41 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk"/>
Oct 25 21:25:41 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:25:41 user nova-compute[74189]:     </disk>
Oct 25 21:25:41 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:25:41 user nova-compute[74189]:       <mac address="fa:16:3e:a4:7d:bb"/>
Oct 25 21:25:41 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:25:41 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:25:41 user nova-compute[74189]:       <target dev="tapb05a2001-02"/>
Oct 25 21:25:41 user nova-compute[74189]:     </interface>
Oct 25 21:25:41 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:25:41 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/console.log" append="off"/>
Oct 25 21:25:41 user nova-compute[74189]:     </serial>
Oct 25 21:25:41 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:25:41 user nova-compute[74189]:     <video>
Oct 25 21:25:41 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:25:41 user nova-compute[74189]:     </video>
Oct 25 21:25:41 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:25:41 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:25:41 user nova-compute[74189]:     </rng>
Oct 25 21:25:41 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:25:41 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:25:41 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:25:41 user nova-compute[74189]:     </memballoon>
Oct 25 21:25:41 user nova-compute[74189]:   </devices>
Oct 25 21:25:41 user nova-compute[74189]: </domain>
Oct 25 21:25:41 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:25:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1322492588',display_name='tempest-tempest.common.compute-instance-1322492588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1322492588',id=25,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5j6CMFPtaQ+NzS5oVZzUHGOr//XCKKpYtJKLFlY6kOEcPffJeLFPf99va1dycVwlGqutcJsn1c271d+g8r5i8+XkpVYF0aKK7TyDm32HptGHWvYJyfbjsyYyV3AGqK6Q==',key_name='tempest-keypair-1752245754',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4815aedea48841188ed8797a0eb51925',ramdisk_id='',reservation_id='r-o280pvx3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1355855048',owner_user_name='tempest-ServerActionsTestOtherA-1355855048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:25:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b34817b1868f40a38a32a51d0e970d51',uuid=7eff6940-9675-4c89-bd28-378a5db4369f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b05a2001-02cd-45af-9242-3d6246edcd0b", "address": "fa:16:3e:a4:7d:bb", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb05a2001-02", "ovs_interfaceid": "b05a2001-02cd-45af-9242-3d6246edcd0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Converting VIF {"id": "b05a2001-02cd-45af-9242-3d6246edcd0b", "address": "fa:16:3e:a4:7d:bb", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb05a2001-02", "ovs_interfaceid": "b05a2001-02cd-45af-9242-3d6246edcd0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7d:bb,bridge_name='br-int',has_traffic_filtering=True,id=b05a2001-02cd-45af-9242-3d6246edcd0b,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb05a2001-02') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG os_vif [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7d:bb,bridge_name='br-int',has_traffic_filtering=True,id=b05a2001-02cd-45af-9242-3d6246edcd0b,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb05a2001-02') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b7555bea-e492-5617-a085-8f3e45d3e796', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb05a2001-02, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb05a2001-02, col_values=(('qos', UUID('396f2fa7-3bed-4a47-b7df-e5e98ac858ec')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb05a2001-02, col_values=(('external_ids', {'iface-id': 'b05a2001-02cd-45af-9242-3d6246edcd0b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:7d:bb', 'vm-uuid': '7eff6940-9675-4c89-bd28-378a5db4369f'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:41 user nova-compute[74189]: INFO os_vif [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7d:bb,bridge_name='br-int',has_traffic_filtering=True,id=b05a2001-02cd-45af-9242-3d6246edcd0b,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb05a2001-02')
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] No VIF found with MAC fa:16:3e:a4:7d:bb, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.network.neutron [req-ac9597f4-8662-4a38-9b4f-228f3b7aff9d req-e3bfc9ea-0066-4adf-93c8-e5a567565544 service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Updated VIF entry in instance network info cache for port b05a2001-02cd-45af-9242-3d6246edcd0b. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.network.neutron [req-ac9597f4-8662-4a38-9b4f-228f3b7aff9d req-e3bfc9ea-0066-4adf-93c8-e5a567565544 service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Updating instance_info_cache with network_info: [{"id": "b05a2001-02cd-45af-9242-3d6246edcd0b", "address": "fa:16:3e:a4:7d:bb", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb05a2001-02", "ovs_interfaceid": "b05a2001-02cd-45af-9242-3d6246edcd0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ac9597f4-8662-4a38-9b4f-228f3b7aff9d req-e3bfc9ea-0066-4adf-93c8-e5a567565544 service nova] Releasing lock "refresh_cache-7eff6940-9675-4c89-bd28-378a5db4369f" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.objects.instance [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lazy-loading 'flavor' on Instance uuid de6b6789-b328-4c3b-8d24-07774d5dbe6d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "refresh_cache-de6b6789-b328-4c3b-8d24-07774d5dbe6d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquired lock "refresh_cache-de6b6789-b328-4c3b-8d24-07774d5dbe6d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.network.neutron [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.objects.instance [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lazy-loading 'info_cache' on Instance uuid de6b6789-b328-4c3b-8d24-07774d5dbe6d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:25:41 user nova-compute[74189]: DEBUG nova.objects.base [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Object Instance<de6b6789-b328-4c3b-8d24-07774d5dbe6d> lazy-loaded attributes: flavor,info_cache {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG nova.compute.manager [req-7d02aa3f-d9de-407e-826d-f0330e86715e req-4669d0f1-ee9e-408d-9a3f-8ec8b3f9ee42 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received event network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7d02aa3f-d9de-407e-826d-f0330e86715e req-4669d0f1-ee9e-408d-9a3f-8ec8b3f9ee42 service nova] Acquiring lock "a57b1185-270e-40d0-a55e-986960826169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7d02aa3f-d9de-407e-826d-f0330e86715e req-4669d0f1-ee9e-408d-9a3f-8ec8b3f9ee42 service nova] Lock "a57b1185-270e-40d0-a55e-986960826169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7d02aa3f-d9de-407e-826d-f0330e86715e req-4669d0f1-ee9e-408d-9a3f-8ec8b3f9ee42 service nova] Lock "a57b1185-270e-40d0-a55e-986960826169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG nova.compute.manager [req-7d02aa3f-d9de-407e-826d-f0330e86715e req-4669d0f1-ee9e-408d-9a3f-8ec8b3f9ee42 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] No waiting events found dispatching network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:25:42 user nova-compute[74189]: WARNING nova.compute.manager [req-7d02aa3f-d9de-407e-826d-f0330e86715e req-4669d0f1-ee9e-408d-9a3f-8ec8b3f9ee42 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received unexpected event network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 for instance with vm_state building and task_state spawning.
Oct 25 21:25:42 user nova-compute[74189]: DEBUG nova.network.neutron [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Updating instance_info_cache with network_info: [{"id": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "address": "fa:16:3e:df:d0:7a", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bbbcbc-08", "ovs_interfaceid": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Releasing lock "refresh_cache-de6b6789-b328-4c3b-8d24-07774d5dbe6d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:25:42 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: a57b1185-270e-40d0-a55e-986960826169] Instance spawned successfully.
Oct 25 21:25:42 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:25:42 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Instance destroyed successfully.
Oct 25 21:25:42 user nova-compute[74189]: DEBUG nova.objects.instance [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lazy-loading 'resources' on Instance uuid de6b6789-b328-4c3b-8d24-07774d5dbe6d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG nova.objects.base [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Object Instance<de6b6789-b328-4c3b-8d24-07774d5dbe6d> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:21:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1758392823',display_name='tempest-AttachVolumeTestJSON-server-1758392823',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1758392823',id=17,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPiYEbKeppJsHkf9Hx5OHRO2CLzGAPd2wBVnTnbTrf7OneA+NCoBGPS8Iup7Bh8CoPm7/VcfZ0KMuu8zfSepXMiLSwU39yVEsYz6SpCmvS4oU93LKx611A6fXbw0yJUBA==',key_name='tempest-keypair-2000039022',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:21:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d1d0f1deb7f04244920dae579032b287',ramdisk_id='',reservation_id='r-90yevjj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1213560671',owner_user_name='tempest-AttachVolumeTestJSON-1213560671-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:23:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e55da2b7458469e844fad1fe95cb695',uuid=de6b6789-b328-4c3b-8d24-07774d5dbe6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "address": "fa:16:3e:df:d0:7a", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bbbcbc-08", "ovs_interfaceid": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Converting VIF {"id": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "address": "fa:16:3e:df:d0:7a", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bbbcbc-08", "ovs_interfaceid": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:d0:7a,bridge_name='br-int',has_traffic_filtering=True,id=b0bbbcbc-085e-476f-b600-f1d684f23beb,network=Network(1d219ea7-a949-4c77-9cd1-79cc99d6ac42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bbbcbc-08') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG os_vif [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:d0:7a,bridge_name='br-int',has_traffic_filtering=True,id=b0bbbcbc-085e-476f-b600-f1d684f23beb,network=Network(1d219ea7-a949-4c77-9cd1-79cc99d6ac42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bbbcbc-08') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0bbbcbc-08, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6f63a963-a1b6-4e59-aac6-89b9c4894045) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:42 user nova-compute[74189]: INFO os_vif [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:d0:7a,bridge_name='br-int',has_traffic_filtering=True,id=b0bbbcbc-085e-476f-b600-f1d684f23beb,network=Network(1d219ea7-a949-4c77-9cd1-79cc99d6ac42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bbbcbc-08')
Oct 25 21:25:42 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDraZkpJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:25:42 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:25:42 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:42 user nova-compute[74189]: INFO nova.compute.manager [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Took 7.13 seconds to spawn the instance on the hypervisor.
Oct 25 21:25:42 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b47301a-b643-4669-903c-df04847f1606]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:25:42 user nova-compute[74189]: No targets found.
Oct 25 21:25:42 user nova-compute[74189]: iSNS:
Oct 25 21:25:42 user nova-compute[74189]: No targets found.
Oct 25 21:25:42 user nova-compute[74189]: STATIC:
Oct 25 21:25:42 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1
Oct 25 21:25:42 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:25:42 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:25:42 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f
Oct 25 21:25:42 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:25:42 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:25:42 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:25:42 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:25:42 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:25:42 user nova-compute[74189]: FIRMWARE:
Oct 25 21:25:42 user nova-compute[74189]: No targets found.
Oct 25 21:25:42 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:25:42 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:25:42 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a378d56-c1ee-40e8-ad8e-3c26e1b5201e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[701391a2-0700-4737-99de-32b77897dcf6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:25:42 user nova-compute[74189]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)
Oct 25 21:25:42 user nova-compute[74189]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:25:42 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:25:42 user nova-compute[74189]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)
Oct 25 21:25:42 user nova-compute[74189]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:25:42 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe304193640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f'): ({'sdc'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Removing single pathed devices sdc {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1498692-f10d-4868-986d-b592e2082fd9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:42 user nova-compute[74189]: INFO nova.compute.manager [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Took 8.08 seconds to build instance.
Oct 25 21:25:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0961e7be-26a8-4d18-b79f-0bfa53ea3372]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a8160f5e-9ecf-4716-b04b-7741a09dbdbf tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "a57b1185-270e-40d0-a55e-986960826169" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.211s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Flushing IO for device /dev/sdc {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae57afc9-fd87-4cb6-9bef-47e78bbbdaf0]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3addf736-e4b8-4199-aa7c-acf4826e6a45]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] SCSI volumes sdc have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b55781f-7530-42d5-9a8c-cf3142f838cb]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0065def-e862-402f-b958-725db94fd5ff]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f, portal: 172.16.0.220,3260]
Oct 25 21:25:42 user nova-compute[74189]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f, portal: 172.16.0.220,3260] successful.
Oct 25 21:25:42 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:25:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ffe215-6d88-4982-85b8-b9db0ebea442]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] <== disconnect_volume: return (414ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Start _get_guest_xml network_info=[{"id": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "address": "fa:16:3e:df:d0:7a", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bbbcbc-08", "ovs_interfaceid": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDraZkpJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'de6b6789-b328-4c3b-8d24-07774d5dbe6d', 'attached_at': '', 'detached_at': '', 'volume_id': '5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f', 'serial': '5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f'}, 'attachment_id': '10f5174f-74df-475c-90b8-4f4a8f95ed03', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG nova.objects.instance [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lazy-loading 'numa_topology' on Instance uuid de6b6789-b328-4c3b-8d24-07774d5dbe6d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG nova.objects.base [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Object Instance<de6b6789-b328-4c3b-8d24-07774d5dbe6d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:25:43 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:25:43 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:25:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG nova.objects.instance [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lazy-loading 'vcpu_model' on Instance uuid de6b6789-b328-4c3b-8d24-07774d5dbe6d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG nova.compute.manager [req-74cb195b-a1d5-4446-8a8b-2ee5a1834308 req-a12d0b0e-202a-44fb-adf4-e7a358388c76 service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Received event network-vif-plugged-b05a2001-02cd-45af-9242-3d6246edcd0b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-74cb195b-a1d5-4446-8a8b-2ee5a1834308 req-a12d0b0e-202a-44fb-adf4-e7a358388c76 service nova] Acquiring lock "7eff6940-9675-4c89-bd28-378a5db4369f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-74cb195b-a1d5-4446-8a8b-2ee5a1834308 req-a12d0b0e-202a-44fb-adf4-e7a358388c76 service nova] Lock "7eff6940-9675-4c89-bd28-378a5db4369f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-74cb195b-a1d5-4446-8a8b-2ee5a1834308 req-a12d0b0e-202a-44fb-adf4-e7a358388c76 service nova] Lock "7eff6940-9675-4c89-bd28-378a5db4369f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG nova.compute.manager [req-74cb195b-a1d5-4446-8a8b-2ee5a1834308 req-a12d0b0e-202a-44fb-adf4-e7a358388c76 service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] No waiting events found dispatching network-vif-plugged-b05a2001-02cd-45af-9242-3d6246edcd0b {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:25:43 user nova-compute[74189]: WARNING nova.compute.manager [req-74cb195b-a1d5-4446-8a8b-2ee5a1834308 req-a12d0b0e-202a-44fb-adf4-e7a358388c76 service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Received unexpected event network-vif-plugged-b05a2001-02cd-45af-9242-3d6246edcd0b for instance with vm_state building and task_state spawning.
Oct 25 21:25:43 user nova-compute[74189]: DEBUG nova.objects.base [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Object Instance<de6b6789-b328-4c3b-8d24-07774d5dbe6d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDraZkpJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:25:43 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:25:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:25:43 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:25:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:25:43 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7978181-44d8-46df-a57a-926905acfd34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:25:43 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.038s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[192a6c80-f9ef-4264-b87f-3131e8f968db]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f] added
Oct 25 21:25:43 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4733eb-3418-4998-8694-a7457538612f]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[47688961-4ba9-4c74-abcd-d5fbff59a706]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qDraZkpJ {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qDraZkpJ" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b43b528-797d-495c-935f-79382be4d31b]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qDraZkpJ'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9061284-06c7-4c50-8c92-ed73a7b7c12a]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b429db04-fb9f-4751-8a10-d7bba56dd061]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:25:43 user nova-compute[74189]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)
Oct 25 21:25:43 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:25:43 user nova-compute[74189]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)
Oct 25 21:25:43 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5262d2fb-88e6-4e22-b5e4-886877e864c4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f, portal: 172.16.0.220,3260]
Oct 25 21:25:43 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f, portal: 172.16.0.220,3260] successful.
Oct 25 21:25:43 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6b0d7f-0725-4a8d-a8f8-826f5c60e9f0]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38de4b6-cf42-4877-add0-bfed71b96f9d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:25:43 user nova-compute[74189]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)
Oct 25 21:25:43 user nova-compute[74189]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:25:43 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:25:43 user nova-compute[74189]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)
Oct 25 21:25:43 user nova-compute[74189]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:25:43 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80d6cad-c8be-434b-9e45-fea5290b2f47]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:25:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDraZkpJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:25:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:25:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '23133616331336462', 'path': '/dev/sdc'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:25:44 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133616331336462', 'path': '/dev/sdc'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:25:44 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:21:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1758392823',display_name='tempest-AttachVolumeTestJSON-server-1758392823',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1758392823',id=17,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPiYEbKeppJsHkf9Hx5OHRO2CLzGAPd2wBVnTnbTrf7OneA+NCoBGPS8Iup7Bh8CoPm7/VcfZ0KMuu8zfSepXMiLSwU39yVEsYz6SpCmvS4oU93LKx611A6fXbw0yJUBA==',key_name='tempest-keypair-2000039022',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:21:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d1d0f1deb7f04244920dae579032b287',ramdisk_id='',reservation_id='r-90yevjj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1213560671',owner_user_name='tempest-AttachVolumeTestJSON-1213560671-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:23:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e55da2b7458469e844fad1fe95cb695',uuid=de6b6789-b328-4c3b-8d24-07774d5dbe6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "address": "fa:16:3e:df:d0:7a", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bbbcbc-08", "ovs_interfaceid": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:25:44 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Converting VIF {"id": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "address": "fa:16:3e:df:d0:7a", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bbbcbc-08", "ovs_interfaceid": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:25:44 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:d0:7a,bridge_name='br-int',has_traffic_filtering=True,id=b0bbbcbc-085e-476f-b600-f1d684f23beb,network=Network(1d219ea7-a949-4c77-9cd1-79cc99d6ac42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bbbcbc-08') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:25:44 user nova-compute[74189]: DEBUG nova.objects.instance [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lazy-loading 'pci_devices' on Instance uuid de6b6789-b328-4c3b-8d24-07774d5dbe6d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:25:44 user nova-compute[74189]: DEBUG nova.objects.base [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Object Instance<de6b6789-b328-4c3b-8d24-07774d5dbe6d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:25:44 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:25:44 user nova-compute[74189]:   <uuid>de6b6789-b328-4c3b-8d24-07774d5dbe6d</uuid>
Oct 25 21:25:44 user nova-compute[74189]:   <name>instance-00000011</name>
Oct 25 21:25:44 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:25:44 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:25:44 user nova-compute[74189]:   <metadata>
Oct 25 21:25:44 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:25:44 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:25:44 user nova-compute[74189]:       <nova:name>tempest-AttachVolumeTestJSON-server-1758392823</nova:name>
Oct 25 21:25:44 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:25:43</nova:creationTime>
Oct 25 21:25:44 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:25:44 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:25:44 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:25:44 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:25:44 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:25:44 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:25:44 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:25:44 user nova-compute[74189]:       <nova:owner>
Oct 25 21:25:44 user nova-compute[74189]:         <nova:user uuid="9e55da2b7458469e844fad1fe95cb695">tempest-AttachVolumeTestJSON-1213560671-project-member</nova:user>
Oct 25 21:25:44 user nova-compute[74189]:         <nova:project uuid="d1d0f1deb7f04244920dae579032b287">tempest-AttachVolumeTestJSON-1213560671</nova:project>
Oct 25 21:25:44 user nova-compute[74189]:       </nova:owner>
Oct 25 21:25:44 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:25:44 user nova-compute[74189]:       <nova:ports>
Oct 25 21:25:44 user nova-compute[74189]:         <nova:port uuid="b0bbbcbc-085e-476f-b600-f1d684f23beb">
Oct 25 21:25:44 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 21:25:44 user nova-compute[74189]:         </nova:port>
Oct 25 21:25:44 user nova-compute[74189]:       </nova:ports>
Oct 25 21:25:44 user nova-compute[74189]:     </nova:instance>
Oct 25 21:25:44 user nova-compute[74189]:   </metadata>
Oct 25 21:25:44 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:25:44 user nova-compute[74189]:     <system>
Oct 25 21:25:44 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:25:44 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:25:44 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:25:44 user nova-compute[74189]:       <entry name="serial">de6b6789-b328-4c3b-8d24-07774d5dbe6d</entry>
Oct 25 21:25:44 user nova-compute[74189]:       <entry name="uuid">de6b6789-b328-4c3b-8d24-07774d5dbe6d</entry>
Oct 25 21:25:44 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:25:44 user nova-compute[74189]:     </system>
Oct 25 21:25:44 user nova-compute[74189]:   </sysinfo>
Oct 25 21:25:44 user nova-compute[74189]:   <os>
Oct 25 21:25:44 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:25:44 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:25:44 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:25:44 user nova-compute[74189]:   </os>
Oct 25 21:25:44 user nova-compute[74189]:   <features>
Oct 25 21:25:44 user nova-compute[74189]:     <acpi/>
Oct 25 21:25:44 user nova-compute[74189]:     <apic/>
Oct 25 21:25:44 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:25:44 user nova-compute[74189]:   </features>
Oct 25 21:25:44 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:25:44 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:25:44 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:25:44 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:25:44 user nova-compute[74189]:   </clock>
Oct 25 21:25:44 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:25:44 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:25:44 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:25:44 user nova-compute[74189]:   </cpu>
Oct 25 21:25:44 user nova-compute[74189]:   <devices>
Oct 25 21:25:44 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:25:44 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:25:44 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk"/>
Oct 25 21:25:44 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:25:44 user nova-compute[74189]:     </disk>
Oct 25 21:25:44 user nova-compute[74189]:     <disk type="block" device="disk">
Oct 25 21:25:44 user nova-compute[74189]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:25:44 user nova-compute[74189]:       <source dev="/dev/sdc"/>
Oct 25 21:25:44 user nova-compute[74189]:       <target dev="vdb" bus="virtio"/>
Oct 25 21:25:44 user nova-compute[74189]:       <serial>5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f</serial>
Oct 25 21:25:44 user nova-compute[74189]:     </disk>
Oct 25 21:25:44 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:25:44 user nova-compute[74189]:       <mac address="fa:16:3e:df:d0:7a"/>
Oct 25 21:25:44 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:25:44 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:25:44 user nova-compute[74189]:       <target dev="tapb0bbbcbc-08"/>
Oct 25 21:25:44 user nova-compute[74189]:     </interface>
Oct 25 21:25:44 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:25:44 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/console.log" append="off"/>
Oct 25 21:25:44 user nova-compute[74189]:     </serial>
Oct 25 21:25:44 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:25:44 user nova-compute[74189]:     <video>
Oct 25 21:25:44 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:25:44 user nova-compute[74189]:     </video>
Oct 25 21:25:44 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:25:44 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:25:44 user nova-compute[74189]:     </rng>
Oct 25 21:25:44 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:25:44 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:25:44 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:25:44 user nova-compute[74189]:     </memballoon>
Oct 25 21:25:44 user nova-compute[74189]:   </devices>
Oct 25 21:25:44 user nova-compute[74189]: </domain>
Oct 25 21:25:44 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:25:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG nova.objects.instance [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lazy-loading 'trusted_certs' on Instance uuid de6b6789-b328-4c3b-8d24-07774d5dbe6d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG nova.objects.base [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Object Instance<de6b6789-b328-4c3b-8d24-07774d5dbe6d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG nova.compute.manager [req-521a4778-42b4-4f85-9c78-0af43cf521fc req-7b3afb68-1c7a-44a9-a37b-4e71362ecfdd service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Received event network-vif-plugged-b05a2001-02cd-45af-9242-3d6246edcd0b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-521a4778-42b4-4f85-9c78-0af43cf521fc req-7b3afb68-1c7a-44a9-a37b-4e71362ecfdd service nova] Acquiring lock "7eff6940-9675-4c89-bd28-378a5db4369f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-521a4778-42b4-4f85-9c78-0af43cf521fc req-7b3afb68-1c7a-44a9-a37b-4e71362ecfdd service nova] Lock "7eff6940-9675-4c89-bd28-378a5db4369f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-521a4778-42b4-4f85-9c78-0af43cf521fc req-7b3afb68-1c7a-44a9-a37b-4e71362ecfdd service nova] Lock "7eff6940-9675-4c89-bd28-378a5db4369f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG nova.compute.manager [req-521a4778-42b4-4f85-9c78-0af43cf521fc req-7b3afb68-1c7a-44a9-a37b-4e71362ecfdd service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] No waiting events found dispatching network-vif-plugged-b05a2001-02cd-45af-9242-3d6246edcd0b {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:25:45 user nova-compute[74189]: WARNING nova.compute.manager [req-521a4778-42b4-4f85-9c78-0af43cf521fc req-7b3afb68-1c7a-44a9-a37b-4e71362ecfdd service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Received unexpected event network-vif-plugged-b05a2001-02cd-45af-9242-3d6246edcd0b for instance with vm_state building and task_state spawning.
Oct 25 21:25:45 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.198s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:25:45 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Instance spawned successfully.
Oct 25 21:25:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:25:45 user nova-compute[74189]: INFO nova.compute.manager [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Took 6.63 seconds to spawn the instance on the hypervisor.
Oct 25 21:25:45 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Cannot resize image /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG nova.objects.instance [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lazy-loading 'migration_context' on Instance uuid de6b6789-b328-4c3b-8d24-07774d5dbe6d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG nova.objects.base [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Object Instance<de6b6789-b328-4c3b-8d24-07774d5dbe6d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:21:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1758392823',display_name='tempest-AttachVolumeTestJSON-server-1758392823',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1758392823',id=17,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPiYEbKeppJsHkf9Hx5OHRO2CLzGAPd2wBVnTnbTrf7OneA+NCoBGPS8Iup7Bh8CoPm7/VcfZ0KMuu8zfSepXMiLSwU39yVEsYz6SpCmvS4oU93LKx611A6fXbw0yJUBA==',key_name='tempest-keypair-2000039022',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:21:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='d1d0f1deb7f04244920dae579032b287',ramdisk_id='',reservation_id='r-90yevjj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1213560671',owner_user_name='tempest-AttachVolumeTestJSON-1213560671-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:23:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e55da2b7458469e844fad1fe95cb695',uuid=de6b6789-b328-4c3b-8d24-07774d5dbe6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "address": "fa:16:3e:df:d0:7a", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bbbcbc-08", "ovs_interfaceid": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Converting VIF {"id": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "address": "fa:16:3e:df:d0:7a", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bbbcbc-08", "ovs_interfaceid": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:d0:7a,bridge_name='br-int',has_traffic_filtering=True,id=b0bbbcbc-085e-476f-b600-f1d684f23beb,network=Network(1d219ea7-a949-4c77-9cd1-79cc99d6ac42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bbbcbc-08') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG os_vif [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:d0:7a,bridge_name='br-int',has_traffic_filtering=True,id=b0bbbcbc-085e-476f-b600-f1d684f23beb,network=Network(1d219ea7-a949-4c77-9cd1-79cc99d6ac42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bbbcbc-08') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:25:45 user nova-compute[74189]: INFO nova.compute.manager [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Took 7.55 seconds to build instance.
Oct 25 21:25:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15c15be6-9f0b-54e6-8f6c-4f53901d39e5', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0bbbcbc-08, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb0bbbcbc-08, col_values=(('qos', UUID('6737f0ab-0ff9-4893-bc33-eef7557963a0')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb0bbbcbc-08, col_values=(('external_ids', {'iface-id': 'b0bbbcbc-085e-476f-b600-f1d684f23beb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:d0:7a', 'vm-uuid': 'de6b6789-b328-4c3b-8d24-07774d5dbe6d'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a9c0da06-b505-4e1b-9f7c-216ab439648e tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "7eff6940-9675-4c89-bd28-378a5db4369f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.715s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:25:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:45 user nova-compute[74189]: INFO os_vif [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:d0:7a,bridge_name='br-int',has_traffic_filtering=True,id=b0bbbcbc-085e-476f-b600-f1d684f23beb,network=Network(1d219ea7-a949-4c77-9cd1-79cc99d6ac42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bbbcbc-08')
Oct 25 21:25:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:48 user nova-compute[74189]: DEBUG nova.compute.manager [req-e12c06b9-30ab-4c1f-b959-b0848dc951ff req-cea7991d-9113-4fd4-bb3e-491954a7e734 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Received event network-vif-plugged-b0bbbcbc-085e-476f-b600-f1d684f23beb {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:25:48 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e12c06b9-30ab-4c1f-b959-b0848dc951ff req-cea7991d-9113-4fd4-bb3e-491954a7e734 service nova] Acquiring lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:48 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e12c06b9-30ab-4c1f-b959-b0848dc951ff req-cea7991d-9113-4fd4-bb3e-491954a7e734 service nova] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:48 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e12c06b9-30ab-4c1f-b959-b0848dc951ff req-cea7991d-9113-4fd4-bb3e-491954a7e734 service nova] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:48 user nova-compute[74189]: DEBUG nova.compute.manager [req-e12c06b9-30ab-4c1f-b959-b0848dc951ff req-cea7991d-9113-4fd4-bb3e-491954a7e734 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] No waiting events found dispatching network-vif-plugged-b0bbbcbc-085e-476f-b600-f1d684f23beb {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:25:48 user nova-compute[74189]: WARNING nova.compute.manager [req-e12c06b9-30ab-4c1f-b959-b0848dc951ff req-cea7991d-9113-4fd4-bb3e-491954a7e734 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Received unexpected event network-vif-plugged-b0bbbcbc-085e-476f-b600-f1d684f23beb for instance with vm_state stopped and task_state powering-on.
Oct 25 21:25:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:50 user nova-compute[74189]: DEBUG nova.compute.manager [req-434fb12a-3576-4dea-8b2b-94859904b71c req-22cc2067-bc15-454f-b3a8-048879ace0a7 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Received event network-vif-plugged-b0bbbcbc-085e-476f-b600-f1d684f23beb {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:25:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-434fb12a-3576-4dea-8b2b-94859904b71c req-22cc2067-bc15-454f-b3a8-048879ace0a7 service nova] Acquiring lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:25:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-434fb12a-3576-4dea-8b2b-94859904b71c req-22cc2067-bc15-454f-b3a8-048879ace0a7 service nova] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:25:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-434fb12a-3576-4dea-8b2b-94859904b71c req-22cc2067-bc15-454f-b3a8-048879ace0a7 service nova] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:25:50 user nova-compute[74189]: DEBUG nova.compute.manager [req-434fb12a-3576-4dea-8b2b-94859904b71c req-22cc2067-bc15-454f-b3a8-048879ace0a7 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] No waiting events found dispatching network-vif-plugged-b0bbbcbc-085e-476f-b600-f1d684f23beb {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:25:50 user nova-compute[74189]: WARNING nova.compute.manager [req-434fb12a-3576-4dea-8b2b-94859904b71c req-22cc2067-bc15-454f-b3a8-048879ace0a7 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Received unexpected event network-vif-plugged-b0bbbcbc-085e-476f-b600-f1d684f23beb for instance with vm_state stopped and task_state powering-on.
Oct 25 21:25:50 user nova-compute[74189]: DEBUG nova.compute.manager [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:25:50 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Instance rebooted successfully.
Oct 25 21:25:50 user nova-compute[74189]: DEBUG nova.compute.manager [None req-669b4ec6-d06f-4817-a312-e14a37ef537e tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:25:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:53 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:25:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:26:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 21:26:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:26:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:26:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:04 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:26:04 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:26:04 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:26:04 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74189) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 21:26:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:05 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:26:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:26:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:26:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:26:05 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:26:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:07 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:26:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Acquiring lock "75071d8a-2ce2-43b5-99f6-23853399dc97" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:26:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:26:08 user nova-compute[74189]: DEBUG nova.objects.instance [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lazy-loading 'flavor' on Instance uuid 75071d8a-2ce2-43b5-99f6-23853399dc97 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:26:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:26:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Acquiring lock "75071d8a-2ce2-43b5-99f6-23853399dc97" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:26:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:26:08 user nova-compute[74189]: INFO nova.compute.manager [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Attaching volume 4f257f0f-5b89-4c0f-8120-b1b725384c6a to /dev/vdb
Oct 25 21:26:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:08 user nova-compute[74189]: DEBUG os_brick.utils [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:26:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:08 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb710e07-d576-46b2-97d8-b9fa31dc6a28]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:08 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a0dad3-cf3a-4ca8-bc7e-94472ec321e5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:08 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce46c1ab-ad31-4ffc-990c-a5a61c10cc11]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:08 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdbd939-8630-4e51-96d3-8853e4c4742b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:26:08 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:26:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:26:08 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:26:08 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97aac0b-659b-4cbc-8a35-9b55a41e2678]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:08 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:26:08 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:26:08 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:26:08 user nova-compute[74189]: DEBUG os_brick.utils [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:26:08 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Updating existing volume attachment record: 87960ca7-87cc-4f98-ad4f-190394ee2f67 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:26:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:26:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/680e134e-5e0d-464f-9e30-460010348795/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/680e134e-5e0d-464f-9e30-460010348795/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/680e134e-5e0d-464f-9e30-460010348795/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/680e134e-5e0d-464f-9e30-460010348795/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:26:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "680e134e-5e0d-464f-9e30-460010348795" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:26:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "680e134e-5e0d-464f-9e30-460010348795" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:26:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:10 user nova-compute[74189]: INFO nova.compute.manager [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Detaching volume a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1
Oct 25 21:26:10 user nova-compute[74189]: INFO nova.virt.block_device [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Attempting to driver detach volume a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 from mountpoint /dev/vdb
Oct 25 21:26:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:10 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Attempting to detach device vdb from instance 680e134e-5e0d-464f-9e30-460010348795 from the persistent domain config. {{(pid=74189) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 21:26:10 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:26:10 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:26:10 user nova-compute[74189]:   <source dev="/dev/sdg"/>
Oct 25 21:26:10 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:26:10 user nova-compute[74189]:   <serial>a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1</serial>
Oct 25 21:26:10 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:26:10 user nova-compute[74189]: </disk>
Oct 25 21:26:10 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:26:10 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Successfully detached device vdb from instance 680e134e-5e0d-464f-9e30-460010348795 from the persistent domain config.
Oct 25 21:26:10 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 680e134e-5e0d-464f-9e30-460010348795 from the live domain config. {{(pid=74189) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 21:26:10 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:26:10 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:26:10 user nova-compute[74189]:   <source dev="/dev/sdg"/>
Oct 25 21:26:10 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:26:10 user nova-compute[74189]:   <serial>a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1</serial>
Oct 25 21:26:10 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:26:10 user nova-compute[74189]: </disk>
Oct 25 21:26:10 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:26:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:10 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 680e134e-5e0d-464f-9e30-460010348795 {{(pid=74189) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 21:26:10 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:26:10 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:26:10 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=7374MB free_disk=25.158557891845703GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:26:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:26:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:26:11 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance d7c3a99a-ab38-4e88-896d-94ae51a09a48 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:26:11 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance af1d7b3c-9950-4b74-8f15-b31011ccfa24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:26:11 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 680e134e-5e0d-464f-9e30-460010348795 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:26:11 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance de6b6789-b328-4c3b-8d24-07774d5dbe6d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:26:11 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 932fe8ac-fdde-45c6-aa32-9bf866f19a4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:26:11 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 75071d8a-2ce2-43b5-99f6-23853399dc97 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:26:11 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 0b4f80c4-98cc-440a-aac7-cd423b71a231 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:26:11 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:26:11 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance a57b1185-270e-40d0-a55e-986960826169 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:26:11 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 7eff6940-9675-4c89-bd28-378a5db4369f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:26:11 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:26:11 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:26:11 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:26:11 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:26:11 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:26:11 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.519s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:26:11 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:26:12 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:26:12 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:26:12 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:26:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-de6b6789-b328-4c3b-8d24-07774d5dbe6d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:26:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-de6b6789-b328-4c3b-8d24-07774d5dbe6d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:26:12 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:26:13 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Updating instance_info_cache with network_info: [{"id": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "address": "fa:16:3e:df:d0:7a", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bbbcbc-08", "ovs_interfaceid": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:26:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-de6b6789-b328-4c3b-8d24-07774d5dbe6d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:26:13 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:26:13 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:26:13 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:26:13 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:26:13 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:26:13 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:26:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:16 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:26:16 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Cleaning up deleted instances {{(pid=74189) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 21:26:16 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] There are 0 instances to clean {{(pid=74189) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 21:26:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:18 user nova-compute[74189]: DEBUG nova.compute.manager [None req-2961a163-0708-4128-9679-f5e01f4d9ed8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:26:18 user nova-compute[74189]: INFO nova.compute.manager [None req-2961a163-0708-4128-9679-f5e01f4d9ed8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] instance snapshotting
Oct 25 21:26:18 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-2961a163-0708-4128-9679-f5e01f4d9ed8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Beginning live snapshot process
Oct 25 21:26:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-2961a163-0708-4128-9679-f5e01f4d9ed8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json -f qcow2 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-2961a163-0708-4128-9679-f5e01f4d9ed8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json -f qcow2" returned: 0 in 0.234s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-2961a163-0708-4128-9679-f5e01f4d9ed8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json -f qcow2 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-2961a163-0708-4128-9679-f5e01f4d9ed8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json -f qcow2" returned: 0 in 0.202s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-2961a163-0708-4128-9679-f5e01f4d9ed8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-2961a163-0708-4128-9679-f5e01f4d9ed8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.196s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-2961a163-0708-4128-9679-f5e01f4d9ed8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsny9op2m/1d69e0481e5b4adcada738185f9886e5.delta 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-2961a163-0708-4128-9679-f5e01f4d9ed8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsny9op2m/1d69e0481e5b4adcada738185f9886e5.delta 1073741824" returned: 0 in 0.057s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:19 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-2961a163-0708-4128-9679-f5e01f4d9ed8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 25 21:26:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-2961a163-0708-4128-9679-f5e01f4d9ed8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74189) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 21:26:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-2961a163-0708-4128-9679-f5e01f4d9ed8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74189) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 21:26:20 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-2961a163-0708-4128-9679-f5e01f4d9ed8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 25 21:26:21 user nova-compute[74189]: DEBUG nova.privsep.utils [None req-2961a163-0708-4128-9679-f5e01f4d9ed8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74189) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 21:26:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-2961a163-0708-4128-9679-f5e01f4d9ed8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsny9op2m/1d69e0481e5b4adcada738185f9886e5.delta /opt/stack/data/nova/instances/snapshots/tmpsny9op2m/1d69e0481e5b4adcada738185f9886e5 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-2961a163-0708-4128-9679-f5e01f4d9ed8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsny9op2m/1d69e0481e5b4adcada738185f9886e5.delta /opt/stack/data/nova/instances/snapshots/tmpsny9op2m/1d69e0481e5b4adcada738185f9886e5" returned: 0 in 0.721s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:21 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-2961a163-0708-4128-9679-f5e01f4d9ed8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Snapshot extracted, beginning image upload
Oct 25 21:26:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:24 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-2961a163-0708-4128-9679-f5e01f4d9ed8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Snapshot image upload complete
Oct 25 21:26:24 user nova-compute[74189]: INFO nova.compute.manager [None req-2961a163-0708-4128-9679-f5e01f4d9ed8 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Took 6.13 seconds to snapshot the instance on the hypervisor.
Oct 25 21:26:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:28 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:26:28 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ojGqQAgJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:26:28 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:26:28 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:26:28 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:26:28 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:26:28 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:26:28 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:26:28 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:26:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:28 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1cd8a9-acd5-4972-820c-c78a455176c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:28 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:26:28 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:26:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:28 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[29eb8a38-ffd8-4b98-8493-ebec32ae2845]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:28 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a] added
Oct 25 21:26:28 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:26:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:28 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8daf78d-cfcc-44f5-8bcc-601ae4f9fe73]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:28 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:26:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:28 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f84427-9193-4e8a-9a44-ef2b419aa75e]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:28 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:26:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ojGqQAgJ {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ojGqQAgJ" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:28 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[074b97a8-58e2-4974-8d95-c93bde325325]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:28 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ojGqQAgJ'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:26:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:28 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f57ce7-110f-4301-81df-259d90dfa8b2]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:28 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:26:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:28 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f41fba5-225d-41d1-b127-f9f14f91c896]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:28 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:26:28 user nova-compute[74189]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)
Oct 25 21:26:28 user nova-compute[74189]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:26:28 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:26:28 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:26:28 user nova-compute[74189]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)
Oct 25 21:26:28 user nova-compute[74189]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:26:28 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:26:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:29 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dda2ad-1938-486a-af8b-2429804c39e8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:29 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a, portal: 172.16.0.220,3260]
Oct 25 21:26:29 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a, portal: 172.16.0.220,3260] successful.
Oct 25 21:26:29 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:26:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.066s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:29 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[56135e8c-d22c-40e5-876f-df6e94766b87]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:29 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:26:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:29 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a221ac-8d22-459a-b42e-b85886d72fbf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:29 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:26:29 user nova-compute[74189]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)
Oct 25 21:26:29 user nova-compute[74189]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:26:29 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:26:29 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:26:29 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:26:29 user nova-compute[74189]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)
Oct 25 21:26:29 user nova-compute[74189]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:26:29 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:26:29 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:26:29 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:26:29 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:26:29 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:26:29 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:26:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:29 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d748549-9b97-4461-bb58-435eeaefe69b]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:29 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: None {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:26:30 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:26:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ojGqQAgJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:26:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:26:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '26262333732336332', 'path': '/dev/sdd'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:26:30 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262333732336332', 'path': '/dev/sdd'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:26:30 user nova-compute[74189]: DEBUG nova.objects.instance [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lazy-loading 'flavor' on Instance uuid 75071d8a-2ce2-43b5-99f6-23853399dc97 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:26:30 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 21:26:30 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:26:30 user nova-compute[74189]:   <source dev="/dev/sdd"/>
Oct 25 21:26:30 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:26:30 user nova-compute[74189]:   <serial>4f257f0f-5b89-4c0f-8120-b1b725384c6a</serial>
Oct 25 21:26:30 user nova-compute[74189]: </disk>
Oct 25 21:26:30 user nova-compute[74189]:  {{(pid=74189) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 21:26:30 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:26:30 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:26:30 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] No VIF found with MAC fa:16:3e:02:6a:1d, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:26:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e956b950-1cda-4493-84b9-82938a48b3e6 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.492s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:26:30 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 680e134e-5e0d-464f-9e30-460010348795 is timed out.
Oct 25 21:26:30 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Successfully detached device vdb from instance 680e134e-5e0d-464f-9e30-460010348795 from the live domain config.
Oct 25 21:26:30 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:26:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'drbaqyvD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:26:30 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:26:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:26:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:26:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce6956b-6bd9-4a2d-89e0-1175aca2e92a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:26:30 user nova-compute[74189]: No targets found.
Oct 25 21:26:30 user nova-compute[74189]: iSNS:
Oct 25 21:26:30 user nova-compute[74189]: No targets found.
Oct 25 21:26:30 user nova-compute[74189]: STATIC:
Oct 25 21:26:30 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a
Oct 25 21:26:30 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:26:30 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:26:30 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1
Oct 25 21:26:30 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:26:30 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:26:30 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f
Oct 25 21:26:30 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:26:30 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:26:30 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:26:30 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:26:30 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:26:30 user nova-compute[74189]: FIRMWARE:
Oct 25 21:26:30 user nova-compute[74189]: No targets found.
Oct 25 21:26:30 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:26:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:26:30 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:26:30 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:26:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:26:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e56d1b-556a-4435-b939-7342c8945172]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4125659b-6bb1-4f4f-9e68-2f2afdfa2e09]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:26:31 user nova-compute[74189]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)
Oct 25 21:26:31 user nova-compute[74189]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:26:31 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:26:31 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:26:31 user nova-compute[74189]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 (non-flash)
Oct 25 21:26:31 user nova-compute[74189]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:26:31 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:26:31 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2e4219e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1'): ({'sdg'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Removing single pathed devices sdg {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0162d1-eeff-4371-90f7-0084a4bb1e19]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a029e4b4-02ef-43c5-82e8-5ce4677769a5]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Flushing IO for device /dev/sdg {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7721c377-c30c-42c0-8801-9bc16ec26908]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e79dc54-d53b-4eb1-92b0-ca6ec5b8ce30]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] SCSI volumes sdg have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29ecdaf-fb95-4ac2-9d03-8f50b33f79bd]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[420d6590-fbfc-4b4f-a2ba-5192a995e317]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1, portal: 172.16.0.220,3260]
Oct 25 21:26:31 user nova-compute[74189]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1, portal: 172.16.0.220,3260] successful.
Oct 25 21:26:31 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1857ac2-a6a1-4db8-ae9c-6bc7682e31d1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de18d07-a2b3-40dc-a47e-13b9c3f3b103]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] <== disconnect_volume: return (340ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:26:31 user nova-compute[74189]: INFO nova.compute.manager [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Rescuing
Oct 25 21:26:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Acquiring lock "refresh_cache-75071d8a-2ce2-43b5-99f6-23853399dc97" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Acquired lock "refresh_cache-75071d8a-2ce2-43b5-99f6-23853399dc97" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG nova.network.neutron [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG nova.network.neutron [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Updating instance_info_cache with network_info: [{"id": "54123e00-9921-4807-b1f7-79073453a82f", "address": "fa:16:3e:02:6a:1d", "network": {"id": "3159e1a7-f60f-4768-9e06-a92287d19dd6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-119288589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046417147a924afdbc8b72333c362261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54123e00-99", "ovs_interfaceid": "54123e00-9921-4807-b1f7-79073453a82f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:26:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Releasing lock "refresh_cache-75071d8a-2ce2-43b5-99f6-23853399dc97" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:26:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:32 user nova-compute[74189]: DEBUG nova.objects.instance [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lazy-loading 'flavor' on Instance uuid 680e134e-5e0d-464f-9e30-460010348795 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:26:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-df506e10-8745-4293-814f-bb31cd14640f tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "680e134e-5e0d-464f-9e30-460010348795" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.258s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:26:32 user nova-compute[74189]: DEBUG nova.compute.manager [req-99d08471-8001-4429-9e1a-7260268f26cd req-0ccc8aca-6aca-4b78-a5a7-b58d17b330e5 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Received event network-vif-unplugged-54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:26:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-99d08471-8001-4429-9e1a-7260268f26cd req-0ccc8aca-6aca-4b78-a5a7-b58d17b330e5 service nova] Acquiring lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:26:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-99d08471-8001-4429-9e1a-7260268f26cd req-0ccc8aca-6aca-4b78-a5a7-b58d17b330e5 service nova] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:26:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-99d08471-8001-4429-9e1a-7260268f26cd req-0ccc8aca-6aca-4b78-a5a7-b58d17b330e5 service nova] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:26:32 user nova-compute[74189]: DEBUG nova.compute.manager [req-99d08471-8001-4429-9e1a-7260268f26cd req-0ccc8aca-6aca-4b78-a5a7-b58d17b330e5 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] No waiting events found dispatching network-vif-unplugged-54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:26:32 user nova-compute[74189]: WARNING nova.compute.manager [req-99d08471-8001-4429-9e1a-7260268f26cd req-0ccc8aca-6aca-4b78-a5a7-b58d17b330e5 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Received unexpected event network-vif-unplugged-54123e00-9921-4807-b1f7-79073453a82f for instance with vm_state active and task_state rescuing.
Oct 25 21:26:32 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Instance destroyed successfully.
Oct 25 21:26:32 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Attempting a stable device rescue
Oct 25 21:26:32 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74189) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 25 21:26:32 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Instance directory exists: not creating {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 21:26:32 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Creating image(s)
Oct 25 21:26:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Acquiring lock "/opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:26:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "/opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:26:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "/opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:26:32 user nova-compute[74189]: DEBUG nova.objects.instance [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lazy-loading 'trusted_certs' on Instance uuid 75071d8a-2ce2-43b5-99f6-23853399dc97 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:26:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Acquiring lock "be39b622d16183486b86a5905433aefa5bc2f512" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:26:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "be39b622d16183486b86a5905433aefa5bc2f512" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:26:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be39b622d16183486b86a5905433aefa5bc2f512.part --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be39b622d16183486b86a5905433aefa5bc2f512.part --force-share --output=json" returned: 0 in 0.204s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:33 user nova-compute[74189]: DEBUG nova.virt.images [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] 9a1f1b4d-50ed-40cc-b93f-06c4145ca079 was qcow2, converting to raw {{(pid=74189) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 21:26:33 user nova-compute[74189]: DEBUG nova.privsep.utils [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74189) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 21:26:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/be39b622d16183486b86a5905433aefa5bc2f512.part /opt/stack/data/nova/instances/_base/be39b622d16183486b86a5905433aefa5bc2f512.converted {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/be39b622d16183486b86a5905433aefa5bc2f512.part /opt/stack/data/nova/instances/_base/be39b622d16183486b86a5905433aefa5bc2f512.converted" returned: 0 in 0.292s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be39b622d16183486b86a5905433aefa5bc2f512.converted --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG nova.compute.manager [req-8c17e47c-7301-4330-94d3-9ffbde7c08da req-52336f3d-bc9b-459c-8437-0c1d6492f529 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Received event network-vif-plugged-54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8c17e47c-7301-4330-94d3-9ffbde7c08da req-52336f3d-bc9b-459c-8437-0c1d6492f529 service nova] Acquiring lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8c17e47c-7301-4330-94d3-9ffbde7c08da req-52336f3d-bc9b-459c-8437-0c1d6492f529 service nova] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8c17e47c-7301-4330-94d3-9ffbde7c08da req-52336f3d-bc9b-459c-8437-0c1d6492f529 service nova] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG nova.compute.manager [req-8c17e47c-7301-4330-94d3-9ffbde7c08da req-52336f3d-bc9b-459c-8437-0c1d6492f529 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] No waiting events found dispatching network-vif-plugged-54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:26:34 user nova-compute[74189]: WARNING nova.compute.manager [req-8c17e47c-7301-4330-94d3-9ffbde7c08da req-52336f3d-bc9b-459c-8437-0c1d6492f529 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Received unexpected event network-vif-plugged-54123e00-9921-4807-b1f7-79073453a82f for instance with vm_state active and task_state rescuing.
Oct 25 21:26:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be39b622d16183486b86a5905433aefa5bc2f512.converted --force-share --output=json" returned: 0 in 0.230s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "be39b622d16183486b86a5905433aefa5bc2f512" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.644s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Acquiring lock "be39b622d16183486b86a5905433aefa5bc2f512" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "be39b622d16183486b86a5905433aefa5bc2f512" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be39b622d16183486b86a5905433aefa5bc2f512 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be39b622d16183486b86a5905433aefa5bc2f512 --force-share --output=json" returned: 0 in 0.207s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be39b622d16183486b86a5905433aefa5bc2f512,backing_fmt=raw /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk.rescue {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be39b622d16183486b86a5905433aefa5bc2f512,backing_fmt=raw /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk.rescue" returned: 0 in 0.056s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "be39b622d16183486b86a5905433aefa5bc2f512" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG nova.objects.instance [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lazy-loading 'migration_context' on Instance uuid 75071d8a-2ce2-43b5-99f6-23853399dc97 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG nova.objects.base [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Object Instance<75071d8a-2ce2-43b5-99f6-23853399dc97> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Start _get_guest_xml network_info=[{"id": "54123e00-9921-4807-b1f7-79073453a82f", "address": "fa:16:3e:02:6a:1d", "network": {"id": "3159e1a7-f60f-4768-9e06-a92287d19dd6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-119288589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-119288589-network", "vif_mac": "fa:16:3e:02:6a:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046417147a924afdbc8b72333c362261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54123e00-99", "ovs_interfaceid": "54123e00-9921-4807-b1f7-79073453a82f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9a1f1b4d-50ed-40cc-b93f-06c4145ca079', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ojGqQAgJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '75071d8a-2ce2-43b5-99f6-23853399dc97', 'attached_at': '', 'detached_at': '', 'volume_id': '4f257f0f-5b89-4c0f-8120-b1b725384c6a', 'serial': '4f257f0f-5b89-4c0f-8120-b1b725384c6a'}, 'attachment_id': '87960ca7-87cc-4f98-ad4f-190394ee2f67', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG nova.objects.instance [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lazy-loading 'resources' on Instance uuid 75071d8a-2ce2-43b5-99f6-23853399dc97 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG nova.objects.base [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Object Instance<75071d8a-2ce2-43b5-99f6-23853399dc97> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG nova.objects.instance [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lazy-loading 'numa_topology' on Instance uuid 75071d8a-2ce2-43b5-99f6-23853399dc97 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG nova.objects.base [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Object Instance<75071d8a-2ce2-43b5-99f6-23853399dc97> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:26:34 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:26:34 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:26:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG nova.objects.instance [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lazy-loading 'vcpu_model' on Instance uuid 75071d8a-2ce2-43b5-99f6-23853399dc97 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG nova.objects.base [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Object Instance<75071d8a-2ce2-43b5-99f6-23853399dc97> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ojGqQAgJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:26:34 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:26:34 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:26:34 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:26:34 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:26:34 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:26:34 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:26:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a -p 172.16.0.220:3260" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f6421f-ee3b-4d3b-8bef-651dde0154b1]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ojGqQAgJ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 25 21:26:35 user nova-compute[74189]: node.name = iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a
Oct 25 21:26:35 user nova-compute[74189]: node.tpgt = -1
Oct 25 21:26:35 user nova-compute[74189]: node.startup = automatic
Oct 25 21:26:35 user nova-compute[74189]: node.leading_login = No
Oct 25 21:26:35 user nova-compute[74189]: iface.iscsi_ifacename = default
Oct 25 21:26:35 user nova-compute[74189]: iface.net_ifacename = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.ipaddress = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.prefix_len = 0
Oct 25 21:26:35 user nova-compute[74189]: iface.hwaddress = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.transport_name = tcp
Oct 25 21:26:35 user nova-compute[74189]: iface.initiatorname = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.state = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.vlan_id = 0
Oct 25 21:26:35 user nova-compute[74189]: iface.vlan_priority = 0
Oct 25 21:26:35 user nova-compute[74189]: iface.vlan_state = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.iface_num = 0
Oct 25 21:26:35 user nova-compute[74189]: iface.mtu = 0
Oct 25 21:26:35 user nova-compute[74189]: iface.port = 0
Oct 25 21:26:35 user nova-compute[74189]: iface.bootproto = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.subnet_mask = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.gateway = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.dhcp_alt_client_id_state = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.dhcp_alt_client_id = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.dhcp_dns = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.dhcp_learn_iqn = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.dhcp_req_vendor_id_state = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.dhcp_vendor_id_state = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.dhcp_vendor_id = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.dhcp_slp_da = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.fragmentation = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.gratuitous_arp = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.incoming_forwarding = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.tos_state = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.tos = 0
Oct 25 21:26:35 user nova-compute[74189]: iface.ttl = 0
Oct 25 21:26:35 user nova-compute[74189]: iface.delayed_ack = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.tcp_nagle = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.tcp_wsf_state = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.tcp_wsf = 0
Oct 25 21:26:35 user nova-compute[74189]: iface.tcp_timer_scale = 0
Oct 25 21:26:35 user nova-compute[74189]: iface.tcp_timestamp = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.redirect = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.def_task_mgmt_timeout = 0
Oct 25 21:26:35 user nova-compute[74189]: iface.header_digest = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.data_digest = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.immediate_data = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.initial_r2t = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.data_seq_inorder = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.data_pdu_inorder = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.erl = 0
Oct 25 21:26:35 user nova-compute[74189]: iface.max_receive_data_len = 0
Oct 25 21:26:35 user nova-compute[74189]: iface.first_burst_len = 0
Oct 25 21:26:35 user nova-compute[74189]: iface.max_outstanding_r2t = 0
Oct 25 21:26:35 user nova-compute[74189]: iface.max_burst_len = 0
Oct 25 21:26:35 user nova-compute[74189]: iface.chap_auth = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.bidi_chap = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.strict_login_compliance = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.discovery_auth = <empty>
Oct 25 21:26:35 user nova-compute[74189]: iface.discovery_logout = <empty>
Oct 25 21:26:35 user nova-compute[74189]: node.discovery_address = <empty>
Oct 25 21:26:35 user nova-compute[74189]: node.discovery_port = 0
Oct 25 21:26:35 user nova-compute[74189]: node.discovery_type = static
Oct 25 21:26:35 user nova-compute[74189]: node.session.initial_cmdsn = 0
Oct 25 21:26:35 user nova-compute[74189]: node.session.initial_login_retry_max = 8
Oct 25 21:26:35 user nova-compute[74189]: node.session.xmit_thread_priority = -20
Oct 25 21:26:35 user nova-compute[74189]: node.session.cmds_max = 128
Oct 25 21:26:35 user nova-compute[74189]: node.session.queue_depth = 32
Oct 25 21:26:35 user nova-compute[74189]: node.session.nr_sessions = 1
Oct 25 21:26:35 user nova-compute[74189]: node.session.auth.authmethod = CHAP
Oct 25 21:26:35 user nova-compute[74189]: node.session.auth.username = ojGqQAgJ
Oct 25 21:26:35 user nova-compute[74189]: node.session.auth.password = ***
Oct 25 21:26:35 user nova-compute[74189]: node.session.auth.username_in = <empty>
Oct 25 21:26:35 user nova-compute[74189]: node.session.auth.password_in = <empty>
Oct 25 21:26:35 user nova-compute[74189]: node.session.auth.chap_algs = MD5
Oct 25 21:26:35 user nova-compute[74189]: node.session.timeo.replacement_timeout = 120
Oct 25 21:26:35 user nova-compute[74189]: node.session.err_timeo.abort_timeout = 15
Oct 25 21:26:35 user nova-compute[74189]: node.session.err_timeo.lu_reset_timeout = 30
Oct 25 21:26:35 user nova-compute[74189]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 25 21:26:35 user nova-compute[74189]: node.session.err_timeo.host_reset_timeout = 60
Oct 25 21:26:35 user nova-compute[74189]: node.session.iscsi.FastAbort = Yes
Oct 25 21:26:35 user nova-compute[74189]: node.session.iscsi.InitialR2T = No
Oct 25 21:26:35 user nova-compute[74189]: node.session.iscsi.ImmediateData = Yes
Oct 25 21:26:35 user nova-compute[74189]: node.session.iscsi.FirstBurstLength = 262144
Oct 25 21:26:35 user nova-compute[74189]: node.session.iscsi.MaxBurstLength = 16776192
Oct 25 21:26:35 user nova-compute[74189]: node.session.iscsi.DefaultTime2Retain = 0
Oct 25 21:26:35 user nova-compute[74189]: node.session.iscsi.DefaultTime2Wait = 2
Oct 25 21:26:35 user nova-compute[74189]: node.session.iscsi.MaxConnections = 1
Oct 25 21:26:35 user nova-compute[74189]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 25 21:26:35 user nova-compute[74189]: node.session.iscsi.ERL = 0
Oct 25 21:26:35 user nova-compute[74189]: node.session.scan = manual
Oct 25 21:26:35 user nova-compute[74189]: node.session.reopen_max = 0
Oct 25 21:26:35 user nova-compute[74189]: node.conn[0].address = 172.16.0.220
Oct 25 21:26:35 user nova-compute[74189]: node.conn[0].port = 3260
Oct 25 21:26:35 user nova-compute[74189]: node.conn[0].startup = manual
Oct 25 21:26:35 user nova-compute[74189]: node.conn[0].tcp.window_size = 524288
Oct 25 21:26:35 user nova-compute[74189]: node.conn[0].tcp.type_of_service = 0
Oct 25 21:26:35 user nova-compute[74189]: node.conn[0].timeo.logout_timeout = 15
Oct 25 21:26:35 user nova-compute[74189]: node.conn[0].timeo.login_timeout = 15
Oct 25 21:26:35 user nova-compute[74189]: node.conn[0].timeo.auth_timeout = 45
Oct 25 21:26:35 user nova-compute[74189]: node.conn[0].timeo.noop_out_interval = 5
Oct 25 21:26:35 user nova-compute[74189]: node.conn[0].timeo.noop_out_timeout = 5
Oct 25 21:26:35 user nova-compute[74189]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 25 21:26:35 user nova-compute[74189]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 25 21:26:35 user nova-compute[74189]: node.conn[0].iscsi.HeaderDigest = None
Oct 25 21:26:35 user nova-compute[74189]: node.conn[0].iscsi.DataDigest = None
Oct 25 21:26:35 user nova-compute[74189]: node.conn[0].iscsi.IFMarker = No
Oct 25 21:26:35 user nova-compute[74189]: node.conn[0].iscsi.OFMarker = No
Oct 25 21:26:35 user nova-compute[74189]: # END RECORD
Oct 25 21:26:35 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd95f3d-eaef-41e8-8ca2-ef2cb57a7a17]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[06969c58-b780-411e-b641-0e22018ae0b2]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ojGqQAgJ {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ojGqQAgJ" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b1b119-6e22-4147-8a9f-96d63123b308]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ojGqQAgJ'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[db223143-bb61-47ae-8bb4-a6d2aa23d826]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cb1bdf-35b7-477a-ae51-c7befc39fbdb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:26:35 user nova-compute[74189]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:26:35 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:26:35 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:26:35 user nova-compute[74189]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:26:35 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:26:35 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.193s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] HCTL ('35', '0', '0', 0) found on session 27 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab805fe-47ab-43a4-be9f-d9f664ff6b21]: (4, ('0 0 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Searching for a device in session 27 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ojGqQAgJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.220s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] <== connect_volume: return (222ms) {'type': 'block', 'scsi_wwn': '26262333732336332', 'path': '/dev/sdd'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262333732336332', 'path': '/dev/sdd'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1061125685',display_name='tempest-ServerStableDeviceRescueTest-server-1061125685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1061125685',id=19,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC20gTviyjNJBjxArKToE8AgxJM88oQS6J0/B2LSO3z48gSESlt2Qa5Ij29DDLKcOPNYWCIhOLQrsgZVfD03v7gd4V+2bdXXxGL2qgyJABqFDgeQggV88dXUclIdYhAD0g==',key_name='tempest-keypair-1832175527',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:22:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='046417147a924afdbc8b72333c362261',ramdisk_id='',reservation_id='r-wm74eoqy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1979035755',owner_user_name='tempest-ServerStableDeviceRescueTest-1979035755-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:24:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e2a4908113594f96adeab0b362046568',uuid=75071d8a-2ce2-43b5-99f6-23853399dc97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54123e00-9921-4807-b1f7-79073453a82f", "address": "fa:16:3e:02:6a:1d", "network": {"id": "3159e1a7-f60f-4768-9e06-a92287d19dd6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-119288589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-119288589-network", "vif_mac": "fa:16:3e:02:6a:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046417147a924afdbc8b72333c362261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54123e00-99", "ovs_interfaceid": "54123e00-9921-4807-b1f7-79073453a82f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Converting VIF {"id": "54123e00-9921-4807-b1f7-79073453a82f", "address": "fa:16:3e:02:6a:1d", "network": {"id": "3159e1a7-f60f-4768-9e06-a92287d19dd6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-119288589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-119288589-network", "vif_mac": "fa:16:3e:02:6a:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046417147a924afdbc8b72333c362261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54123e00-99", "ovs_interfaceid": "54123e00-9921-4807-b1f7-79073453a82f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:6a:1d,bridge_name='br-int',has_traffic_filtering=True,id=54123e00-9921-4807-b1f7-79073453a82f,network=Network(3159e1a7-f60f-4768-9e06-a92287d19dd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54123e00-99') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG nova.objects.instance [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lazy-loading 'pci_devices' on Instance uuid 75071d8a-2ce2-43b5-99f6-23853399dc97 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG nova.objects.base [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Object Instance<75071d8a-2ce2-43b5-99f6-23853399dc97> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:26:35 user nova-compute[74189]:   <uuid>75071d8a-2ce2-43b5-99f6-23853399dc97</uuid>
Oct 25 21:26:35 user nova-compute[74189]:   <name>instance-00000013</name>
Oct 25 21:26:35 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:26:35 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:26:35 user nova-compute[74189]:   <metadata>
Oct 25 21:26:35 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:26:35 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:26:35 user nova-compute[74189]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1061125685</nova:name>
Oct 25 21:26:35 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:26:34</nova:creationTime>
Oct 25 21:26:35 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:26:35 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:26:35 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:26:35 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:26:35 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:26:35 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:26:35 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:26:35 user nova-compute[74189]:       <nova:owner>
Oct 25 21:26:35 user nova-compute[74189]:         <nova:user uuid="e2a4908113594f96adeab0b362046568">tempest-ServerStableDeviceRescueTest-1979035755-project-member</nova:user>
Oct 25 21:26:35 user nova-compute[74189]:         <nova:project uuid="046417147a924afdbc8b72333c362261">tempest-ServerStableDeviceRescueTest-1979035755</nova:project>
Oct 25 21:26:35 user nova-compute[74189]:       </nova:owner>
Oct 25 21:26:35 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:26:35 user nova-compute[74189]:       <nova:ports>
Oct 25 21:26:35 user nova-compute[74189]:         <nova:port uuid="54123e00-9921-4807-b1f7-79073453a82f">
Oct 25 21:26:35 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 25 21:26:35 user nova-compute[74189]:         </nova:port>
Oct 25 21:26:35 user nova-compute[74189]:       </nova:ports>
Oct 25 21:26:35 user nova-compute[74189]:     </nova:instance>
Oct 25 21:26:35 user nova-compute[74189]:   </metadata>
Oct 25 21:26:35 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:26:35 user nova-compute[74189]:     <system>
Oct 25 21:26:35 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:26:35 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:26:35 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:26:35 user nova-compute[74189]:       <entry name="serial">75071d8a-2ce2-43b5-99f6-23853399dc97</entry>
Oct 25 21:26:35 user nova-compute[74189]:       <entry name="uuid">75071d8a-2ce2-43b5-99f6-23853399dc97</entry>
Oct 25 21:26:35 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:26:35 user nova-compute[74189]:     </system>
Oct 25 21:26:35 user nova-compute[74189]:   </sysinfo>
Oct 25 21:26:35 user nova-compute[74189]:   <os>
Oct 25 21:26:35 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:26:35 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:26:35 user nova-compute[74189]:   </os>
Oct 25 21:26:35 user nova-compute[74189]:   <features>
Oct 25 21:26:35 user nova-compute[74189]:     <acpi/>
Oct 25 21:26:35 user nova-compute[74189]:     <apic/>
Oct 25 21:26:35 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:26:35 user nova-compute[74189]:   </features>
Oct 25 21:26:35 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:26:35 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:26:35 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:26:35 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:26:35 user nova-compute[74189]:   </clock>
Oct 25 21:26:35 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:26:35 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:26:35 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:26:35 user nova-compute[74189]:   </cpu>
Oct 25 21:26:35 user nova-compute[74189]:   <devices>
Oct 25 21:26:35 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:26:35 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:26:35 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk"/>
Oct 25 21:26:35 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:26:35 user nova-compute[74189]:     </disk>
Oct 25 21:26:35 user nova-compute[74189]:     <disk type="block" device="disk">
Oct 25 21:26:35 user nova-compute[74189]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:26:35 user nova-compute[74189]:       <source dev="/dev/sdd"/>
Oct 25 21:26:35 user nova-compute[74189]:       <target dev="vdb" bus="virtio"/>
Oct 25 21:26:35 user nova-compute[74189]:       <serial>4f257f0f-5b89-4c0f-8120-b1b725384c6a</serial>
Oct 25 21:26:35 user nova-compute[74189]:     </disk>
Oct 25 21:26:35 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:26:35 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:26:35 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk.rescue"/>
Oct 25 21:26:35 user nova-compute[74189]:       <target dev="vdc" bus="virtio"/>
Oct 25 21:26:35 user nova-compute[74189]:       <boot order="1"/>
Oct 25 21:26:35 user nova-compute[74189]:     </disk>
Oct 25 21:26:35 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:26:35 user nova-compute[74189]:       <mac address="fa:16:3e:02:6a:1d"/>
Oct 25 21:26:35 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:26:35 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:26:35 user nova-compute[74189]:       <target dev="tap54123e00-99"/>
Oct 25 21:26:35 user nova-compute[74189]:     </interface>
Oct 25 21:26:35 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:26:35 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/console.log" append="off"/>
Oct 25 21:26:35 user nova-compute[74189]:     </serial>
Oct 25 21:26:35 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:26:35 user nova-compute[74189]:     <video>
Oct 25 21:26:35 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:26:35 user nova-compute[74189]:     </video>
Oct 25 21:26:35 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:26:35 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:26:35 user nova-compute[74189]:     </rng>
Oct 25 21:26:35 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:26:35 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:26:35 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:26:35 user nova-compute[74189]:     </memballoon>
Oct 25 21:26:35 user nova-compute[74189]:   </devices>
Oct 25 21:26:35 user nova-compute[74189]: </domain>
Oct 25 21:26:35 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:26:35 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Instance destroyed successfully.
Oct 25 21:26:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] No VIF found with MAC fa:16:3e:02:6a:1d, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:26:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:36 user nova-compute[74189]: DEBUG nova.compute.manager [req-7e0bf754-fe6f-4c90-9ddb-5102b6e656be req-f7e2b135-27f9-4244-a394-a62b44fbc2f4 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Received event network-vif-plugged-54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:26:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7e0bf754-fe6f-4c90-9ddb-5102b6e656be req-f7e2b135-27f9-4244-a394-a62b44fbc2f4 service nova] Acquiring lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:26:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7e0bf754-fe6f-4c90-9ddb-5102b6e656be req-f7e2b135-27f9-4244-a394-a62b44fbc2f4 service nova] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:26:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7e0bf754-fe6f-4c90-9ddb-5102b6e656be req-f7e2b135-27f9-4244-a394-a62b44fbc2f4 service nova] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:26:36 user nova-compute[74189]: DEBUG nova.compute.manager [req-7e0bf754-fe6f-4c90-9ddb-5102b6e656be req-f7e2b135-27f9-4244-a394-a62b44fbc2f4 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] No waiting events found dispatching network-vif-plugged-54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:26:36 user nova-compute[74189]: WARNING nova.compute.manager [req-7e0bf754-fe6f-4c90-9ddb-5102b6e656be req-f7e2b135-27f9-4244-a394-a62b44fbc2f4 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Received unexpected event network-vif-plugged-54123e00-9921-4807-b1f7-79073453a82f for instance with vm_state active and task_state rescuing.
Oct 25 21:26:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:39 user nova-compute[74189]: DEBUG nova.compute.manager [req-6b4b2f34-e309-43ae-989b-2a9c7631c85a req-35cd7f22-5f4e-402a-b9a7-b07c572688c8 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Received event network-vif-plugged-54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:26:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-6b4b2f34-e309-43ae-989b-2a9c7631c85a req-35cd7f22-5f4e-402a-b9a7-b07c572688c8 service nova] Acquiring lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:26:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-6b4b2f34-e309-43ae-989b-2a9c7631c85a req-35cd7f22-5f4e-402a-b9a7-b07c572688c8 service nova] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:26:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-6b4b2f34-e309-43ae-989b-2a9c7631c85a req-35cd7f22-5f4e-402a-b9a7-b07c572688c8 service nova] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:26:39 user nova-compute[74189]: DEBUG nova.compute.manager [req-6b4b2f34-e309-43ae-989b-2a9c7631c85a req-35cd7f22-5f4e-402a-b9a7-b07c572688c8 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] No waiting events found dispatching network-vif-plugged-54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:26:39 user nova-compute[74189]: WARNING nova.compute.manager [req-6b4b2f34-e309-43ae-989b-2a9c7631c85a req-35cd7f22-5f4e-402a-b9a7-b07c572688c8 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Received unexpected event network-vif-plugged-54123e00-9921-4807-b1f7-79073453a82f for instance with vm_state active and task_state rescuing.
Oct 25 21:26:39 user nova-compute[74189]: DEBUG nova.compute.manager [None req-903a11d0-798c-4162-9758-6ac35b66c8ae tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:26:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:51 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:52 user nova-compute[74189]: DEBUG nova.compute.manager [req-c5509650-c8f7-4913-ac88-31e920a91e43 req-f5daf75e-5083-4f25-ad96-a382ffaa76c0 service nova] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Received event network-changed-b3fce63c-7b53-4a74-ad26-0e547a9643a0 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:26:52 user nova-compute[74189]: DEBUG nova.compute.manager [req-c5509650-c8f7-4913-ac88-31e920a91e43 req-f5daf75e-5083-4f25-ad96-a382ffaa76c0 service nova] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Refreshing instance network info cache due to event network-changed-b3fce63c-7b53-4a74-ad26-0e547a9643a0. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:26:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c5509650-c8f7-4913-ac88-31e920a91e43 req-f5daf75e-5083-4f25-ad96-a382ffaa76c0 service nova] Acquiring lock "refresh_cache-f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:26:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c5509650-c8f7-4913-ac88-31e920a91e43 req-f5daf75e-5083-4f25-ad96-a382ffaa76c0 service nova] Acquired lock "refresh_cache-f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:26:52 user nova-compute[74189]: DEBUG nova.network.neutron [req-c5509650-c8f7-4913-ac88-31e920a91e43 req-f5daf75e-5083-4f25-ad96-a382ffaa76c0 service nova] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Refreshing network info cache for port b3fce63c-7b53-4a74-ad26-0e547a9643a0 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:26:53 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:53 user nova-compute[74189]: DEBUG nova.network.neutron [req-c5509650-c8f7-4913-ac88-31e920a91e43 req-f5daf75e-5083-4f25-ad96-a382ffaa76c0 service nova] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Updated VIF entry in instance network info cache for port b3fce63c-7b53-4a74-ad26-0e547a9643a0. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:26:53 user nova-compute[74189]: DEBUG nova.network.neutron [req-c5509650-c8f7-4913-ac88-31e920a91e43 req-f5daf75e-5083-4f25-ad96-a382ffaa76c0 service nova] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Updating instance_info_cache with network_info: [{"id": "b3fce63c-7b53-4a74-ad26-0e547a9643a0", "address": "fa:16:3e:27:ed:f4", "network": {"id": "a10206fb-faee-4e14-9b44-b5e9274f7c92", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-96164946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fc56f5ca1b142d199c360c89d552569", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fce63c-7b", "ovs_interfaceid": "b3fce63c-7b53-4a74-ad26-0e547a9643a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:26:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c5509650-c8f7-4913-ac88-31e920a91e43 req-f5daf75e-5083-4f25-ad96-a382ffaa76c0 service nova] Releasing lock "refresh_cache-f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:26:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Acquiring lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:26:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:26:56 user nova-compute[74189]: DEBUG nova.compute.manager [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:26:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "cdb13b8f-c136-4f2b-95b9-e464babac28a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:26:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "cdb13b8f-c136-4f2b-95b9-e464babac28a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:26:56 user nova-compute[74189]: DEBUG nova.compute.manager [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:26:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:26:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:26:56 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:26:56 user nova-compute[74189]: INFO nova.compute.claims [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Claim successful on node user
Oct 25 21:26:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:26:57 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Refreshing inventories for resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 21:26:57 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Updating ProviderTree inventory for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 21:26:57 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Updating inventory in ProviderTree for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 21:26:57 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Refreshing aggregate associations for resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc, aggregates: None {{(pid=74189) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 21:26:57 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Refreshing trait associations for resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING {{(pid=74189) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 21:26:57 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:26:57 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:26:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.590s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:26:57 user nova-compute[74189]: DEBUG nova.compute.manager [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:26:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.572s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:26:57 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:26:57 user nova-compute[74189]: INFO nova.compute.claims [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Claim successful on node user
Oct 25 21:26:57 user nova-compute[74189]: DEBUG nova.compute.manager [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:26:57 user nova-compute[74189]: DEBUG nova.network.neutron [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:26:57 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:26:57 user nova-compute[74189]: DEBUG nova.compute.manager [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:26:57 user nova-compute[74189]: DEBUG nova.policy [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0a958107c53f4eeb832f6040969c8a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef48aafc7b54ce5aeda52b0b52f2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:26:57 user nova-compute[74189]: INFO nova.virt.block_device [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Booting with volume e76a8bc1-8695-4085-874e-c1575956d75e at /dev/vda
Oct 25 21:26:57 user nova-compute[74189]: DEBUG os_brick.utils [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:26:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd28514-0128-4ba6-8bf8-615a51025048]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c48bf1-c87b-495c-8974-ea57b8e85e81]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88ff152-3490-4a0e-97a4-00e30c8c323f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4643f7c8-737a-4044-b196-9459e80c1f27]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:26:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:26:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:26:57 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:26:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bb0b26-d871-4049-bdd4-7a60a7f068e8]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:26:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:26:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:26:57 user nova-compute[74189]: DEBUG os_brick.utils [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:26:57 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Updating existing volume attachment record: 32e71e5a-9077-4890-94d8-af52d044f132 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:26:58 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:26:58 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:26:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.601s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:26:58 user nova-compute[74189]: DEBUG nova.compute.manager [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:26:58 user nova-compute[74189]: DEBUG nova.compute.manager [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:26:58 user nova-compute[74189]: DEBUG nova.network.neutron [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:26:58 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:26:58 user nova-compute[74189]: DEBUG nova.compute.manager [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:26:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:26:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "9a15fb16-8623-4a20-ae26-5f0aab29ec07" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:26:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "9a15fb16-8623-4a20-ae26-5f0aab29ec07" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:26:58 user nova-compute[74189]: DEBUG nova.policy [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a829dcf4095d45ab868a0ea904e9bfce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1339c959b4cbebeefd550fc436c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:26:58 user nova-compute[74189]: DEBUG nova.compute.manager [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:26:58 user nova-compute[74189]: DEBUG nova.compute.manager [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:26:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:26:58 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Creating image(s)
Oct 25 21:26:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "/opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:26:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "/opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:26:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "/opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:26:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "585e49721907e895ad71a4154c3a8aefaef1f6e2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:26:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "585e49721907e895ad71a4154c3a8aefaef1f6e2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:26:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:26:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:26:58 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:26:58 user nova-compute[74189]: INFO nova.compute.claims [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Claim successful on node user
Oct 25 21:26:58 user nova-compute[74189]: DEBUG nova.network.neutron [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Successfully created port: 1d25f7eb-3650-4049-a6b9-4fe9ff701593 {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:26:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/585e49721907e895ad71a4154c3a8aefaef1f6e2.part --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG nova.network.neutron [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Successfully created port: 6a146bba-178b-4b17-be10-0410392d8b06 {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/585e49721907e895ad71a4154c3a8aefaef1f6e2.part --force-share --output=json" returned: 0 in 0.207s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG nova.virt.images [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] aa2b6cc1-286b-43bf-b15c-d93296dcd109 was qcow2, converting to raw {{(pid=74189) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG nova.privsep.utils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74189) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/585e49721907e895ad71a4154c3a8aefaef1f6e2.part /opt/stack/data/nova/instances/_base/585e49721907e895ad71a4154c3a8aefaef1f6e2.converted {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Acquiring lock "f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Lock "f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG nova.objects.instance [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Lazy-loading 'flavor' on Instance uuid f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Lock "f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.107s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/585e49721907e895ad71a4154c3a8aefaef1f6e2.part /opt/stack/data/nova/instances/_base/585e49721907e895ad71a4154c3a8aefaef1f6e2.converted" returned: 0 in 0.216s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/585e49721907e895ad71a4154c3a8aefaef1f6e2.converted --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG nova.network.neutron [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Successfully updated port: 1d25f7eb-3650-4049-a6b9-4fe9ff701593 {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-f82469cc-dcc7-423b-b445-60edf7f7cf77 req-edd68cbb-b22d-45eb-b6ac-8f96a984b64a service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Received event network-changed-1d25f7eb-3650-4049-a6b9-4fe9ff701593 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-f82469cc-dcc7-423b-b445-60edf7f7cf77 req-edd68cbb-b22d-45eb-b6ac-8f96a984b64a service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Refreshing instance network info cache due to event network-changed-1d25f7eb-3650-4049-a6b9-4fe9ff701593. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f82469cc-dcc7-423b-b445-60edf7f7cf77 req-edd68cbb-b22d-45eb-b6ac-8f96a984b64a service nova] Acquiring lock "refresh_cache-d6e14e1a-6ef7-4a47-afc7-096326de8f5e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f82469cc-dcc7-423b-b445-60edf7f7cf77 req-edd68cbb-b22d-45eb-b6ac-8f96a984b64a service nova] Acquired lock "refresh_cache-d6e14e1a-6ef7-4a47-afc7-096326de8f5e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG nova.network.neutron [req-f82469cc-dcc7-423b-b445-60edf7f7cf77 req-edd68cbb-b22d-45eb-b6ac-8f96a984b64a service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Refreshing network info cache for port 1d25f7eb-3650-4049-a6b9-4fe9ff701593 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Acquiring lock "refresh_cache-d6e14e1a-6ef7-4a47-afc7-096326de8f5e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG nova.network.neutron [req-f82469cc-dcc7-423b-b445-60edf7f7cf77 req-edd68cbb-b22d-45eb-b6ac-8f96a984b64a service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Acquiring lock "f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Lock "f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:26:59 user nova-compute[74189]: INFO nova.compute.manager [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Attaching volume de583eee-b9f9-4e9b-9c71-1530de4e111e to /dev/vdb
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/585e49721907e895ad71a4154c3a8aefaef1f6e2.converted --force-share --output=json" returned: 0 in 0.195s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "585e49721907e895ad71a4154c3a8aefaef1f6e2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.159s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/585e49721907e895ad71a4154c3a8aefaef1f6e2 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG os_brick.utils [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40434c6-1eb6-4d0d-98b0-34d658335833]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28d67ca-d40a-4556-9bd6-0e81d5f3ec2d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8754a3d-95c9-4c8b-9f9e-020a8ac683b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc67dcc2-815e-481d-bd69-55e053458d54]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG nova.network.neutron [req-f82469cc-dcc7-423b-b445-60edf7f7cf77 req-edd68cbb-b22d-45eb-b6ac-8f96a984b64a service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.323s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG nova.compute.manager [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f82469cc-dcc7-423b-b445-60edf7f7cf77 req-edd68cbb-b22d-45eb-b6ac-8f96a984b64a service nova] Releasing lock "refresh_cache-d6e14e1a-6ef7-4a47-afc7-096326de8f5e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Acquired lock "refresh_cache-d6e14e1a-6ef7-4a47-afc7-096326de8f5e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG nova.network.neutron [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/585e49721907e895ad71a4154c3a8aefaef1f6e2 --force-share --output=json" returned: 0 in 0.212s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "585e49721907e895ad71a4154c3a8aefaef1f6e2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "585e49721907e895ad71a4154c3a8aefaef1f6e2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/585e49721907e895ad71a4154c3a8aefaef1f6e2 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:26:59 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:26:59 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d8d84f-c291-41cf-9b9f-30795385c4ae]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG os_brick.utils [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] <== get_connector_properties: return (241ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Updating existing volume attachment record: eed6ad5b-dd8e-4a16-945b-39972a76b0d0 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG nova.compute.manager [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG nova.network.neutron [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:26:59 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:26:59 user nova-compute[74189]: DEBUG nova.compute.manager [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:26:59 user nova-compute[74189]: DEBUG nova.network.neutron [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.policy [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '77a27a7ebb4a458097c901871c378bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e893e8f3f58e4e15920d313b6391682c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:27:00 user nova-compute[74189]: INFO nova.virt.block_device [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Booting with volume 03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d at /dev/vda
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/585e49721907e895ad71a4154c3a8aefaef1f6e2 --force-share --output=json" returned: 0 in 0.226s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/585e49721907e895ad71a4154c3a8aefaef1f6e2,backing_fmt=raw /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/585e49721907e895ad71a4154c3a8aefaef1f6e2,backing_fmt=raw /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk 1073741824" returned: 0 in 0.074s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "585e49721907e895ad71a4154c3a8aefaef1f6e2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.304s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/585e49721907e895ad71a4154c3a8aefaef1f6e2 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.network.neutron [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Successfully updated port: 6a146bba-178b-4b17-be10-0410392d8b06 {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "refresh_cache-cdb13b8f-c136-4f2b-95b9-e464babac28a" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquired lock "refresh_cache-cdb13b8f-c136-4f2b-95b9-e464babac28a" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.network.neutron [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.compute.manager [req-f14c477f-5ddc-4e9a-bb97-81103cd26382 req-5c0788fc-595e-464c-ad2a-cbf00b73984e service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Received event network-changed-6a146bba-178b-4b17-be10-0410392d8b06 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.compute.manager [req-f14c477f-5ddc-4e9a-bb97-81103cd26382 req-5c0788fc-595e-464c-ad2a-cbf00b73984e service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Refreshing instance network info cache due to event network-changed-6a146bba-178b-4b17-be10-0410392d8b06. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f14c477f-5ddc-4e9a-bb97-81103cd26382 req-5c0788fc-595e-464c-ad2a-cbf00b73984e service nova] Acquiring lock "refresh_cache-cdb13b8f-c136-4f2b-95b9-e464babac28a" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG os_brick.utils [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a5a64c-ac23-46cd-a4bb-19a00b05a3e3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.network.neutron [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ece2834-e540-45c3-9b9e-be842da7e3bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.network.neutron [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Updating instance_info_cache with network_info: [{"id": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "address": "fa:16:3e:58:36:23", "network": {"id": "1fce8fb6-f20e-4de3-80ec-3d74154c0e23", "bridge": "br-int", "label": "tempest-TestShelveInstance-1146708282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef48aafc7b54ce5aeda52b0b52f2714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d25f7eb-36", "ovs_interfaceid": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9b01c7-7330-41a6-aa38-7686ae120c73]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17b5cfa-0635-4298-9791-b823e5a1e9cc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fdd9d269-0d59-494f-866d-9983bc9b6231 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "680e134e-5e0d-464f-9e30-460010348795" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fdd9d269-0d59-494f-866d-9983bc9b6231 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "680e134e-5e0d-464f-9e30-460010348795" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fdd9d269-0d59-494f-866d-9983bc9b6231 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "680e134e-5e0d-464f-9e30-460010348795-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fdd9d269-0d59-494f-866d-9983bc9b6231 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "680e134e-5e0d-464f-9e30-460010348795-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fdd9d269-0d59-494f-866d-9983bc9b6231 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "680e134e-5e0d-464f-9e30-460010348795-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Releasing lock "refresh_cache-d6e14e1a-6ef7-4a47-afc7-096326de8f5e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.compute.manager [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Instance network_info: |[{"id": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "address": "fa:16:3e:58:36:23", "network": {"id": "1fce8fb6-f20e-4de3-80ec-3d74154c0e23", "bridge": "br-int", "label": "tempest-TestShelveInstance-1146708282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef48aafc7b54ce5aeda52b0b52f2714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d25f7eb-36", "ovs_interfaceid": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/585e49721907e895ad71a4154c3a8aefaef1f6e2 --force-share --output=json" returned: 0 in 0.288s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:00 user nova-compute[74189]: INFO nova.compute.manager [None req-fdd9d269-0d59-494f-866d-9983bc9b6231 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Terminating instance
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.compute.manager [None req-fdd9d269-0d59-494f-866d-9983bc9b6231 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:27:00 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40f6e72-c5a9-42bf-8f5b-76fe796d51f9]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG os_brick.utils [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] <== get_connector_properties: return (199ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Updating existing volume attachment record: 8d9e8562-c892-480e-96c0-2b59c2e7d10a {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Cannot resize image /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Ensure instance console log exists: /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.network.neutron [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Updating instance_info_cache with network_info: [{"id": "6a146bba-178b-4b17-be10-0410392d8b06", "address": "fa:16:3e:7f:d7:49", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a146bba-17", "ovs_interfaceid": "6a146bba-178b-4b17-be10-0410392d8b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Releasing lock "refresh_cache-cdb13b8f-c136-4f2b-95b9-e464babac28a" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.compute.manager [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Instance network_info: |[{"id": "6a146bba-178b-4b17-be10-0410392d8b06", "address": "fa:16:3e:7f:d7:49", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a146bba-17", "ovs_interfaceid": "6a146bba-178b-4b17-be10-0410392d8b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f14c477f-5ddc-4e9a-bb97-81103cd26382 req-5c0788fc-595e-464c-ad2a-cbf00b73984e service nova] Acquired lock "refresh_cache-cdb13b8f-c136-4f2b-95b9-e464babac28a" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.network.neutron [req-f14c477f-5ddc-4e9a-bb97-81103cd26382 req-5c0788fc-595e-464c-ad2a-cbf00b73984e service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Refreshing network info cache for port 6a146bba-178b-4b17-be10-0410392d8b06 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Start _get_guest_xml network_info=[{"id": "6a146bba-178b-4b17-be10-0410392d8b06", "address": "fa:16:3e:7f:d7:49", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a146bba-17", "ovs_interfaceid": "6a146bba-178b-4b17-be10-0410392d8b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:26:53Z,direct_url=<?>,disk_format='qcow2',id=aa2b6cc1-286b-43bf-b15c-d93296dcd109,min_disk=0,min_ram=0,name='tempest-scenario-img--755122702',owner='3ee1339c959b4cbebeefd550fc436c61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:26:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': 'aa2b6cc1-286b-43bf-b15c-d93296dcd109'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:27:00 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:27:00 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:26:53Z,direct_url=<?>,disk_format='qcow2',id=aa2b6cc1-286b-43bf-b15c-d93296dcd109,min_disk=0,min_ram=0,name='tempest-scenario-img--755122702',owner='3ee1339c959b4cbebeefd550fc436c61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:26:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:26:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-203509859',display_name='tempest-TestMinimumBasicScenario-server-203509859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-203509859',id=26,image_ref='aa2b6cc1-286b-43bf-b15c-d93296dcd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4z0OWc1huBv+7er3wDTCce5Gzj47ISPUaomWnov/1ylLmTYrJ3U3snYabzU/u51yiodhiArIMzrX6ZmmAOGafBpcWVPHiXEEAfzqGtBPL3XnJzz4AaxgWLjIB8rVfOCg==',key_name='tempest-TestMinimumBasicScenario-2109189230',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ee1339c959b4cbebeefd550fc436c61',ramdisk_id='',reservation_id='r-vdjf4bu6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa2b6cc1-286b-43bf-b15c-d93296dcd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1857244532',owner_user_name='tempest-TestMinimumBasicScenario-1857244532-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:26:58Z,user_data=None,user_id='a829dcf4095d45ab868a0ea904e9bfce',uuid=cdb13b8f-c136-4f2b-95b9-e464babac28a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a146bba-178b-4b17-be10-0410392d8b06", "address": "fa:16:3e:7f:d7:49", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a146bba-17", "ovs_interfaceid": "6a146bba-178b-4b17-be10-0410392d8b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Converting VIF {"id": "6a146bba-178b-4b17-be10-0410392d8b06", "address": "fa:16:3e:7f:d7:49", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a146bba-17", "ovs_interfaceid": "6a146bba-178b-4b17-be10-0410392d8b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:d7:49,bridge_name='br-int',has_traffic_filtering=True,id=6a146bba-178b-4b17-be10-0410392d8b06,network=Network(d0eb2495-d624-4f66-91a4-2d97b9461a19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a146bba-17') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.objects.instance [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lazy-loading 'pci_devices' on Instance uuid cdb13b8f-c136-4f2b-95b9-e464babac28a {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.network.neutron [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Successfully created port: 99d99cc1-710e-41b6-8239-79f4dbc9183a {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:27:00 user nova-compute[74189]:   <uuid>cdb13b8f-c136-4f2b-95b9-e464babac28a</uuid>
Oct 25 21:27:00 user nova-compute[74189]:   <name>instance-0000001a</name>
Oct 25 21:27:00 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:27:00 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:27:00 user nova-compute[74189]:   <metadata>
Oct 25 21:27:00 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:27:00 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:27:00 user nova-compute[74189]:       <nova:name>tempest-TestMinimumBasicScenario-server-203509859</nova:name>
Oct 25 21:27:00 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:27:00</nova:creationTime>
Oct 25 21:27:00 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:27:00 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:27:00 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:27:00 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:27:00 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:27:00 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:27:00 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:27:00 user nova-compute[74189]:       <nova:owner>
Oct 25 21:27:00 user nova-compute[74189]:         <nova:user uuid="a829dcf4095d45ab868a0ea904e9bfce">tempest-TestMinimumBasicScenario-1857244532-project-member</nova:user>
Oct 25 21:27:00 user nova-compute[74189]:         <nova:project uuid="3ee1339c959b4cbebeefd550fc436c61">tempest-TestMinimumBasicScenario-1857244532</nova:project>
Oct 25 21:27:00 user nova-compute[74189]:       </nova:owner>
Oct 25 21:27:00 user nova-compute[74189]:       <nova:root type="image" uuid="aa2b6cc1-286b-43bf-b15c-d93296dcd109"/>
Oct 25 21:27:00 user nova-compute[74189]:       <nova:ports>
Oct 25 21:27:00 user nova-compute[74189]:         <nova:port uuid="6a146bba-178b-4b17-be10-0410392d8b06">
Oct 25 21:27:00 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 25 21:27:00 user nova-compute[74189]:         </nova:port>
Oct 25 21:27:00 user nova-compute[74189]:       </nova:ports>
Oct 25 21:27:00 user nova-compute[74189]:     </nova:instance>
Oct 25 21:27:00 user nova-compute[74189]:   </metadata>
Oct 25 21:27:00 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:27:00 user nova-compute[74189]:     <system>
Oct 25 21:27:00 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:27:00 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:27:00 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:27:00 user nova-compute[74189]:       <entry name="serial">cdb13b8f-c136-4f2b-95b9-e464babac28a</entry>
Oct 25 21:27:00 user nova-compute[74189]:       <entry name="uuid">cdb13b8f-c136-4f2b-95b9-e464babac28a</entry>
Oct 25 21:27:00 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:27:00 user nova-compute[74189]:     </system>
Oct 25 21:27:00 user nova-compute[74189]:   </sysinfo>
Oct 25 21:27:00 user nova-compute[74189]:   <os>
Oct 25 21:27:00 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:27:00 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:27:00 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:27:00 user nova-compute[74189]:   </os>
Oct 25 21:27:00 user nova-compute[74189]:   <features>
Oct 25 21:27:00 user nova-compute[74189]:     <acpi/>
Oct 25 21:27:00 user nova-compute[74189]:     <apic/>
Oct 25 21:27:00 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:27:00 user nova-compute[74189]:   </features>
Oct 25 21:27:00 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:27:00 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:27:00 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:27:00 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:27:00 user nova-compute[74189]:   </clock>
Oct 25 21:27:00 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:27:00 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:27:00 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:27:00 user nova-compute[74189]:   </cpu>
Oct 25 21:27:00 user nova-compute[74189]:   <devices>
Oct 25 21:27:00 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:27:00 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:27:00 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk"/>
Oct 25 21:27:00 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:27:00 user nova-compute[74189]:     </disk>
Oct 25 21:27:00 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:27:00 user nova-compute[74189]:       <mac address="fa:16:3e:7f:d7:49"/>
Oct 25 21:27:00 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:27:00 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:27:00 user nova-compute[74189]:       <target dev="tap6a146bba-17"/>
Oct 25 21:27:00 user nova-compute[74189]:     </interface>
Oct 25 21:27:00 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:27:00 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/console.log" append="off"/>
Oct 25 21:27:00 user nova-compute[74189]:     </serial>
Oct 25 21:27:00 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:27:00 user nova-compute[74189]:     <video>
Oct 25 21:27:00 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:27:00 user nova-compute[74189]:     </video>
Oct 25 21:27:00 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:27:00 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:27:00 user nova-compute[74189]:     </rng>
Oct 25 21:27:00 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:27:00 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:27:00 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:27:00 user nova-compute[74189]:     </memballoon>
Oct 25 21:27:00 user nova-compute[74189]:   </devices>
Oct 25 21:27:00 user nova-compute[74189]: </domain>
Oct 25 21:27:00 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:26:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-203509859',display_name='tempest-TestMinimumBasicScenario-server-203509859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-203509859',id=26,image_ref='aa2b6cc1-286b-43bf-b15c-d93296dcd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4z0OWc1huBv+7er3wDTCce5Gzj47ISPUaomWnov/1ylLmTYrJ3U3snYabzU/u51yiodhiArIMzrX6ZmmAOGafBpcWVPHiXEEAfzqGtBPL3XnJzz4AaxgWLjIB8rVfOCg==',key_name='tempest-TestMinimumBasicScenario-2109189230',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ee1339c959b4cbebeefd550fc436c61',ramdisk_id='',reservation_id='r-vdjf4bu6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa2b6cc1-286b-43bf-b15c-d93296dcd109',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1857244532',owner_user_name='tempest-TestMinimumBasicScenario-1857244532-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:26:58Z,user_data=None,user_id='a829dcf4095d45ab868a0ea904e9bfce',uuid=cdb13b8f-c136-4f2b-95b9-e464babac28a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a146bba-178b-4b17-be10-0410392d8b06", "address": "fa:16:3e:7f:d7:49", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a146bba-17", "ovs_interfaceid": "6a146bba-178b-4b17-be10-0410392d8b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Converting VIF {"id": "6a146bba-178b-4b17-be10-0410392d8b06", "address": "fa:16:3e:7f:d7:49", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a146bba-17", "ovs_interfaceid": "6a146bba-178b-4b17-be10-0410392d8b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:d7:49,bridge_name='br-int',has_traffic_filtering=True,id=6a146bba-178b-4b17-be10-0410392d8b06,network=Network(d0eb2495-d624-4f66-91a4-2d97b9461a19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a146bba-17') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG os_vif [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:d7:49,bridge_name='br-int',has_traffic_filtering=True,id=6a146bba-178b-4b17-be10-0410392d8b06,network=Network(d0eb2495-d624-4f66-91a4-2d97b9461a19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a146bba-17') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ff0e20ed-a4bf-574f-a8b7-befb2fb9afd8', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:27:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a146bba-17, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:27:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a146bba-17, col_values=(('qos', UUID('b4b59741-5ce5-4802-a440-599bf3bb7b36')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:27:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a146bba-17, col_values=(('external_ids', {'iface-id': '6a146bba-178b-4b17-be10-0410392d8b06', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:d7:49', 'vm-uuid': 'cdb13b8f-c136-4f2b-95b9-e464babac28a'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:27:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:27:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:01 user nova-compute[74189]: INFO os_vif [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:d7:49,bridge_name='br-int',has_traffic_filtering=True,id=6a146bba-178b-4b17-be10-0410392d8b06,network=Network(d0eb2495-d624-4f66-91a4-2d97b9461a19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a146bba-17')
Oct 25 21:27:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:27:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] No VIF found with MAC fa:16:3e:7f:d7:49, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:27:01 user nova-compute[74189]: DEBUG nova.network.neutron [req-f14c477f-5ddc-4e9a-bb97-81103cd26382 req-5c0788fc-595e-464c-ad2a-cbf00b73984e service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Updated VIF entry in instance network info cache for port 6a146bba-178b-4b17-be10-0410392d8b06. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:27:01 user nova-compute[74189]: DEBUG nova.network.neutron [req-f14c477f-5ddc-4e9a-bb97-81103cd26382 req-5c0788fc-595e-464c-ad2a-cbf00b73984e service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Updating instance_info_cache with network_info: [{"id": "6a146bba-178b-4b17-be10-0410392d8b06", "address": "fa:16:3e:7f:d7:49", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a146bba-17", "ovs_interfaceid": "6a146bba-178b-4b17-be10-0410392d8b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:27:01 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 680e134e-5e0d-464f-9e30-460010348795] Instance destroyed successfully.
Oct 25 21:27:01 user nova-compute[74189]: DEBUG nova.objects.instance [None req-fdd9d269-0d59-494f-866d-9983bc9b6231 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lazy-loading 'resources' on Instance uuid 680e134e-5e0d-464f-9e30-460010348795 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:27:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f14c477f-5ddc-4e9a-bb97-81103cd26382 req-5c0788fc-595e-464c-ad2a-cbf00b73984e service nova] Releasing lock "refresh_cache-cdb13b8f-c136-4f2b-95b9-e464babac28a" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:27:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-fdd9d269-0d59-494f-866d-9983bc9b6231 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:21:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1656701919',display_name='tempest-AttachVolumeNegativeTest-server-1656701919',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1656701919',id=16,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZADoVdjAPdniZ9l1cLdzDlzqU7uPibv2D8hZ950ZNhbevYe/TwT2kBxZJzDgqXzaQwRBq2gxzbSIRRpmP9G1//QYPdGcaaIEP+v5+OP4OH7E6GuC6Dxx+ydlAVXrRbbA==',key_name='tempest-keypair-1430001064',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:21:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a555d708aa644d586d5edad7db837b4',ramdisk_id='',reservation_id='r-r0390wd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-979681322',owner_user_name='tempest-AttachVolumeNegativeTest-979681322-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:21:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2f19a398fd9486fbef04eebad62a0cb',uuid=680e134e-5e0d-464f-9e30-460010348795,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41682423-a7e4-44c2-9936-24fe7a965bf9", "address": "fa:16:3e:a3:82:56", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41682423-a7", "ovs_interfaceid": "41682423-a7e4-44c2-9936-24fe7a965bf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:27:01 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-fdd9d269-0d59-494f-866d-9983bc9b6231 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Converting VIF {"id": "41682423-a7e4-44c2-9936-24fe7a965bf9", "address": "fa:16:3e:a3:82:56", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41682423-a7", "ovs_interfaceid": "41682423-a7e4-44c2-9936-24fe7a965bf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:27:01 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-fdd9d269-0d59-494f-866d-9983bc9b6231 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:82:56,bridge_name='br-int',has_traffic_filtering=True,id=41682423-a7e4-44c2-9936-24fe7a965bf9,network=Network(5029031b-e67b-4f60-bc17-781cbdc88b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41682423-a7') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:27:01 user nova-compute[74189]: DEBUG os_vif [None req-fdd9d269-0d59-494f-866d-9983bc9b6231 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:82:56,bridge_name='br-int',has_traffic_filtering=True,id=41682423-a7e4-44c2-9936-24fe7a965bf9,network=Network(5029031b-e67b-4f60-bc17-781cbdc88b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41682423-a7') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:27:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41682423-a7, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:27:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:27:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1267250b-42c9-4650-a6cd-2f594e73e514) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:27:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:27:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:01 user nova-compute[74189]: INFO os_vif [None req-fdd9d269-0d59-494f-866d-9983bc9b6231 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:82:56,bridge_name='br-int',has_traffic_filtering=True,id=41682423-a7e4-44c2-9936-24fe7a965bf9,network=Network(5029031b-e67b-4f60-bc17-781cbdc88b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41682423-a7')
Oct 25 21:27:01 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-fdd9d269-0d59-494f-866d-9983bc9b6231 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Deleting instance files /opt/stack/data/nova/instances/680e134e-5e0d-464f-9e30-460010348795_del
Oct 25 21:27:01 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-fdd9d269-0d59-494f-866d-9983bc9b6231 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Deletion of /opt/stack/data/nova/instances/680e134e-5e0d-464f-9e30-460010348795_del complete
Oct 25 21:27:01 user nova-compute[74189]: INFO nova.compute.manager [None req-fdd9d269-0d59-494f-866d-9983bc9b6231 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: 680e134e-5e0d-464f-9e30-460010348795] Took 1.32 seconds to destroy the instance on the hypervisor.
Oct 25 21:27:01 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-fdd9d269-0d59-494f-866d-9983bc9b6231 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:27:01 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: 680e134e-5e0d-464f-9e30-460010348795] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:27:01 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 680e134e-5e0d-464f-9e30-460010348795] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:27:02 user nova-compute[74189]: DEBUG nova.network.neutron [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Successfully updated port: 99d99cc1-710e-41b6-8239-79f4dbc9183a {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:27:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "refresh_cache-9a15fb16-8623-4a20-ae26-5f0aab29ec07" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:27:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquired lock "refresh_cache-9a15fb16-8623-4a20-ae26-5f0aab29ec07" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:27:02 user nova-compute[74189]: DEBUG nova.network.neutron [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:27:02 user nova-compute[74189]: DEBUG nova.network.neutron [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:27:02 user nova-compute[74189]: DEBUG nova.compute.manager [req-1d70cd7b-4e5a-4a4b-9b08-236375602660 req-5e2b24c8-71ec-4221-9ec2-ecd3254f57cf service nova] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Received event network-changed-99d99cc1-710e-41b6-8239-79f4dbc9183a {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:27:02 user nova-compute[74189]: DEBUG nova.compute.manager [req-1d70cd7b-4e5a-4a4b-9b08-236375602660 req-5e2b24c8-71ec-4221-9ec2-ecd3254f57cf service nova] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Refreshing instance network info cache due to event network-changed-99d99cc1-710e-41b6-8239-79f4dbc9183a. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:27:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1d70cd7b-4e5a-4a4b-9b08-236375602660 req-5e2b24c8-71ec-4221-9ec2-ecd3254f57cf service nova] Acquiring lock "refresh_cache-9a15fb16-8623-4a20-ae26-5f0aab29ec07" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:27:02 user nova-compute[74189]: DEBUG nova.compute.manager [req-eb37e62a-bf1f-4e35-9e17-6d34454294e7 req-60dd7856-1303-4425-bb34-8076e3a4b155 service nova] [instance: 680e134e-5e0d-464f-9e30-460010348795] Received event network-vif-unplugged-41682423-a7e4-44c2-9936-24fe7a965bf9 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:27:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-eb37e62a-bf1f-4e35-9e17-6d34454294e7 req-60dd7856-1303-4425-bb34-8076e3a4b155 service nova] Acquiring lock "680e134e-5e0d-464f-9e30-460010348795-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-eb37e62a-bf1f-4e35-9e17-6d34454294e7 req-60dd7856-1303-4425-bb34-8076e3a4b155 service nova] Lock "680e134e-5e0d-464f-9e30-460010348795-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-eb37e62a-bf1f-4e35-9e17-6d34454294e7 req-60dd7856-1303-4425-bb34-8076e3a4b155 service nova] Lock "680e134e-5e0d-464f-9e30-460010348795-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:02 user nova-compute[74189]: DEBUG nova.compute.manager [req-eb37e62a-bf1f-4e35-9e17-6d34454294e7 req-60dd7856-1303-4425-bb34-8076e3a4b155 service nova] [instance: 680e134e-5e0d-464f-9e30-460010348795] No waiting events found dispatching network-vif-unplugged-41682423-a7e4-44c2-9936-24fe7a965bf9 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:27:02 user nova-compute[74189]: DEBUG nova.compute.manager [req-eb37e62a-bf1f-4e35-9e17-6d34454294e7 req-60dd7856-1303-4425-bb34-8076e3a4b155 service nova] [instance: 680e134e-5e0d-464f-9e30-460010348795] Received event network-vif-unplugged-41682423-a7e4-44c2-9936-24fe7a965bf9 for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:27:02 user nova-compute[74189]: DEBUG nova.compute.manager [req-eb37e62a-bf1f-4e35-9e17-6d34454294e7 req-60dd7856-1303-4425-bb34-8076e3a4b155 service nova] [instance: 680e134e-5e0d-464f-9e30-460010348795] Received event network-vif-plugged-41682423-a7e4-44c2-9936-24fe7a965bf9 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:27:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-eb37e62a-bf1f-4e35-9e17-6d34454294e7 req-60dd7856-1303-4425-bb34-8076e3a4b155 service nova] Acquiring lock "680e134e-5e0d-464f-9e30-460010348795-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-eb37e62a-bf1f-4e35-9e17-6d34454294e7 req-60dd7856-1303-4425-bb34-8076e3a4b155 service nova] Lock "680e134e-5e0d-464f-9e30-460010348795-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-eb37e62a-bf1f-4e35-9e17-6d34454294e7 req-60dd7856-1303-4425-bb34-8076e3a4b155 service nova] Lock "680e134e-5e0d-464f-9e30-460010348795-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:02 user nova-compute[74189]: DEBUG nova.compute.manager [req-eb37e62a-bf1f-4e35-9e17-6d34454294e7 req-60dd7856-1303-4425-bb34-8076e3a4b155 service nova] [instance: 680e134e-5e0d-464f-9e30-460010348795] No waiting events found dispatching network-vif-plugged-41682423-a7e4-44c2-9936-24fe7a965bf9 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:27:02 user nova-compute[74189]: WARNING nova.compute.manager [req-eb37e62a-bf1f-4e35-9e17-6d34454294e7 req-60dd7856-1303-4425-bb34-8076e3a4b155 service nova] [instance: 680e134e-5e0d-464f-9e30-460010348795] Received unexpected event network-vif-plugged-41682423-a7e4-44c2-9936-24fe7a965bf9 for instance with vm_state active and task_state deleting.
Oct 25 21:27:02 user nova-compute[74189]: DEBUG nova.network.neutron [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Updating instance_info_cache with network_info: [{"id": "99d99cc1-710e-41b6-8239-79f4dbc9183a", "address": "fa:16:3e:09:c7:d1", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d99cc1-71", "ovs_interfaceid": "99d99cc1-710e-41b6-8239-79f4dbc9183a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:27:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Releasing lock "refresh_cache-9a15fb16-8623-4a20-ae26-5f0aab29ec07" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:27:02 user nova-compute[74189]: DEBUG nova.compute.manager [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Instance network_info: |[{"id": "99d99cc1-710e-41b6-8239-79f4dbc9183a", "address": "fa:16:3e:09:c7:d1", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d99cc1-71", "ovs_interfaceid": "99d99cc1-710e-41b6-8239-79f4dbc9183a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:27:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1d70cd7b-4e5a-4a4b-9b08-236375602660 req-5e2b24c8-71ec-4221-9ec2-ecd3254f57cf service nova] Acquired lock "refresh_cache-9a15fb16-8623-4a20-ae26-5f0aab29ec07" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:27:02 user nova-compute[74189]: DEBUG nova.network.neutron [req-1d70cd7b-4e5a-4a4b-9b08-236375602660 req-5e2b24c8-71ec-4221-9ec2-ecd3254f57cf service nova] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Refreshing network info cache for port 99d99cc1-710e-41b6-8239-79f4dbc9183a {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:27:02 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 680e134e-5e0d-464f-9e30-460010348795] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:27:02 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: 680e134e-5e0d-464f-9e30-460010348795] Took 0.86 seconds to deallocate network for instance.
Oct 25 21:27:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fdd9d269-0d59-494f-866d-9983bc9b6231 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fdd9d269-0d59-494f-866d-9983bc9b6231 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:02 user nova-compute[74189]: DEBUG nova.compute.manager [req-ee398f45-877d-4382-95c0-cc14048e32f3 req-781836ee-3446-4dbe-bb9c-ccc75ac47c65 service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Received event network-vif-plugged-6a146bba-178b-4b17-be10-0410392d8b06 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:27:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ee398f45-877d-4382-95c0-cc14048e32f3 req-781836ee-3446-4dbe-bb9c-ccc75ac47c65 service nova] Acquiring lock "cdb13b8f-c136-4f2b-95b9-e464babac28a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ee398f45-877d-4382-95c0-cc14048e32f3 req-781836ee-3446-4dbe-bb9c-ccc75ac47c65 service nova] Lock "cdb13b8f-c136-4f2b-95b9-e464babac28a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ee398f45-877d-4382-95c0-cc14048e32f3 req-781836ee-3446-4dbe-bb9c-ccc75ac47c65 service nova] Lock "cdb13b8f-c136-4f2b-95b9-e464babac28a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:02 user nova-compute[74189]: DEBUG nova.compute.manager [req-ee398f45-877d-4382-95c0-cc14048e32f3 req-781836ee-3446-4dbe-bb9c-ccc75ac47c65 service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] No waiting events found dispatching network-vif-plugged-6a146bba-178b-4b17-be10-0410392d8b06 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:27:02 user nova-compute[74189]: WARNING nova.compute.manager [req-ee398f45-877d-4382-95c0-cc14048e32f3 req-781836ee-3446-4dbe-bb9c-ccc75ac47c65 service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Received unexpected event network-vif-plugged-6a146bba-178b-4b17-be10-0410392d8b06 for instance with vm_state building and task_state spawning.
Oct 25 21:27:03 user nova-compute[74189]: DEBUG nova.network.neutron [req-1d70cd7b-4e5a-4a4b-9b08-236375602660 req-5e2b24c8-71ec-4221-9ec2-ecd3254f57cf service nova] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Updated VIF entry in instance network info cache for port 99d99cc1-710e-41b6-8239-79f4dbc9183a. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:27:03 user nova-compute[74189]: DEBUG nova.network.neutron [req-1d70cd7b-4e5a-4a4b-9b08-236375602660 req-5e2b24c8-71ec-4221-9ec2-ecd3254f57cf service nova] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Updating instance_info_cache with network_info: [{"id": "99d99cc1-710e-41b6-8239-79f4dbc9183a", "address": "fa:16:3e:09:c7:d1", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d99cc1-71", "ovs_interfaceid": "99d99cc1-710e-41b6-8239-79f4dbc9183a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:27:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1d70cd7b-4e5a-4a4b-9b08-236375602660 req-5e2b24c8-71ec-4221-9ec2-ecd3254f57cf service nova] Releasing lock "refresh_cache-9a15fb16-8623-4a20-ae26-5f0aab29ec07" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:27:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:03 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-fdd9d269-0d59-494f-866d-9983bc9b6231 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:27:03 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-fdd9d269-0d59-494f-866d-9983bc9b6231 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:27:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fdd9d269-0d59-494f-866d-9983bc9b6231 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.671s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:03 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-fdd9d269-0d59-494f-866d-9983bc9b6231 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Deleted allocations for instance 680e134e-5e0d-464f-9e30-460010348795
Oct 25 21:27:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fdd9d269-0d59-494f-866d-9983bc9b6231 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "680e134e-5e0d-464f-9e30-460010348795" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.197s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:04 user nova-compute[74189]: DEBUG nova.compute.manager [req-f6ab6eeb-64af-4892-becf-56dd97cffee3 req-d9f2d633-0b2f-4a57-9f7c-e7a935cf0e4e service nova] [instance: 680e134e-5e0d-464f-9e30-460010348795] Received event network-vif-deleted-41682423-a7e4-44c2-9936-24fe7a965bf9 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:27:04 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:27:04 user nova-compute[74189]: DEBUG nova.compute.manager [req-7c0a54e5-8d63-4ecd-955e-cd8fec9533f2 req-498be59f-029d-45f5-ba66-69af9df88064 service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Received event network-vif-plugged-6a146bba-178b-4b17-be10-0410392d8b06 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:27:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7c0a54e5-8d63-4ecd-955e-cd8fec9533f2 req-498be59f-029d-45f5-ba66-69af9df88064 service nova] Acquiring lock "cdb13b8f-c136-4f2b-95b9-e464babac28a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7c0a54e5-8d63-4ecd-955e-cd8fec9533f2 req-498be59f-029d-45f5-ba66-69af9df88064 service nova] Lock "cdb13b8f-c136-4f2b-95b9-e464babac28a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7c0a54e5-8d63-4ecd-955e-cd8fec9533f2 req-498be59f-029d-45f5-ba66-69af9df88064 service nova] Lock "cdb13b8f-c136-4f2b-95b9-e464babac28a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:04 user nova-compute[74189]: DEBUG nova.compute.manager [req-7c0a54e5-8d63-4ecd-955e-cd8fec9533f2 req-498be59f-029d-45f5-ba66-69af9df88064 service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] No waiting events found dispatching network-vif-plugged-6a146bba-178b-4b17-be10-0410392d8b06 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:27:04 user nova-compute[74189]: WARNING nova.compute.manager [req-7c0a54e5-8d63-4ecd-955e-cd8fec9533f2 req-498be59f-029d-45f5-ba66-69af9df88064 service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Received unexpected event network-vif-plugged-6a146bba-178b-4b17-be10-0410392d8b06 for instance with vm_state building and task_state spawning.
Oct 25 21:27:05 user nova-compute[74189]: DEBUG nova.compute.manager [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:27:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:27:05 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Instance spawned successfully.
Oct 25 21:27:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:27:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:27:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:27:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:27:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:27:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:27:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:27:05 user nova-compute[74189]: INFO nova.compute.manager [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Took 7.03 seconds to spawn the instance on the hypervisor.
Oct 25 21:27:05 user nova-compute[74189]: DEBUG nova.compute.manager [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:27:05 user nova-compute[74189]: INFO nova.compute.manager [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Took 8.61 seconds to build instance.
Oct 25 21:27:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3297c8e6-a627-4898-bf81-1e0bb05d7144 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "cdb13b8f-c136-4f2b-95b9-e464babac28a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.742s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:06 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:27:06 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:27:06 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:27:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-932fe8ac-fdde-45c6-aa32-9bf866f19a4e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:27:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-932fe8ac-fdde-45c6-aa32-9bf866f19a4e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:27:06 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:27:07 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Updating instance_info_cache with network_info: [{"id": "8eb6e9e2-60c6-463d-8525-b768933a94df", "address": "fa:16:3e:e8:de:d0", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb6e9e2-60", "ovs_interfaceid": "8eb6e9e2-60c6-463d-8525-b768933a94df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:27:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-932fe8ac-fdde-45c6-aa32-9bf866f19a4e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:27:07 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:27:07 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:27:07 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:27:07 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:27:07 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:27:07 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:27:07 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:27:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:07 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:27:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:27:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:10 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:27:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk.rescue --force-share --output=json" returned: 0 in 0.237s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:11 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:27:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:11 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:13 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:27:13 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:27:13 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=7458MB free_disk=24.961830139160156GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:27:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:13 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance d7c3a99a-ab38-4e88-896d-94ae51a09a48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:27:13 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance af1d7b3c-9950-4b74-8f15-b31011ccfa24 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:27:13 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance de6b6789-b328-4c3b-8d24-07774d5dbe6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:27:13 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 932fe8ac-fdde-45c6-aa32-9bf866f19a4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:27:13 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 75071d8a-2ce2-43b5-99f6-23853399dc97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:27:13 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 0b4f80c4-98cc-440a-aac7-cd423b71a231 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:27:13 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:27:13 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance a57b1185-270e-40d0-a55e-986960826169 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:27:13 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 7eff6940-9675-4c89-bd28-378a5db4369f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:27:13 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance cdb13b8f-c136-4f2b-95b9-e464babac28a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:27:13 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance d6e14e1a-6ef7-4a47-afc7-096326de8f5e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:27:13 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 9a15fb16-8623-4a20-ae26-5f0aab29ec07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:27:13 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:27:13 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:27:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:13 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:27:13 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:27:13 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:27:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.638s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:14 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:27:14 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:27:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:17 user nova-compute[74189]: DEBUG nova.compute.manager [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:27:17 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:27:17 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Creating image(s)
Oct 25 21:27:17 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Did not create local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 21:27:17 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Ensure instance console log exists: /opt/stack/data/nova/instances/d6e14e1a-6ef7-4a47-afc7-096326de8f5e/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:27:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:17 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Start _get_guest_xml network_info=[{"id": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "address": "fa:16:3e:58:36:23", "network": {"id": "1fce8fb6-f20e-4de3-80ec-3d74154c0e23", "bridge": "br-int", "label": "tempest-TestShelveInstance-1146708282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef48aafc7b54ce5aeda52b0b52f2714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d25f7eb-36", "ovs_interfaceid": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bBkaEFvy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd6e14e1a-6ef7-4a47-afc7-096326de8f5e', 'attached_at': '', 'detached_at': '', 'volume_id': 'e76a8bc1-8695-4085-874e-c1575956d75e', 'serial': 'e76a8bc1-8695-4085-874e-c1575956d75e'}, 'attachment_id': '32e71e5a-9077-4890-94d8-af52d044f132', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:27:17 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:27:17 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:27:17 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:27:17 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:27:17 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:27:17 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:27:17 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:27:17 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:27:17 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:27:17 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:27:17 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:27:17 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:27:17 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:27:17 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:27:17 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:27:17 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:27:17 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:27:17 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:27:17 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:27:17 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bBkaEFvy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:27:17 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:27:17 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:27:17 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:27:17 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:27:17 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:27:17 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:27:17 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:27:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:17 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b96c77-4272-41e3-8612-17736b46c075]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:17 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:27:17 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[627a1d5b-0c6d-41d1-8184-ae3e46a916e6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e] added
Oct 25 21:27:18 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed30354-50fc-4007-a56a-d46f2ad9b5fd]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.044s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[97447a0c-f856-4d76-a53b-028e7ddef3e2]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bBkaEFvy {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bBkaEFvy" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51629cf-faf3-497d-8b55-ed6729167b82]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bBkaEFvy'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb1ebcc-c8b3-4da1-bd58-be0c0f2adac2]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c837b2-1305-488f-9e30-ed0627bbc3f2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:27:18 user nova-compute[74189]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:27:18 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:27:18 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:27:18 user nova-compute[74189]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:27:18 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:27:18 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8493a16-a522-4eaa-864b-5401d314a56d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e, portal: 172.16.0.220,3260]
Oct 25 21:27:18 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e, portal: 172.16.0.220,3260] successful.
Oct 25 21:27:18 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f4b6e7-06ac-41e1-8f76-2f11c522e82d]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0c3481-b769-428d-9463-81ef71d73d9e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:27:18 user nova-compute[74189]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:27:18 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:27:18 user nova-compute[74189]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:27:18 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:27:18 user nova-compute[74189]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:27:18 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:27:18 user nova-compute[74189]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:27:18 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e043c9-17a7-458b-8772-ce7a26893aac]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:18 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: None {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bBkaEFvy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23839613763323633', 'path': '/dev/sde'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839613763323633', 'path': '/dev/sde'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:26:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1213251010',display_name='tempest-TestShelveInstance-server-1213251010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1213251010',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNqUIHf3I8RhYrvivy/tUrkctgg0VuWe78qUcgCaXcqN8tRyHKb0x17tdtbNu6jPaS71Or0GKwjH1tiyjOQJpFf+EUe1BDFHzAeH5wwreHNU2pAmWFu7FPqZaEfm+f0xA==',key_name='tempest-TestShelveInstance-290074196',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ef48aafc7b54ce5aeda52b0b52f2714',ramdisk_id='',reservation_id='r-fduvh40c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-715930903',owner_user_name='tempest-TestShelveInstance-715930903-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:26:58Z,user_data=None,user_id='0a958107c53f4eeb832f6040969c8a24',uuid=d6e14e1a-6ef7-4a47-afc7-096326de8f5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "address": "fa:16:3e:58:36:23", "network": {"id": "1fce8fb6-f20e-4de3-80ec-3d74154c0e23", "bridge": "br-int", "label": "tempest-TestShelveInstance-1146708282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef48aafc7b54ce5aeda52b0b52f2714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d25f7eb-36", "ovs_interfaceid": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Converting VIF {"id": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "address": "fa:16:3e:58:36:23", "network": {"id": "1fce8fb6-f20e-4de3-80ec-3d74154c0e23", "bridge": "br-int", "label": "tempest-TestShelveInstance-1146708282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef48aafc7b54ce5aeda52b0b52f2714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d25f7eb-36", "ovs_interfaceid": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:36:23,bridge_name='br-int',has_traffic_filtering=True,id=1d25f7eb-3650-4049-a6b9-4fe9ff701593,network=Network(1fce8fb6-f20e-4de3-80ec-3d74154c0e23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d25f7eb-36') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG nova.objects.instance [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lazy-loading 'pci_devices' on Instance uuid d6e14e1a-6ef7-4a47-afc7-096326de8f5e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:27:19 user nova-compute[74189]:   <uuid>d6e14e1a-6ef7-4a47-afc7-096326de8f5e</uuid>
Oct 25 21:27:19 user nova-compute[74189]:   <name>instance-0000001b</name>
Oct 25 21:27:19 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:27:19 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:27:19 user nova-compute[74189]:   <metadata>
Oct 25 21:27:19 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:27:19 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:27:19 user nova-compute[74189]:       <nova:name>tempest-TestShelveInstance-server-1213251010</nova:name>
Oct 25 21:27:19 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:27:17</nova:creationTime>
Oct 25 21:27:19 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:27:19 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:27:19 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:27:19 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:27:19 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:27:19 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:27:19 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:27:19 user nova-compute[74189]:       <nova:owner>
Oct 25 21:27:19 user nova-compute[74189]:         <nova:user uuid="0a958107c53f4eeb832f6040969c8a24">tempest-TestShelveInstance-715930903-project-member</nova:user>
Oct 25 21:27:19 user nova-compute[74189]:         <nova:project uuid="9ef48aafc7b54ce5aeda52b0b52f2714">tempest-TestShelveInstance-715930903</nova:project>
Oct 25 21:27:19 user nova-compute[74189]:       </nova:owner>
Oct 25 21:27:19 user nova-compute[74189]:       <nova:ports>
Oct 25 21:27:19 user nova-compute[74189]:         <nova:port uuid="1d25f7eb-3650-4049-a6b9-4fe9ff701593">
Oct 25 21:27:19 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 25 21:27:19 user nova-compute[74189]:         </nova:port>
Oct 25 21:27:19 user nova-compute[74189]:       </nova:ports>
Oct 25 21:27:19 user nova-compute[74189]:     </nova:instance>
Oct 25 21:27:19 user nova-compute[74189]:   </metadata>
Oct 25 21:27:19 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:27:19 user nova-compute[74189]:     <system>
Oct 25 21:27:19 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:27:19 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:27:19 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:27:19 user nova-compute[74189]:       <entry name="serial">d6e14e1a-6ef7-4a47-afc7-096326de8f5e</entry>
Oct 25 21:27:19 user nova-compute[74189]:       <entry name="uuid">d6e14e1a-6ef7-4a47-afc7-096326de8f5e</entry>
Oct 25 21:27:19 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:27:19 user nova-compute[74189]:     </system>
Oct 25 21:27:19 user nova-compute[74189]:   </sysinfo>
Oct 25 21:27:19 user nova-compute[74189]:   <os>
Oct 25 21:27:19 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:27:19 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:27:19 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:27:19 user nova-compute[74189]:   </os>
Oct 25 21:27:19 user nova-compute[74189]:   <features>
Oct 25 21:27:19 user nova-compute[74189]:     <acpi/>
Oct 25 21:27:19 user nova-compute[74189]:     <apic/>
Oct 25 21:27:19 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:27:19 user nova-compute[74189]:   </features>
Oct 25 21:27:19 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:27:19 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:27:19 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:27:19 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:27:19 user nova-compute[74189]:   </clock>
Oct 25 21:27:19 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:27:19 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:27:19 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:27:19 user nova-compute[74189]:   </cpu>
Oct 25 21:27:19 user nova-compute[74189]:   <devices>
Oct 25 21:27:19 user nova-compute[74189]:     <disk type="block" device="disk">
Oct 25 21:27:19 user nova-compute[74189]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:27:19 user nova-compute[74189]:       <source dev="/dev/sde"/>
Oct 25 21:27:19 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:27:19 user nova-compute[74189]:       <serial>e76a8bc1-8695-4085-874e-c1575956d75e</serial>
Oct 25 21:27:19 user nova-compute[74189]:     </disk>
Oct 25 21:27:19 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:27:19 user nova-compute[74189]:       <mac address="fa:16:3e:58:36:23"/>
Oct 25 21:27:19 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:27:19 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:27:19 user nova-compute[74189]:       <target dev="tap1d25f7eb-36"/>
Oct 25 21:27:19 user nova-compute[74189]:     </interface>
Oct 25 21:27:19 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:27:19 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/d6e14e1a-6ef7-4a47-afc7-096326de8f5e/console.log" append="off"/>
Oct 25 21:27:19 user nova-compute[74189]:     </serial>
Oct 25 21:27:19 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:27:19 user nova-compute[74189]:     <video>
Oct 25 21:27:19 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:27:19 user nova-compute[74189]:     </video>
Oct 25 21:27:19 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:27:19 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:27:19 user nova-compute[74189]:     </rng>
Oct 25 21:27:19 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:27:19 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:27:19 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:27:19 user nova-compute[74189]:     </memballoon>
Oct 25 21:27:19 user nova-compute[74189]:   </devices>
Oct 25 21:27:19 user nova-compute[74189]: </domain>
Oct 25 21:27:19 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:26:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1213251010',display_name='tempest-TestShelveInstance-server-1213251010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1213251010',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNqUIHf3I8RhYrvivy/tUrkctgg0VuWe78qUcgCaXcqN8tRyHKb0x17tdtbNu6jPaS71Or0GKwjH1tiyjOQJpFf+EUe1BDFHzAeH5wwreHNU2pAmWFu7FPqZaEfm+f0xA==',key_name='tempest-TestShelveInstance-290074196',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ef48aafc7b54ce5aeda52b0b52f2714',ramdisk_id='',reservation_id='r-fduvh40c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-715930903',owner_user_name='tempest-TestShelveInstance-715930903-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:26:58Z,user_data=None,user_id='0a958107c53f4eeb832f6040969c8a24',uuid=d6e14e1a-6ef7-4a47-afc7-096326de8f5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "address": "fa:16:3e:58:36:23", "network": {"id": "1fce8fb6-f20e-4de3-80ec-3d74154c0e23", "bridge": "br-int", "label": "tempest-TestShelveInstance-1146708282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef48aafc7b54ce5aeda52b0b52f2714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d25f7eb-36", "ovs_interfaceid": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Converting VIF {"id": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "address": "fa:16:3e:58:36:23", "network": {"id": "1fce8fb6-f20e-4de3-80ec-3d74154c0e23", "bridge": "br-int", "label": "tempest-TestShelveInstance-1146708282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef48aafc7b54ce5aeda52b0b52f2714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d25f7eb-36", "ovs_interfaceid": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:36:23,bridge_name='br-int',has_traffic_filtering=True,id=1d25f7eb-3650-4049-a6b9-4fe9ff701593,network=Network(1fce8fb6-f20e-4de3-80ec-3d74154c0e23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d25f7eb-36') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG os_vif [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:36:23,bridge_name='br-int',has_traffic_filtering=True,id=1d25f7eb-3650-4049-a6b9-4fe9ff701593,network=Network(1fce8fb6-f20e-4de3-80ec-3d74154c0e23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d25f7eb-36') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15cdcb3c-3c7b-5d08-9b36-ca58a448e49f', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d25f7eb-36, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d25f7eb-36, col_values=(('qos', UUID('7aab7493-7896-4a66-9384-6c6eb5b6d994')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d25f7eb-36, col_values=(('external_ids', {'iface-id': '1d25f7eb-3650-4049-a6b9-4fe9ff701593', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:36:23', 'vm-uuid': 'd6e14e1a-6ef7-4a47-afc7-096326de8f5e'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:19 user nova-compute[74189]: INFO os_vif [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:36:23,bridge_name='br-int',has_traffic_filtering=True,id=1d25f7eb-3650-4049-a6b9-4fe9ff701593,network=Network(1fce8fb6-f20e-4de3-80ec-3d74154c0e23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d25f7eb-36')
Oct 25 21:27:19 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] No VIF found with MAC fa:16:3e:58:36:23, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRaXIMsg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:27:19 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:27:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:27:19 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:27:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:27:19 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:27:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f747bbd5-8c1b-449b-af94-55a7706714c0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:27:19 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ea415f-7696-43c0-b7b0-6eb380686284]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e] added
Oct 25 21:27:19 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[22637c14-f377-413b-879b-c03975b4b961]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae92384a-50f7-4615-99ba-bda0786d2539]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oRaXIMsg {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oRaXIMsg" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad1422c-1e8a-47a5-b9f6-acb4e8cbf23d]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oRaXIMsg'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6da24d-cc07-44a5-babc-ff6b2e3a04ec]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3025537-df08-4695-8986-6815cf593bd2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:27:19 user nova-compute[74189]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:27:19 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:27:19 user nova-compute[74189]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:27:19 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:27:19 user nova-compute[74189]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:27:19 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:27:19 user nova-compute[74189]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:27:19 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6300bed-6c68-481b-8ff9-baee4b53f205]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e, portal: 172.16.0.220,3260]
Oct 25 21:27:19 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e, portal: 172.16.0.220,3260] successful.
Oct 25 21:27:19 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac34641a-7d07-4ea7-8778-e37873264f3a]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de106c4-9485-4ba2-aaf4-7535af901fde]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:27:19 user nova-compute[74189]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:27:19 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:27:19 user nova-compute[74189]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:27:19 user nova-compute[74189]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e (non-flash)
Oct 25 21:27:19 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:27:19 user nova-compute[74189]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:27:19 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:27:19 user nova-compute[74189]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:27:19 user nova-compute[74189]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e (non-flash)
Oct 25 21:27:19 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] HCTL ('37', '-', '-', 0) found on session 29 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[203098a6-6666-4836-b8c8-fb2b453a9b5f]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Searching for a device in session 29 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:27:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRaXIMsg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG nova.compute.manager [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:27:20 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Creating image(s)
Oct 25 21:27:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Did not create local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Ensure instance console log exists: /opt/stack/data/nova/instances/9a15fb16-8623-4a20-ae26-5f0aab29ec07/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Start _get_guest_xml network_info=[{"id": "99d99cc1-710e-41b6-8239-79f4dbc9183a", "address": "fa:16:3e:09:c7:d1", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d99cc1-71", "ovs_interfaceid": "99d99cc1-710e-41b6-8239-79f4dbc9183a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KcyRfFoi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9a15fb16-8623-4a20-ae26-5f0aab29ec07', 'attached_at': '', 'detached_at': '', 'volume_id': '03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d', 'serial': '03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d'}, 'attachment_id': '8d9e8562-c892-480e-96c0-2b59c2e7d10a', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:27:20 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:27:20 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:27:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KcyRfFoi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:27:20 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:27:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26661343163326437', 'path': '/dev/sdf'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661343163326437', 'path': '/dev/sdf'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.090s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:27:20 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:27:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:27:20 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:27:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG nova.objects.instance [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Lazy-loading 'flavor' on Instance uuid f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb59085-d05c-4355-b914-bf80e44c4a90]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:27:20 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG nova.compute.manager [req-17139980-a97c-4ced-962b-51f567ab1157 req-732b85c8-dfb5-4d0d-9020-a1743e42d8ff service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Received event network-vif-plugged-1d25f7eb-3650-4049-a6b9-4fe9ff701593 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-17139980-a97c-4ced-962b-51f567ab1157 req-732b85c8-dfb5-4d0d-9020-a1743e42d8ff service nova] Acquiring lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-17139980-a97c-4ced-962b-51f567ab1157 req-732b85c8-dfb5-4d0d-9020-a1743e42d8ff service nova] Lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-17139980-a97c-4ced-962b-51f567ab1157 req-732b85c8-dfb5-4d0d-9020-a1743e42d8ff service nova] Lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG nova.compute.manager [req-17139980-a97c-4ced-962b-51f567ab1157 req-732b85c8-dfb5-4d0d-9020-a1743e42d8ff service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] No waiting events found dispatching network-vif-plugged-1d25f7eb-3650-4049-a6b9-4fe9ff701593 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:27:21 user nova-compute[74189]: WARNING nova.compute.manager [req-17139980-a97c-4ced-962b-51f567ab1157 req-732b85c8-dfb5-4d0d-9020-a1743e42d8ff service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Received unexpected event network-vif-plugged-1d25f7eb-3650-4049-a6b9-4fe9ff701593 for instance with vm_state building and task_state spawning.
Oct 25 21:27:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 21:27:21 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:27:21 user nova-compute[74189]:   <source dev="/dev/sdf"/>
Oct 25 21:27:21 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:27:21 user nova-compute[74189]:   <serial>de583eee-b9f9-4e9b-9c71-1530de4e111e</serial>
Oct 25 21:27:21 user nova-compute[74189]: </disk>
Oct 25 21:27:21 user nova-compute[74189]:  {{(pid=74189) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef11ded-c00e-4ab7-a40b-4ce0d76320aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d] added
Oct 25 21:27:21 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[89aeb4d8-68c8-4d33-a164-d558d24b4209]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffaa14e-6809-4b4c-a40e-32ec43f7d618]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KcyRfFoi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KcyRfFoi" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[331989fb-cea6-4ac8-9e6e-2fe2956a6f76]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KcyRfFoi'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb66e379-5519-46a5-a48b-99496d3edb9e]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf0b97c-d870-4adb-8267-ae4b0adf6d5b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:27:21 user nova-compute[74189]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:27:21 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:27:21 user nova-compute[74189]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:27:21 user nova-compute[74189]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e (non-flash)
Oct 25 21:27:21 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:27:21 user nova-compute[74189]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:27:21 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:27:21 user nova-compute[74189]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:27:21 user nova-compute[74189]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e (non-flash)
Oct 25 21:27:21 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4e5e1e-9013-4f1c-b959-a6835fd35400]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d, portal: 172.16.0.220,3260]
Oct 25 21:27:21 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d, portal: 172.16.0.220,3260] successful.
Oct 25 21:27:21 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3285610-b209-4096-a606-742a1079aa44]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ca30b8-9c39-435b-8cad-4f5bf7869d20]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:27:21 user nova-compute[74189]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:27:21 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:27:21 user nova-compute[74189]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:27:21 user nova-compute[74189]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e (non-flash)
Oct 25 21:27:21 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:27:21 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:27:21 user nova-compute[74189]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:27:21 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:27:21 user nova-compute[74189]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:27:21 user nova-compute[74189]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e (non-flash)
Oct 25 21:27:21 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:27:21 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] HCTL ('38', '-', '-', 0) found on session 30 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.026s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[044f03a7-b9d3-4fc1-a318-d475694906d2]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Searching for a device in session 30 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KcyRfFoi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] No VIF found with MAC fa:16:3e:27:ed:f4, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:27:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-052e5028-1062-49f0-827e-2240086720f7 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Lock "f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.183s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:27:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] <== connect_volume: return (1479ms) {'type': 'block', 'scsi_wwn': '23530336635363532', 'path': '/dev/sdg'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:27:22 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530336635363532', 'path': '/dev/sdg'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:27:22 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-373776185',display_name='tempest-TestVolumeBootPattern-volume-backed-server-373776185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-373776185',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTqyu9zscRHG+4PWq2KUYWUDaF14I7dW5TvNxWSSGwOpQH6P2k9O5z/UfIY2G1oHw7ySR9zIJa9lEWatc6t/ZPIYW/ejRmVUjVyHxlMIB9C8LoZZ2dikky07mAnqdwDVA==',key_name='tempest-keypair-245422482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e893e8f3f58e4e15920d313b6391682c',ramdisk_id='',reservation_id='r-pqtkyg7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1934687878',owner_user_name='tempest-TestVolumeBootPattern-1934687878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:27:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77a27a7ebb4a458097c901871c378bc8',uuid=9a15fb16-8623-4a20-ae26-5f0aab29ec07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99d99cc1-710e-41b6-8239-79f4dbc9183a", "address": "fa:16:3e:09:c7:d1", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d99cc1-71", "ovs_interfaceid": "99d99cc1-710e-41b6-8239-79f4dbc9183a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:27:22 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converting VIF {"id": "99d99cc1-710e-41b6-8239-79f4dbc9183a", "address": "fa:16:3e:09:c7:d1", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d99cc1-71", "ovs_interfaceid": "99d99cc1-710e-41b6-8239-79f4dbc9183a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:27:22 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:c7:d1,bridge_name='br-int',has_traffic_filtering=True,id=99d99cc1-710e-41b6-8239-79f4dbc9183a,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d99cc1-71') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:27:22 user nova-compute[74189]: DEBUG nova.objects.instance [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a15fb16-8623-4a20-ae26-5f0aab29ec07 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:27:22 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:27:22 user nova-compute[74189]:   <uuid>9a15fb16-8623-4a20-ae26-5f0aab29ec07</uuid>
Oct 25 21:27:22 user nova-compute[74189]:   <name>instance-0000001c</name>
Oct 25 21:27:22 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:27:22 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:27:22 user nova-compute[74189]:   <metadata>
Oct 25 21:27:22 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:27:22 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:27:22 user nova-compute[74189]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-373776185</nova:name>
Oct 25 21:27:22 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:27:20</nova:creationTime>
Oct 25 21:27:22 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:27:22 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:27:22 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:27:22 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:27:22 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:27:22 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:27:22 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:27:22 user nova-compute[74189]:       <nova:owner>
Oct 25 21:27:22 user nova-compute[74189]:         <nova:user uuid="77a27a7ebb4a458097c901871c378bc8">tempest-TestVolumeBootPattern-1934687878-project-member</nova:user>
Oct 25 21:27:22 user nova-compute[74189]:         <nova:project uuid="e893e8f3f58e4e15920d313b6391682c">tempest-TestVolumeBootPattern-1934687878</nova:project>
Oct 25 21:27:22 user nova-compute[74189]:       </nova:owner>
Oct 25 21:27:22 user nova-compute[74189]:       <nova:ports>
Oct 25 21:27:22 user nova-compute[74189]:         <nova:port uuid="99d99cc1-710e-41b6-8239-79f4dbc9183a">
Oct 25 21:27:22 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 25 21:27:22 user nova-compute[74189]:         </nova:port>
Oct 25 21:27:22 user nova-compute[74189]:       </nova:ports>
Oct 25 21:27:22 user nova-compute[74189]:     </nova:instance>
Oct 25 21:27:22 user nova-compute[74189]:   </metadata>
Oct 25 21:27:22 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:27:22 user nova-compute[74189]:     <system>
Oct 25 21:27:22 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:27:22 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:27:22 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:27:22 user nova-compute[74189]:       <entry name="serial">9a15fb16-8623-4a20-ae26-5f0aab29ec07</entry>
Oct 25 21:27:22 user nova-compute[74189]:       <entry name="uuid">9a15fb16-8623-4a20-ae26-5f0aab29ec07</entry>
Oct 25 21:27:22 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:27:22 user nova-compute[74189]:     </system>
Oct 25 21:27:22 user nova-compute[74189]:   </sysinfo>
Oct 25 21:27:22 user nova-compute[74189]:   <os>
Oct 25 21:27:22 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:27:22 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:27:22 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:27:22 user nova-compute[74189]:   </os>
Oct 25 21:27:22 user nova-compute[74189]:   <features>
Oct 25 21:27:22 user nova-compute[74189]:     <acpi/>
Oct 25 21:27:22 user nova-compute[74189]:     <apic/>
Oct 25 21:27:22 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:27:22 user nova-compute[74189]:   </features>
Oct 25 21:27:22 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:27:22 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:27:22 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:27:22 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:27:22 user nova-compute[74189]:   </clock>
Oct 25 21:27:22 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:27:22 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:27:22 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:27:22 user nova-compute[74189]:   </cpu>
Oct 25 21:27:22 user nova-compute[74189]:   <devices>
Oct 25 21:27:22 user nova-compute[74189]:     <disk type="block" device="disk">
Oct 25 21:27:22 user nova-compute[74189]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:27:22 user nova-compute[74189]:       <source dev="/dev/sdg"/>
Oct 25 21:27:22 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:27:22 user nova-compute[74189]:       <serial>03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d</serial>
Oct 25 21:27:22 user nova-compute[74189]:     </disk>
Oct 25 21:27:22 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:27:22 user nova-compute[74189]:       <mac address="fa:16:3e:09:c7:d1"/>
Oct 25 21:27:22 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:27:22 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:27:22 user nova-compute[74189]:       <target dev="tap99d99cc1-71"/>
Oct 25 21:27:22 user nova-compute[74189]:     </interface>
Oct 25 21:27:22 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:27:22 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/9a15fb16-8623-4a20-ae26-5f0aab29ec07/console.log" append="off"/>
Oct 25 21:27:22 user nova-compute[74189]:     </serial>
Oct 25 21:27:22 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:27:22 user nova-compute[74189]:     <video>
Oct 25 21:27:22 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:27:22 user nova-compute[74189]:     </video>
Oct 25 21:27:22 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:27:22 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:27:22 user nova-compute[74189]:     </rng>
Oct 25 21:27:22 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:27:22 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:27:22 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:27:22 user nova-compute[74189]:     </memballoon>
Oct 25 21:27:22 user nova-compute[74189]:   </devices>
Oct 25 21:27:22 user nova-compute[74189]: </domain>
Oct 25 21:27:22 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:27:22 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-373776185',display_name='tempest-TestVolumeBootPattern-volume-backed-server-373776185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-373776185',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTqyu9zscRHG+4PWq2KUYWUDaF14I7dW5TvNxWSSGwOpQH6P2k9O5z/UfIY2G1oHw7ySR9zIJa9lEWatc6t/ZPIYW/ejRmVUjVyHxlMIB9C8LoZZ2dikky07mAnqdwDVA==',key_name='tempest-keypair-245422482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e893e8f3f58e4e15920d313b6391682c',ramdisk_id='',reservation_id='r-pqtkyg7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1934687878',owner_user_name='tempest-TestVolumeBootPattern-1934687878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:27:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77a27a7ebb4a458097c901871c378bc8',uuid=9a15fb16-8623-4a20-ae26-5f0aab29ec07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99d99cc1-710e-41b6-8239-79f4dbc9183a", "address": "fa:16:3e:09:c7:d1", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d99cc1-71", "ovs_interfaceid": "99d99cc1-710e-41b6-8239-79f4dbc9183a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:27:22 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converting VIF {"id": "99d99cc1-710e-41b6-8239-79f4dbc9183a", "address": "fa:16:3e:09:c7:d1", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d99cc1-71", "ovs_interfaceid": "99d99cc1-710e-41b6-8239-79f4dbc9183a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:27:22 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:c7:d1,bridge_name='br-int',has_traffic_filtering=True,id=99d99cc1-710e-41b6-8239-79f4dbc9183a,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d99cc1-71') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:27:22 user nova-compute[74189]: DEBUG os_vif [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:c7:d1,bridge_name='br-int',has_traffic_filtering=True,id=99d99cc1-710e-41b6-8239-79f4dbc9183a,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d99cc1-71') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:27:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:27:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:27:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85565a30-8ca3-5acf-a762-290881023f69', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:27:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99d99cc1-71, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:27:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap99d99cc1-71, col_values=(('qos', UUID('e06c10cd-53e0-44f3-b7d7-8c00a7836323')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:27:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap99d99cc1-71, col_values=(('external_ids', {'iface-id': '99d99cc1-710e-41b6-8239-79f4dbc9183a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:c7:d1', 'vm-uuid': '9a15fb16-8623-4a20-ae26-5f0aab29ec07'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:27:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:27:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:22 user nova-compute[74189]: INFO os_vif [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:c7:d1,bridge_name='br-int',has_traffic_filtering=True,id=99d99cc1-710e-41b6-8239-79f4dbc9183a,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d99cc1-71')
Oct 25 21:27:22 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:27:22 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] No VIF found with MAC fa:16:3e:09:c7:d1, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:27:23 user nova-compute[74189]: DEBUG nova.compute.manager [req-25b1b2b1-459f-4fae-b6d6-676fac482046 req-b2e67b00-7bb8-4be4-8a79-21bae5286766 service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Received event network-vif-plugged-1d25f7eb-3650-4049-a6b9-4fe9ff701593 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:27:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-25b1b2b1-459f-4fae-b6d6-676fac482046 req-b2e67b00-7bb8-4be4-8a79-21bae5286766 service nova] Acquiring lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-25b1b2b1-459f-4fae-b6d6-676fac482046 req-b2e67b00-7bb8-4be4-8a79-21bae5286766 service nova] Lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-25b1b2b1-459f-4fae-b6d6-676fac482046 req-b2e67b00-7bb8-4be4-8a79-21bae5286766 service nova] Lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:23 user nova-compute[74189]: DEBUG nova.compute.manager [req-25b1b2b1-459f-4fae-b6d6-676fac482046 req-b2e67b00-7bb8-4be4-8a79-21bae5286766 service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] No waiting events found dispatching network-vif-plugged-1d25f7eb-3650-4049-a6b9-4fe9ff701593 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:27:23 user nova-compute[74189]: WARNING nova.compute.manager [req-25b1b2b1-459f-4fae-b6d6-676fac482046 req-b2e67b00-7bb8-4be4-8a79-21bae5286766 service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Received unexpected event network-vif-plugged-1d25f7eb-3650-4049-a6b9-4fe9ff701593 for instance with vm_state building and task_state spawning.
Oct 25 21:27:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:23 user nova-compute[74189]: DEBUG nova.compute.manager [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:27:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:27:23 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Instance spawned successfully.
Oct 25 21:27:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:27:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:27:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:27:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:27:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:27:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:27:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:27:23 user nova-compute[74189]: INFO nova.compute.manager [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Took 5.63 seconds to spawn the instance on the hypervisor.
Oct 25 21:27:23 user nova-compute[74189]: DEBUG nova.compute.manager [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:27:23 user nova-compute[74189]: INFO nova.compute.manager [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Took 26.81 seconds to build instance.
Oct 25 21:27:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c24498b8-0029-4552-8e6f-8ed0a60e6ada tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.932s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Acquiring lock "f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Lock "f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:23 user nova-compute[74189]: INFO nova.compute.manager [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Detaching volume de583eee-b9f9-4e9b-9c71-1530de4e111e
Oct 25 21:27:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:23 user nova-compute[74189]: INFO nova.virt.block_device [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Attempting to driver detach volume de583eee-b9f9-4e9b-9c71-1530de4e111e from mountpoint /dev/vdb
Oct 25 21:27:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Attempting to detach device vdb from instance f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d from the persistent domain config. {{(pid=74189) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 21:27:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:27:23 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:27:23 user nova-compute[74189]:   <source dev="/dev/sdf"/>
Oct 25 21:27:23 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:27:23 user nova-compute[74189]:   <serial>de583eee-b9f9-4e9b-9c71-1530de4e111e</serial>
Oct 25 21:27:23 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:27:23 user nova-compute[74189]: </disk>
Oct 25 21:27:23 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:27:23 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Successfully detached device vdb from instance f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d from the persistent domain config.
Oct 25 21:27:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d from the live domain config. {{(pid=74189) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 21:27:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:27:23 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:27:23 user nova-compute[74189]:   <source dev="/dev/sdf"/>
Oct 25 21:27:23 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:27:23 user nova-compute[74189]:   <serial>de583eee-b9f9-4e9b-9c71-1530de4e111e</serial>
Oct 25 21:27:23 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:27:23 user nova-compute[74189]: </disk>
Oct 25 21:27:23 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:27:24 user nova-compute[74189]: DEBUG nova.compute.manager [req-ea331900-89e7-4c3f-918f-10cf9a9726b2 req-d62536b2-fbfe-4ab8-bbab-1872842cf93b service nova] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Received event network-vif-plugged-99d99cc1-710e-41b6-8239-79f4dbc9183a {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:27:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ea331900-89e7-4c3f-918f-10cf9a9726b2 req-d62536b2-fbfe-4ab8-bbab-1872842cf93b service nova] Acquiring lock "9a15fb16-8623-4a20-ae26-5f0aab29ec07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ea331900-89e7-4c3f-918f-10cf9a9726b2 req-d62536b2-fbfe-4ab8-bbab-1872842cf93b service nova] Lock "9a15fb16-8623-4a20-ae26-5f0aab29ec07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ea331900-89e7-4c3f-918f-10cf9a9726b2 req-d62536b2-fbfe-4ab8-bbab-1872842cf93b service nova] Lock "9a15fb16-8623-4a20-ae26-5f0aab29ec07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:24 user nova-compute[74189]: DEBUG nova.compute.manager [req-ea331900-89e7-4c3f-918f-10cf9a9726b2 req-d62536b2-fbfe-4ab8-bbab-1872842cf93b service nova] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] No waiting events found dispatching network-vif-plugged-99d99cc1-710e-41b6-8239-79f4dbc9183a {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:27:24 user nova-compute[74189]: WARNING nova.compute.manager [req-ea331900-89e7-4c3f-918f-10cf9a9726b2 req-d62536b2-fbfe-4ab8-bbab-1872842cf93b service nova] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Received unexpected event network-vif-plugged-99d99cc1-710e-41b6-8239-79f4dbc9183a for instance with vm_state building and task_state spawning.
Oct 25 21:27:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d {{(pid=74189) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 21:27:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:25 user nova-compute[74189]: DEBUG nova.compute.manager [req-e7cac0f5-86d0-412e-836f-be50ee79701b req-64bcc9c0-2fae-4566-b1c7-9e7deeb21b09 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received event network-changed-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:27:25 user nova-compute[74189]: DEBUG nova.compute.manager [req-e7cac0f5-86d0-412e-836f-be50ee79701b req-64bcc9c0-2fae-4566-b1c7-9e7deeb21b09 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Refreshing instance network info cache due to event network-changed-ecc4dd08-df4f-445b-81eb-b3946804aef8. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:27:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e7cac0f5-86d0-412e-836f-be50ee79701b req-64bcc9c0-2fae-4566-b1c7-9e7deeb21b09 service nova] Acquiring lock "refresh_cache-a57b1185-270e-40d0-a55e-986960826169" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:27:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e7cac0f5-86d0-412e-836f-be50ee79701b req-64bcc9c0-2fae-4566-b1c7-9e7deeb21b09 service nova] Acquired lock "refresh_cache-a57b1185-270e-40d0-a55e-986960826169" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:27:25 user nova-compute[74189]: DEBUG nova.network.neutron [req-e7cac0f5-86d0-412e-836f-be50ee79701b req-64bcc9c0-2fae-4566-b1c7-9e7deeb21b09 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Refreshing network info cache for port ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:27:26 user nova-compute[74189]: DEBUG nova.network.neutron [req-e7cac0f5-86d0-412e-836f-be50ee79701b req-64bcc9c0-2fae-4566-b1c7-9e7deeb21b09 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Updated VIF entry in instance network info cache for port ecc4dd08-df4f-445b-81eb-b3946804aef8. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:27:26 user nova-compute[74189]: DEBUG nova.network.neutron [req-e7cac0f5-86d0-412e-836f-be50ee79701b req-64bcc9c0-2fae-4566-b1c7-9e7deeb21b09 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Updating instance_info_cache with network_info: [{"id": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "address": "fa:16:3e:6b:ad:c5", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc4dd08-df", "ovs_interfaceid": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:27:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e7cac0f5-86d0-412e-836f-be50ee79701b req-64bcc9c0-2fae-4566-b1c7-9e7deeb21b09 service nova] Releasing lock "refresh_cache-a57b1185-270e-40d0-a55e-986960826169" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:27:26 user nova-compute[74189]: DEBUG nova.compute.manager [req-732e9ac8-78f3-4ca5-9278-740049c84c2d req-229e438a-2e27-4040-9efa-9b1cdf38c615 service nova] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Received event network-vif-plugged-99d99cc1-710e-41b6-8239-79f4dbc9183a {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:27:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-732e9ac8-78f3-4ca5-9278-740049c84c2d req-229e438a-2e27-4040-9efa-9b1cdf38c615 service nova] Acquiring lock "9a15fb16-8623-4a20-ae26-5f0aab29ec07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-732e9ac8-78f3-4ca5-9278-740049c84c2d req-229e438a-2e27-4040-9efa-9b1cdf38c615 service nova] Lock "9a15fb16-8623-4a20-ae26-5f0aab29ec07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-732e9ac8-78f3-4ca5-9278-740049c84c2d req-229e438a-2e27-4040-9efa-9b1cdf38c615 service nova] Lock "9a15fb16-8623-4a20-ae26-5f0aab29ec07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:26 user nova-compute[74189]: DEBUG nova.compute.manager [req-732e9ac8-78f3-4ca5-9278-740049c84c2d req-229e438a-2e27-4040-9efa-9b1cdf38c615 service nova] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] No waiting events found dispatching network-vif-plugged-99d99cc1-710e-41b6-8239-79f4dbc9183a {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:27:26 user nova-compute[74189]: WARNING nova.compute.manager [req-732e9ac8-78f3-4ca5-9278-740049c84c2d req-229e438a-2e27-4040-9efa-9b1cdf38c615 service nova] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Received unexpected event network-vif-plugged-99d99cc1-710e-41b6-8239-79f4dbc9183a for instance with vm_state building and task_state spawning.
Oct 25 21:27:26 user nova-compute[74189]: DEBUG nova.compute.manager [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:27:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:27:26 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Instance spawned successfully.
Oct 25 21:27:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:27:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:27:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:27:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:27:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:27:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:27:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:27:26 user nova-compute[74189]: INFO nova.compute.manager [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Took 5.72 seconds to spawn the instance on the hypervisor.
Oct 25 21:27:26 user nova-compute[74189]: DEBUG nova.compute.manager [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:27:26 user nova-compute[74189]: INFO nova.compute.manager [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Took 28.21 seconds to build instance.
Oct 25 21:27:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8300fbde-d45b-42bc-a9bb-a062ef5a3ae4 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "9a15fb16-8623-4a20-ae26-5f0aab29ec07" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.362s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:28 user nova-compute[74189]: DEBUG nova.compute.manager [req-e3a4f084-0d15-4ab5-89b6-79c7cd8de080 req-8e41e5b8-dc90-4768-bfa2-b30a066fe094 service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Received event network-changed-b05a2001-02cd-45af-9242-3d6246edcd0b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:27:28 user nova-compute[74189]: DEBUG nova.compute.manager [req-e3a4f084-0d15-4ab5-89b6-79c7cd8de080 req-8e41e5b8-dc90-4768-bfa2-b30a066fe094 service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Refreshing instance network info cache due to event network-changed-b05a2001-02cd-45af-9242-3d6246edcd0b. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:27:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e3a4f084-0d15-4ab5-89b6-79c7cd8de080 req-8e41e5b8-dc90-4768-bfa2-b30a066fe094 service nova] Acquiring lock "refresh_cache-7eff6940-9675-4c89-bd28-378a5db4369f" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:27:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e3a4f084-0d15-4ab5-89b6-79c7cd8de080 req-8e41e5b8-dc90-4768-bfa2-b30a066fe094 service nova] Acquired lock "refresh_cache-7eff6940-9675-4c89-bd28-378a5db4369f" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:27:28 user nova-compute[74189]: DEBUG nova.network.neutron [req-e3a4f084-0d15-4ab5-89b6-79c7cd8de080 req-8e41e5b8-dc90-4768-bfa2-b30a066fe094 service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Refreshing network info cache for port b05a2001-02cd-45af-9242-3d6246edcd0b {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:27:29 user nova-compute[74189]: DEBUG nova.network.neutron [req-e3a4f084-0d15-4ab5-89b6-79c7cd8de080 req-8e41e5b8-dc90-4768-bfa2-b30a066fe094 service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Updated VIF entry in instance network info cache for port b05a2001-02cd-45af-9242-3d6246edcd0b. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:27:29 user nova-compute[74189]: DEBUG nova.network.neutron [req-e3a4f084-0d15-4ab5-89b6-79c7cd8de080 req-8e41e5b8-dc90-4768-bfa2-b30a066fe094 service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Updating instance_info_cache with network_info: [{"id": "b05a2001-02cd-45af-9242-3d6246edcd0b", "address": "fa:16:3e:a4:7d:bb", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb05a2001-02", "ovs_interfaceid": "b05a2001-02cd-45af-9242-3d6246edcd0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:27:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "7eff6940-9675-4c89-bd28-378a5db4369f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "7eff6940-9675-4c89-bd28-378a5db4369f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e3a4f084-0d15-4ab5-89b6-79c7cd8de080 req-8e41e5b8-dc90-4768-bfa2-b30a066fe094 service nova] Releasing lock "refresh_cache-7eff6940-9675-4c89-bd28-378a5db4369f" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:27:29 user nova-compute[74189]: DEBUG nova.objects.instance [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lazy-loading 'flavor' on Instance uuid 7eff6940-9675-4c89-bd28-378a5db4369f {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:27:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "7eff6940-9675-4c89-bd28-378a5db4369f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "7eff6940-9675-4c89-bd28-378a5db4369f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "7eff6940-9675-4c89-bd28-378a5db4369f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:29 user nova-compute[74189]: INFO nova.compute.manager [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Attaching volume 148fadc7-8c60-4425-8451-634634e85cf1 to /dev/vdb
Oct 25 21:27:29 user nova-compute[74189]: DEBUG os_brick.utils [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:27:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:29 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1355f224-1693-4c6d-a5ca-4686ac17c0b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c00ea3a-689a-4487-9e3e-0ab2813615b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0660554a-f7d0-4271-ac73-c23fb2937760]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a088d4-df3e-4731-8d16-d7fb4b414301]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:27:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:27:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:27:30 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:27:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4e5951-e836-42a5-929b-c36fb99cc561]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:27:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:27:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:27:30 user nova-compute[74189]: DEBUG os_brick.utils [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:27:30 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Updating existing volume attachment record: 95a5e7c2-87d3-44d1-a416-b4326c846d33 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:27:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7aedc48f-aad7-4c6c-a59e-593e06992095 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "a57b1185-270e-40d0-a55e-986960826169" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7aedc48f-aad7-4c6c-a59e-593e06992095 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "a57b1185-270e-40d0-a55e-986960826169" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:32 user nova-compute[74189]: INFO nova.compute.manager [None req-7aedc48f-aad7-4c6c-a59e-593e06992095 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Shelving
Oct 25 21:27:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-72cb19e6-fc35-47f1-bad9-af77c6f17b8e req-8d31f769-5952-46ff-827b-ff1f65b4edcc service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received event network-vif-unplugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:27:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-72cb19e6-fc35-47f1-bad9-af77c6f17b8e req-8d31f769-5952-46ff-827b-ff1f65b4edcc service nova] Acquiring lock "a57b1185-270e-40d0-a55e-986960826169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-72cb19e6-fc35-47f1-bad9-af77c6f17b8e req-8d31f769-5952-46ff-827b-ff1f65b4edcc service nova] Lock "a57b1185-270e-40d0-a55e-986960826169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-72cb19e6-fc35-47f1-bad9-af77c6f17b8e req-8d31f769-5952-46ff-827b-ff1f65b4edcc service nova] Lock "a57b1185-270e-40d0-a55e-986960826169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-72cb19e6-fc35-47f1-bad9-af77c6f17b8e req-8d31f769-5952-46ff-827b-ff1f65b4edcc service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] No waiting events found dispatching network-vif-unplugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:27:33 user nova-compute[74189]: WARNING nova.compute.manager [req-72cb19e6-fc35-47f1-bad9-af77c6f17b8e req-8d31f769-5952-46ff-827b-ff1f65b4edcc service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received unexpected event network-vif-unplugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 for instance with vm_state active and task_state shelving.
Oct 25 21:27:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:33 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: a57b1185-270e-40d0-a55e-986960826169] Instance destroyed successfully.
Oct 25 21:27:33 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-7aedc48f-aad7-4c6c-a59e-593e06992095 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Beginning cold snapshot process
Oct 25 21:27:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:33 user nova-compute[74189]: INFO nova.compute.manager [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Detaching volume 5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f
Oct 25 21:27:33 user nova-compute[74189]: INFO nova.virt.block_device [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Attempting to driver detach volume 5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f from mountpoint /dev/vdb
Oct 25 21:27:33 user nova-compute[74189]: DEBUG nova.privsep.utils [None req-7aedc48f-aad7-4c6c-a59e-593e06992095 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74189) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 21:27:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-7aedc48f-aad7-4c6c-a59e-593e06992095 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk /opt/stack/data/nova/instances/snapshots/tmp23riwqr9/7864b71a4c014c538e7fc55e6a51d1e1 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Attempting to detach device vdb from instance de6b6789-b328-4c3b-8d24-07774d5dbe6d from the persistent domain config. {{(pid=74189) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 21:27:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:27:33 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:27:33 user nova-compute[74189]:   <source dev="/dev/sdc"/>
Oct 25 21:27:33 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:27:33 user nova-compute[74189]:   <serial>5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f</serial>
Oct 25 21:27:33 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 21:27:33 user nova-compute[74189]: </disk>
Oct 25 21:27:33 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:27:33 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Successfully detached device vdb from instance de6b6789-b328-4c3b-8d24-07774d5dbe6d from the persistent domain config.
Oct 25 21:27:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance de6b6789-b328-4c3b-8d24-07774d5dbe6d from the live domain config. {{(pid=74189) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 21:27:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:27:33 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:27:33 user nova-compute[74189]:   <source dev="/dev/sdc"/>
Oct 25 21:27:33 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:27:33 user nova-compute[74189]:   <serial>5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f</serial>
Oct 25 21:27:33 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 21:27:33 user nova-compute[74189]: </disk>
Oct 25 21:27:33 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:27:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance de6b6789-b328-4c3b-8d24-07774d5dbe6d {{(pid=74189) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 21:27:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-7aedc48f-aad7-4c6c-a59e-593e06992095 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk /opt/stack/data/nova/instances/snapshots/tmp23riwqr9/7864b71a4c014c538e7fc55e6a51d1e1" returned: 0 in 0.832s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:34 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-7aedc48f-aad7-4c6c-a59e-593e06992095 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Snapshot extracted, beginning image upload
Oct 25 21:27:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-8e29c58b-acd3-4891-bc0d-0b4a45d7214d req-1f4cbb5e-4823-48e7-b6c3-3282709965a5 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received event network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:27:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8e29c58b-acd3-4891-bc0d-0b4a45d7214d req-1f4cbb5e-4823-48e7-b6c3-3282709965a5 service nova] Acquiring lock "a57b1185-270e-40d0-a55e-986960826169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8e29c58b-acd3-4891-bc0d-0b4a45d7214d req-1f4cbb5e-4823-48e7-b6c3-3282709965a5 service nova] Lock "a57b1185-270e-40d0-a55e-986960826169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8e29c58b-acd3-4891-bc0d-0b4a45d7214d req-1f4cbb5e-4823-48e7-b6c3-3282709965a5 service nova] Lock "a57b1185-270e-40d0-a55e-986960826169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-8e29c58b-acd3-4891-bc0d-0b4a45d7214d req-1f4cbb5e-4823-48e7-b6c3-3282709965a5 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] No waiting events found dispatching network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:27:35 user nova-compute[74189]: WARNING nova.compute.manager [req-8e29c58b-acd3-4891-bc0d-0b4a45d7214d req-1f4cbb5e-4823-48e7-b6c3-3282709965a5 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received unexpected event network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 for instance with vm_state active and task_state shelving_image_uploading.
Oct 25 21:27:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-8e29c58b-acd3-4891-bc0d-0b4a45d7214d req-1f4cbb5e-4823-48e7-b6c3-3282709965a5 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received event network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:27:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8e29c58b-acd3-4891-bc0d-0b4a45d7214d req-1f4cbb5e-4823-48e7-b6c3-3282709965a5 service nova] Acquiring lock "a57b1185-270e-40d0-a55e-986960826169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8e29c58b-acd3-4891-bc0d-0b4a45d7214d req-1f4cbb5e-4823-48e7-b6c3-3282709965a5 service nova] Lock "a57b1185-270e-40d0-a55e-986960826169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8e29c58b-acd3-4891-bc0d-0b4a45d7214d req-1f4cbb5e-4823-48e7-b6c3-3282709965a5 service nova] Lock "a57b1185-270e-40d0-a55e-986960826169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-8e29c58b-acd3-4891-bc0d-0b4a45d7214d req-1f4cbb5e-4823-48e7-b6c3-3282709965a5 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] No waiting events found dispatching network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:27:35 user nova-compute[74189]: WARNING nova.compute.manager [req-8e29c58b-acd3-4891-bc0d-0b4a45d7214d req-1f4cbb5e-4823-48e7-b6c3-3282709965a5 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received unexpected event network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 for instance with vm_state active and task_state shelving_image_uploading.
Oct 25 21:27:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-8e29c58b-acd3-4891-bc0d-0b4a45d7214d req-1f4cbb5e-4823-48e7-b6c3-3282709965a5 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received event network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:27:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8e29c58b-acd3-4891-bc0d-0b4a45d7214d req-1f4cbb5e-4823-48e7-b6c3-3282709965a5 service nova] Acquiring lock "a57b1185-270e-40d0-a55e-986960826169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8e29c58b-acd3-4891-bc0d-0b4a45d7214d req-1f4cbb5e-4823-48e7-b6c3-3282709965a5 service nova] Lock "a57b1185-270e-40d0-a55e-986960826169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8e29c58b-acd3-4891-bc0d-0b4a45d7214d req-1f4cbb5e-4823-48e7-b6c3-3282709965a5 service nova] Lock "a57b1185-270e-40d0-a55e-986960826169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-8e29c58b-acd3-4891-bc0d-0b4a45d7214d req-1f4cbb5e-4823-48e7-b6c3-3282709965a5 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] No waiting events found dispatching network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:27:35 user nova-compute[74189]: WARNING nova.compute.manager [req-8e29c58b-acd3-4891-bc0d-0b4a45d7214d req-1f4cbb5e-4823-48e7-b6c3-3282709965a5 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received unexpected event network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 for instance with vm_state active and task_state shelving_image_uploading.
Oct 25 21:27:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-8e29c58b-acd3-4891-bc0d-0b4a45d7214d req-1f4cbb5e-4823-48e7-b6c3-3282709965a5 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received event network-vif-unplugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:27:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8e29c58b-acd3-4891-bc0d-0b4a45d7214d req-1f4cbb5e-4823-48e7-b6c3-3282709965a5 service nova] Acquiring lock "a57b1185-270e-40d0-a55e-986960826169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8e29c58b-acd3-4891-bc0d-0b4a45d7214d req-1f4cbb5e-4823-48e7-b6c3-3282709965a5 service nova] Lock "a57b1185-270e-40d0-a55e-986960826169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8e29c58b-acd3-4891-bc0d-0b4a45d7214d req-1f4cbb5e-4823-48e7-b6c3-3282709965a5 service nova] Lock "a57b1185-270e-40d0-a55e-986960826169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-8e29c58b-acd3-4891-bc0d-0b4a45d7214d req-1f4cbb5e-4823-48e7-b6c3-3282709965a5 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] No waiting events found dispatching network-vif-unplugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:27:35 user nova-compute[74189]: WARNING nova.compute.manager [req-8e29c58b-acd3-4891-bc0d-0b4a45d7214d req-1f4cbb5e-4823-48e7-b6c3-3282709965a5 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received unexpected event network-vif-unplugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 for instance with vm_state active and task_state shelving_image_uploading.
Oct 25 21:27:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-8e29c58b-acd3-4891-bc0d-0b4a45d7214d req-1f4cbb5e-4823-48e7-b6c3-3282709965a5 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received event network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:27:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8e29c58b-acd3-4891-bc0d-0b4a45d7214d req-1f4cbb5e-4823-48e7-b6c3-3282709965a5 service nova] Acquiring lock "a57b1185-270e-40d0-a55e-986960826169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8e29c58b-acd3-4891-bc0d-0b4a45d7214d req-1f4cbb5e-4823-48e7-b6c3-3282709965a5 service nova] Lock "a57b1185-270e-40d0-a55e-986960826169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8e29c58b-acd3-4891-bc0d-0b4a45d7214d req-1f4cbb5e-4823-48e7-b6c3-3282709965a5 service nova] Lock "a57b1185-270e-40d0-a55e-986960826169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-8e29c58b-acd3-4891-bc0d-0b4a45d7214d req-1f4cbb5e-4823-48e7-b6c3-3282709965a5 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] No waiting events found dispatching network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:27:35 user nova-compute[74189]: WARNING nova.compute.manager [req-8e29c58b-acd3-4891-bc0d-0b4a45d7214d req-1f4cbb5e-4823-48e7-b6c3-3282709965a5 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received unexpected event network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 for instance with vm_state active and task_state shelving_image_uploading.
Oct 25 21:27:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:38 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-7aedc48f-aad7-4c6c-a59e-593e06992095 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Snapshot image upload complete
Oct 25 21:27:38 user nova-compute[74189]: DEBUG nova.compute.manager [None req-7aedc48f-aad7-4c6c-a59e-593e06992095 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:27:38 user nova-compute[74189]: INFO nova.compute.manager [None req-7aedc48f-aad7-4c6c-a59e-593e06992095 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Shelve offloading
Oct 25 21:27:38 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: a57b1185-270e-40d0-a55e-986960826169] Instance destroyed successfully.
Oct 25 21:27:38 user nova-compute[74189]: DEBUG nova.compute.manager [None req-7aedc48f-aad7-4c6c-a59e-593e06992095 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:27:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7aedc48f-aad7-4c6c-a59e-593e06992095 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "refresh_cache-a57b1185-270e-40d0-a55e-986960826169" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:27:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7aedc48f-aad7-4c6c-a59e-593e06992095 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquired lock "refresh_cache-a57b1185-270e-40d0-a55e-986960826169" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:27:38 user nova-compute[74189]: DEBUG nova.network.neutron [None req-7aedc48f-aad7-4c6c-a59e-593e06992095 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:27:38 user nova-compute[74189]: DEBUG nova.network.neutron [None req-7aedc48f-aad7-4c6c-a59e-593e06992095 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Updating instance_info_cache with network_info: [{"id": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "address": "fa:16:3e:6b:ad:c5", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc4dd08-df", "ovs_interfaceid": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:27:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7aedc48f-aad7-4c6c-a59e-593e06992095 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Releasing lock "refresh_cache-a57b1185-270e-40d0-a55e-986960826169" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:27:39 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: a57b1185-270e-40d0-a55e-986960826169] Instance destroyed successfully.
Oct 25 21:27:39 user nova-compute[74189]: DEBUG nova.objects.instance [None req-7aedc48f-aad7-4c6c-a59e-593e06992095 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lazy-loading 'resources' on Instance uuid a57b1185-270e-40d0-a55e-986960826169 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:27:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-7aedc48f-aad7-4c6c-a59e-593e06992095 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:25:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1746373749',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1746373749',id=24,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeVfbHlnrfHPlWJf0qQWN3RmoyGnlwESQMNATRyDnsaQDNhoQQ5AFt+AOrCNT1My52XNyl/wmtAhCjs522VgUQ0PcCWFwer2/z8cWlMfT4+vBhmGaYJddvSyq52kAg4Cg==',key_name='tempest-keypair-784432470',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:25:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e45f8868c6a04e31ad1617ee6e9438a2',ramdisk_id='',reservation_id='r-6cje6qbe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-846255404',owner_user_name='tempest-AttachVolumeShelveTestJSON-846255404-project-member',shelved_at='2023-10-25T21:27:38.241094',shelved_host='user',shelved_image_id='b646bcdf-ed18-4e0e-a4f7-3b15c220907d'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:27:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6fb9b5c36f049c1af4ae44e11267264',uuid=a57b1185-270e-40d0-a55e-986960826169,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "address": "fa:16:3e:6b:ad:c5", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc4dd08-df", "ovs_interfaceid": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:27:39 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-7aedc48f-aad7-4c6c-a59e-593e06992095 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Converting VIF {"id": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "address": "fa:16:3e:6b:ad:c5", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc4dd08-df", "ovs_interfaceid": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:27:39 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-7aedc48f-aad7-4c6c-a59e-593e06992095 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ad:c5,bridge_name='br-int',has_traffic_filtering=True,id=ecc4dd08-df4f-445b-81eb-b3946804aef8,network=Network(09d8bdf6-f255-479c-aa38-55d468abf1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc4dd08-df') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:27:39 user nova-compute[74189]: DEBUG os_vif [None req-7aedc48f-aad7-4c6c-a59e-593e06992095 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ad:c5,bridge_name='br-int',has_traffic_filtering=True,id=ecc4dd08-df4f-445b-81eb-b3946804aef8,network=Network(09d8bdf6-f255-479c-aa38-55d468abf1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc4dd08-df') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:27:39 user nova-compute[74189]: DEBUG nova.compute.manager [req-07c021bc-3dfd-4df2-a9c4-da96e55669c8 req-f8cbec86-906d-404d-ae17-b4951c2f840f service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received event network-changed-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:27:39 user nova-compute[74189]: DEBUG nova.compute.manager [req-07c021bc-3dfd-4df2-a9c4-da96e55669c8 req-f8cbec86-906d-404d-ae17-b4951c2f840f service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Refreshing instance network info cache due to event network-changed-ecc4dd08-df4f-445b-81eb-b3946804aef8. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:27:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-07c021bc-3dfd-4df2-a9c4-da96e55669c8 req-f8cbec86-906d-404d-ae17-b4951c2f840f service nova] Acquiring lock "refresh_cache-a57b1185-270e-40d0-a55e-986960826169" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:27:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-07c021bc-3dfd-4df2-a9c4-da96e55669c8 req-f8cbec86-906d-404d-ae17-b4951c2f840f service nova] Acquired lock "refresh_cache-a57b1185-270e-40d0-a55e-986960826169" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:27:39 user nova-compute[74189]: DEBUG nova.network.neutron [req-07c021bc-3dfd-4df2-a9c4-da96e55669c8 req-f8cbec86-906d-404d-ae17-b4951c2f840f service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Refreshing network info cache for port ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:27:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapecc4dd08-df, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:27:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:27:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=28bd3bef-7dea-4b5e-b9f8-f45c17d8dc1f) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:27:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:39 user nova-compute[74189]: INFO os_vif [None req-7aedc48f-aad7-4c6c-a59e-593e06992095 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ad:c5,bridge_name='br-int',has_traffic_filtering=True,id=ecc4dd08-df4f-445b-81eb-b3946804aef8,network=Network(09d8bdf6-f255-479c-aa38-55d468abf1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc4dd08-df')
Oct 25 21:27:39 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-7aedc48f-aad7-4c6c-a59e-593e06992095 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Deleting instance files /opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169_del
Oct 25 21:27:39 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-7aedc48f-aad7-4c6c-a59e-593e06992095 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Deletion of /opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169_del complete
Oct 25 21:27:39 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-7aedc48f-aad7-4c6c-a59e-593e06992095 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Deleted allocations for instance a57b1185-270e-40d0-a55e-986960826169
Oct 25 21:27:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7aedc48f-aad7-4c6c-a59e-593e06992095 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7aedc48f-aad7-4c6c-a59e-593e06992095 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:39 user nova-compute[74189]: DEBUG nova.objects.instance [None req-7aedc48f-aad7-4c6c-a59e-593e06992095 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lazy-loading 'numa_topology' on Instance uuid a57b1185-270e-40d0-a55e-986960826169 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:27:39 user nova-compute[74189]: DEBUG nova.objects.base [None req-7aedc48f-aad7-4c6c-a59e-593e06992095 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Object Instance<a57b1185-270e-40d0-a55e-986960826169> lazy-loaded attributes: resources,numa_topology {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:27:39 user nova-compute[74189]: DEBUG nova.network.neutron [req-07c021bc-3dfd-4df2-a9c4-da96e55669c8 req-f8cbec86-906d-404d-ae17-b4951c2f840f service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Updated VIF entry in instance network info cache for port ecc4dd08-df4f-445b-81eb-b3946804aef8. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:27:39 user nova-compute[74189]: DEBUG nova.network.neutron [req-07c021bc-3dfd-4df2-a9c4-da96e55669c8 req-f8cbec86-906d-404d-ae17-b4951c2f840f service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Updating instance_info_cache with network_info: [{"id": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "address": "fa:16:3e:6b:ad:c5", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapecc4dd08-df", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:27:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-07c021bc-3dfd-4df2-a9c4-da96e55669c8 req-f8cbec86-906d-404d-ae17-b4951c2f840f service nova] Releasing lock "refresh_cache-a57b1185-270e-40d0-a55e-986960826169" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:27:40 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-7aedc48f-aad7-4c6c-a59e-593e06992095 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:27:40 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-7aedc48f-aad7-4c6c-a59e-593e06992095 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:27:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7aedc48f-aad7-4c6c-a59e-593e06992095 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.537s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7aedc48f-aad7-4c6c-a59e-593e06992095 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "a57b1185-270e-40d0-a55e-986960826169" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.636s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:44 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d is timed out.
Oct 25 21:27:44 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Successfully detached device vdb from instance f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d from the live domain config.
Oct 25 21:27:44 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRaXIMsg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:27:44 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:27:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[515da658-57a6-4a35-bc7b-87ccf6f0715e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:27:44 user nova-compute[74189]: No targets found.
Oct 25 21:27:44 user nova-compute[74189]: iSNS:
Oct 25 21:27:44 user nova-compute[74189]: No targets found.
Oct 25 21:27:44 user nova-compute[74189]: STATIC:
Oct 25 21:27:44 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e
Oct 25 21:27:44 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:27:44 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:27:44 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a
Oct 25 21:27:44 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:27:44 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:27:44 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d
Oct 25 21:27:44 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:27:44 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:27:44 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e
Oct 25 21:27:44 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:27:44 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:27:44 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f
Oct 25 21:27:44 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:27:44 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:27:44 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:27:44 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:27:44 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:27:44 user nova-compute[74189]: FIRMWARE:
Oct 25 21:27:44 user nova-compute[74189]: No targets found.
Oct 25 21:27:44 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:27:44 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:27:44 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c966b6-06bd-4dd0-a0eb-95731c45f8a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e7e72a-563a-4b1e-9ce6-bbb090c40d8d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:27:44 user nova-compute[74189]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:27:44 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:27:44 user nova-compute[74189]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:27:44 user nova-compute[74189]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e (non-flash)
Oct 25 21:27:44 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:27:44 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:27:44 user nova-compute[74189]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:27:44 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:27:44 user nova-compute[74189]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:27:44 user nova-compute[74189]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e (non-flash)
Oct 25 21:27:44 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:27:44 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2e41a12d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e'): ({'sdf'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Removing single pathed devices sdf {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb223ba2-87aa-4510-bcc0-34bdcec6a641]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81e6a07-9db9-43b8-9ec3-65bdb5e6ffd9]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Flushing IO for device /dev/sdf {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9a7475-f68f-4fee-ab27-2897e4d29e46]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.035s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8238da2d-3ef9-46b2-b407-ae0e395842b9]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] SCSI volumes sdf have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1dc20b-e53d-47c6-9718-7cfce933a261]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a95ea4-bd97-4451-956e-c80d1f0bfe16]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e, portal: 172.16.0.220,3260]
Oct 25 21:27:44 user nova-compute[74189]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e, portal: 172.16.0.220,3260] successful.
Oct 25 21:27:44 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de583eee-b9f9-4e9b-9c71-1530de4e111e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8076016-c485-4665-8947-c490663f3fe1]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] <== disconnect_volume: return (313ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:27:44 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:27:45 user nova-compute[74189]: DEBUG nova.objects.instance [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Lazy-loading 'flavor' on Instance uuid f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:27:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6ccb84c5-e6c4-4fc0-913a-855376eaf2d2 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Lock "f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.998s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HQGOgDXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:27:51 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:27:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:27:51 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:27:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:27:51 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:27:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9136d396-c553-4228-ad03-05cdfa4b97f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:27:51 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5448afa-08fc-409f-aa3f-05ef878628e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1] added
Oct 25 21:27:51 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f86596-857e-44b3-8fb7-d1839a7bf152]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d33d07-080c-40ff-8517-11c6534fb38c]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HQGOgDXa {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HQGOgDXa" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[901cc34a-437e-4207-aedf-e42c7cdc29a3]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HQGOgDXa'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8178c1-8776-4aca-883f-c6f9c0c0c582]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d83d4bf-546f-4acf-8c37-674f6a72f835]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:27:51 user nova-compute[74189]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:27:51 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:27:51 user nova-compute[74189]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:27:51 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:27:51 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:27:51 user nova-compute[74189]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:27:51 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:27:51 user nova-compute[74189]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:27:51 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:27:51 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0671e8c-921d-4d55-83f5-500c540f1f20]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1, portal: 172.16.0.220,3260]
Oct 25 21:27:51 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1, portal: 172.16.0.220,3260] successful.
Oct 25 21:27:51 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae56c89-278a-4dcc-ac76-6dd0edb302fa]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a1a720-872a-47fd-8e81-3c142d84901b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:27:51 user nova-compute[74189]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:27:51 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:27:51 user nova-compute[74189]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:27:51 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:27:51 user nova-compute[74189]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:27:51 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:27:51 user nova-compute[74189]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:27:51 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:27:51 user nova-compute[74189]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:27:51 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:27:51 user nova-compute[74189]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:27:51 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] HCTL ('37', '-', '-', 0) found on session 31 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[af91a036-be3a-41eb-8d3c-2b61cca651b5]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:27:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HQGOgDXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:27:52 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:27:52 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23431663938383263', 'path': '/dev/sdf'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:27:52 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431663938383263', 'path': '/dev/sdf'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:27:52 user nova-compute[74189]: DEBUG nova.objects.instance [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lazy-loading 'flavor' on Instance uuid 7eff6940-9675-4c89-bd28-378a5db4369f {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:27:52 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 21:27:52 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:27:52 user nova-compute[74189]:   <source dev="/dev/sdf"/>
Oct 25 21:27:52 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:27:52 user nova-compute[74189]:   <serial>148fadc7-8c60-4425-8451-634634e85cf1</serial>
Oct 25 21:27:52 user nova-compute[74189]: </disk>
Oct 25 21:27:52 user nova-compute[74189]:  {{(pid=74189) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 21:27:53 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:27:53 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:27:53 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] No VIF found with MAC fa:16:3e:a4:7d:bb, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:27:53 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-51c5ce5e-e042-4a69-91b6-aa3d39e4fa2c tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "7eff6940-9675-4c89-bd28-378a5db4369f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.550s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:54 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance de6b6789-b328-4c3b-8d24-07774d5dbe6d is timed out.
Oct 25 21:27:54 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Successfully detached device vdb from instance de6b6789-b328-4c3b-8d24-07774d5dbe6d from the live domain config.
Oct 25 21:27:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDraZkpJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:27:54 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:27:54 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[62398dbc-f1ed-4a18-9141-d04f68d11819]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:27:54 user nova-compute[74189]: No targets found.
Oct 25 21:27:54 user nova-compute[74189]: iSNS:
Oct 25 21:27:54 user nova-compute[74189]: No targets found.
Oct 25 21:27:54 user nova-compute[74189]: STATIC:
Oct 25 21:27:54 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a
Oct 25 21:27:54 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:27:54 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:27:54 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d
Oct 25 21:27:54 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:27:54 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:27:54 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e
Oct 25 21:27:54 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:27:54 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:27:54 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1
Oct 25 21:27:54 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:27:54 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:27:54 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f
Oct 25 21:27:54 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:27:54 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:27:54 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:27:54 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:27:54 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:27:54 user nova-compute[74189]: FIRMWARE:
Oct 25 21:27:54 user nova-compute[74189]: No targets found.
Oct 25 21:27:54 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:27:54 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:27:54 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7012b6a-b0a7-4fc3-8ded-17823f4bc178]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "c5ba374a-821b-424c-aeaa-528a0164160e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "c5ba374a-821b-424c-aeaa-528a0164160e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba846700-e6c1-40d9-b393-4ff968227f8d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:27:54 user nova-compute[74189]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:27:54 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:27:54 user nova-compute[74189]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:27:54 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:27:54 user nova-compute[74189]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:27:54 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:27:54 user nova-compute[74189]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f (non-flash)
Oct 25 21:27:54 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:27:54 user nova-compute[74189]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:27:54 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:27:54 user nova-compute[74189]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:27:54 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2e4252440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f'): ({'sdc'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Removing single pathed devices sdc {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG nova.compute.manager [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e826e8a1-eaca-47b5-9c64-e81f31a9306d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafa33e3-88b8-43a5-8471-031bbd9eb8f5]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Flushing IO for device /dev/sdc {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[85271eee-8917-4206-90f2-df0890cd7d9c]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:27:54 user nova-compute[74189]: INFO nova.compute.claims [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Claim successful on node user
Oct 25 21:27:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[de54a292-b9ba-4362-98a6-e3add62eb57c]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] SCSI volumes sdc have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc37679-177c-4ba8-9b6c-291526b29286]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2df4fd-6a4c-416a-a3ae-8aab6c432843]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f, portal: 172.16.0.220,3260]
Oct 25 21:27:54 user nova-compute[74189]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f, portal: 172.16.0.220,3260] successful.
Oct 25 21:27:54 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cc6ee95-eeab-47a0-8d60-fdbf98f0e10f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1baa5298-7f6f-4907-8904-8f5ecf503f05]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] <== disconnect_volume: return (393ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:27:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:27:55 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:27:55 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:27:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.556s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:55 user nova-compute[74189]: DEBUG nova.compute.manager [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:27:55 user nova-compute[74189]: DEBUG nova.compute.manager [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:27:55 user nova-compute[74189]: DEBUG nova.network.neutron [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:27:55 user nova-compute[74189]: INFO nova.compute.manager [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Rebuilding instance
Oct 25 21:27:55 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:27:55 user nova-compute[74189]: DEBUG nova.compute.manager [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:27:55 user nova-compute[74189]: DEBUG nova.compute.manager [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:27:55 user nova-compute[74189]: DEBUG nova.compute.manager [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:27:55 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:27:55 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Creating image(s)
Oct 25 21:27:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "/opt/stack/data/nova/instances/c5ba374a-821b-424c-aeaa-528a0164160e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "/opt/stack/data/nova/instances/c5ba374a-821b-424c-aeaa-528a0164160e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "/opt/stack/data/nova/instances/c5ba374a-821b-424c-aeaa-528a0164160e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:55 user nova-compute[74189]: DEBUG nova.policy [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2f19a398fd9486fbef04eebad62a0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a555d708aa644d586d5edad7db837b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:27:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.253s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:55 user nova-compute[74189]: DEBUG nova.objects.instance [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lazy-loading 'flavor' on Instance uuid de6b6789-b328-4c3b-8d24-07774d5dbe6d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:27:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5bbfabc0-c1e7-4beb-8044-9af4a729fc21 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.226s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.197s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/c5ba374a-821b-424c-aeaa-528a0164160e/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:55 user nova-compute[74189]: DEBUG nova.compute.manager [req-20d9c22a-0424-4068-9022-6225dbe4c7e1 req-0bd280c9-5107-4836-ab36-c230960da092 service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Received event network-vif-unplugged-b05a2001-02cd-45af-9242-3d6246edcd0b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:27:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-20d9c22a-0424-4068-9022-6225dbe4c7e1 req-0bd280c9-5107-4836-ab36-c230960da092 service nova] Acquiring lock "7eff6940-9675-4c89-bd28-378a5db4369f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-20d9c22a-0424-4068-9022-6225dbe4c7e1 req-0bd280c9-5107-4836-ab36-c230960da092 service nova] Lock "7eff6940-9675-4c89-bd28-378a5db4369f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-20d9c22a-0424-4068-9022-6225dbe4c7e1 req-0bd280c9-5107-4836-ab36-c230960da092 service nova] Lock "7eff6940-9675-4c89-bd28-378a5db4369f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:55 user nova-compute[74189]: DEBUG nova.compute.manager [req-20d9c22a-0424-4068-9022-6225dbe4c7e1 req-0bd280c9-5107-4836-ab36-c230960da092 service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] No waiting events found dispatching network-vif-unplugged-b05a2001-02cd-45af-9242-3d6246edcd0b {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:27:55 user nova-compute[74189]: WARNING nova.compute.manager [req-20d9c22a-0424-4068-9022-6225dbe4c7e1 req-0bd280c9-5107-4836-ab36-c230960da092 service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Received unexpected event network-vif-unplugged-b05a2001-02cd-45af-9242-3d6246edcd0b for instance with vm_state active and task_state rebuilding.
Oct 25 21:27:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/c5ba374a-821b-424c-aeaa-528a0164160e/disk 1073741824" returned: 0 in 0.057s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.205s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c5ba374a-821b-424c-aeaa-528a0164160e/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ba374a-821b-424c-aeaa-528a0164160e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:56 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Instance destroyed successfully.
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-0d1b18c5-003e-4a61-82ba-f6a49816c433 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-0d1b18c5-003e-4a61-82ba-f6a49816c433 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG nova.compute.manager [None req-0d1b18c5-003e-4a61-82ba-f6a49816c433 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG nova.compute.manager [None req-0d1b18c5-003e-4a61-82ba-f6a49816c433 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74189) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG nova.objects.instance [None req-0d1b18c5-003e-4a61-82ba-f6a49816c433 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lazy-loading 'flavor' on Instance uuid de6b6789-b328-4c3b-8d24-07774d5dbe6d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ba374a-821b-424c-aeaa-528a0164160e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Cannot resize image /opt/stack/data/nova/instances/c5ba374a-821b-424c-aeaa-528a0164160e/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Ensure instance console log exists: /opt/stack/data/nova/instances/c5ba374a-821b-424c-aeaa-528a0164160e/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:56 user nova-compute[74189]: INFO nova.compute.manager [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Detaching volume 148fadc7-8c60-4425-8451-634634e85cf1
Oct 25 21:27:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:56 user nova-compute[74189]: INFO nova.virt.block_device [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Attempting to driver detach volume 148fadc7-8c60-4425-8451-634634e85cf1 from mountpoint /dev/vdb
Oct 25 21:27:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Attempting to detach device vdb from instance 7eff6940-9675-4c89-bd28-378a5db4369f from the persistent domain config. {{(pid=74189) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:27:56 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:27:56 user nova-compute[74189]:   <source dev="/dev/sdf"/>
Oct 25 21:27:56 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:27:56 user nova-compute[74189]:   <serial>148fadc7-8c60-4425-8451-634634e85cf1</serial>
Oct 25 21:27:56 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:27:56 user nova-compute[74189]: </disk>
Oct 25 21:27:56 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:56 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Successfully detached device vdb from instance 7eff6940-9675-4c89-bd28-378a5db4369f from the persistent domain config.
Oct 25 21:27:56 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HQGOgDXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:27:56 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 21:27:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.042s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d51d4c-33dd-41fb-9d22-9d39a81d5f12]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:27:56 user nova-compute[74189]: No targets found.
Oct 25 21:27:56 user nova-compute[74189]: iSNS:
Oct 25 21:27:56 user nova-compute[74189]: No targets found.
Oct 25 21:27:56 user nova-compute[74189]: STATIC:
Oct 25 21:27:56 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a
Oct 25 21:27:56 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:27:56 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:27:56 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d
Oct 25 21:27:56 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:27:56 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:27:56 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e
Oct 25 21:27:56 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:27:56 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:27:56 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1
Oct 25 21:27:56 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:27:56 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:27:56 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:27:56 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:27:56 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:27:56 user nova-compute[74189]: FIRMWARE:
Oct 25 21:27:56 user nova-compute[74189]: No targets found.
Oct 25 21:27:56 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:27:56 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:27:56 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9adaea-8ab4-46e8-bd9e-8d8c2ad0d9a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG nova.network.neutron [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Successfully created port: d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c14270c-b62b-466c-932d-1a846ab65aa5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:27:56 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:27:56 user nova-compute[74189]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:27:56 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:27:56 user nova-compute[74189]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:27:56 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:27:56 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:27:56 user nova-compute[74189]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:27:56 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:27:56 user nova-compute[74189]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:27:56 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2e43855a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1'): ({'sdf'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Removing single pathed devices sdf {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG nova.compute.manager [req-22c157d3-150a-4ce0-9c41-d22e52331ddc req-e52e2d22-3ccc-4cb0-86d3-bffdf5dd98ea service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Received event network-vif-unplugged-b0bbbcbc-085e-476f-b600-f1d684f23beb {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-22c157d3-150a-4ce0-9c41-d22e52331ddc req-e52e2d22-3ccc-4cb0-86d3-bffdf5dd98ea service nova] Acquiring lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-22c157d3-150a-4ce0-9c41-d22e52331ddc req-e52e2d22-3ccc-4cb0-86d3-bffdf5dd98ea service nova] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-22c157d3-150a-4ce0-9c41-d22e52331ddc req-e52e2d22-3ccc-4cb0-86d3-bffdf5dd98ea service nova] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG nova.compute.manager [req-22c157d3-150a-4ce0-9c41-d22e52331ddc req-e52e2d22-3ccc-4cb0-86d3-bffdf5dd98ea service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] No waiting events found dispatching network-vif-unplugged-b0bbbcbc-085e-476f-b600-f1d684f23beb {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:27:56 user nova-compute[74189]: WARNING nova.compute.manager [req-22c157d3-150a-4ce0-9c41-d22e52331ddc req-e52e2d22-3ccc-4cb0-86d3-bffdf5dd98ea service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Received unexpected event network-vif-unplugged-b0bbbcbc-085e-476f-b600-f1d684f23beb for instance with vm_state active and task_state powering-off.
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e74183-4225-46c1-9a7e-f3aa6e7c338f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4e241c-6d4d-45cc-ab2a-61880d89f895]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Flushing IO for device /dev/sdf {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efb470d-4cce-4142-93e0-bf7dcb263f0a]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[14db1c80-1289-4c65-b904-001b34336172]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] SCSI volumes sdf have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b0b573-4149-4df0-9429-10062338e985]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fe2d53-ed83-44b0-b436-682fd05d5c9e]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1, portal: 172.16.0.220,3260]
Oct 25 21:27:56 user nova-compute[74189]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1, portal: 172.16.0.220,3260] successful.
Oct 25 21:27:56 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c626a319-3b67-48eb-bba5-4cd58f341a41]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:27:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:27:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] <== disconnect_volume: return (415ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:27:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:27:57 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Instance destroyed successfully.
Oct 25 21:27:57 user nova-compute[74189]: DEBUG nova.compute.manager [None req-0d1b18c5-003e-4a61-82ba-f6a49816c433 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:27:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-0d1b18c5-003e-4a61-82ba-f6a49816c433 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.914s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:57 user nova-compute[74189]: DEBUG nova.network.neutron [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Successfully updated port: d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:27:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "refresh_cache-c5ba374a-821b-424c-aeaa-528a0164160e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:27:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquired lock "refresh_cache-c5ba374a-821b-424c-aeaa-528a0164160e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:27:57 user nova-compute[74189]: DEBUG nova.network.neutron [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:27:57 user nova-compute[74189]: DEBUG nova.network.neutron [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.compute.manager [req-052dd2ae-4a2c-4866-8c3c-bf2aa95df4e7 req-8ebe7c59-7c5f-4e12-9852-f1370a584c46 service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Received event network-vif-plugged-b05a2001-02cd-45af-9242-3d6246edcd0b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-052dd2ae-4a2c-4866-8c3c-bf2aa95df4e7 req-8ebe7c59-7c5f-4e12-9852-f1370a584c46 service nova] Acquiring lock "7eff6940-9675-4c89-bd28-378a5db4369f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-052dd2ae-4a2c-4866-8c3c-bf2aa95df4e7 req-8ebe7c59-7c5f-4e12-9852-f1370a584c46 service nova] Lock "7eff6940-9675-4c89-bd28-378a5db4369f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-052dd2ae-4a2c-4866-8c3c-bf2aa95df4e7 req-8ebe7c59-7c5f-4e12-9852-f1370a584c46 service nova] Lock "7eff6940-9675-4c89-bd28-378a5db4369f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.compute.manager [req-052dd2ae-4a2c-4866-8c3c-bf2aa95df4e7 req-8ebe7c59-7c5f-4e12-9852-f1370a584c46 service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] No waiting events found dispatching network-vif-plugged-b05a2001-02cd-45af-9242-3d6246edcd0b {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:27:58 user nova-compute[74189]: WARNING nova.compute.manager [req-052dd2ae-4a2c-4866-8c3c-bf2aa95df4e7 req-8ebe7c59-7c5f-4e12-9852-f1370a584c46 service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Received unexpected event network-vif-plugged-b05a2001-02cd-45af-9242-3d6246edcd0b for instance with vm_state active and task_state rebuilding.
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.compute.manager [req-052dd2ae-4a2c-4866-8c3c-bf2aa95df4e7 req-8ebe7c59-7c5f-4e12-9852-f1370a584c46 service nova] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Received event network-changed-d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.compute.manager [req-052dd2ae-4a2c-4866-8c3c-bf2aa95df4e7 req-8ebe7c59-7c5f-4e12-9852-f1370a584c46 service nova] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Refreshing instance network info cache due to event network-changed-d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-052dd2ae-4a2c-4866-8c3c-bf2aa95df4e7 req-8ebe7c59-7c5f-4e12-9852-f1370a584c46 service nova] Acquiring lock "refresh_cache-c5ba374a-821b-424c-aeaa-528a0164160e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.network.neutron [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Updating instance_info_cache with network_info: [{"id": "d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b", "address": "fa:16:3e:7b:b8:af", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dcfc4c-1d", "ovs_interfaceid": "d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Releasing lock "refresh_cache-c5ba374a-821b-424c-aeaa-528a0164160e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.compute.manager [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Instance network_info: |[{"id": "d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b", "address": "fa:16:3e:7b:b8:af", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dcfc4c-1d", "ovs_interfaceid": "d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-052dd2ae-4a2c-4866-8c3c-bf2aa95df4e7 req-8ebe7c59-7c5f-4e12-9852-f1370a584c46 service nova] Acquired lock "refresh_cache-c5ba374a-821b-424c-aeaa-528a0164160e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.network.neutron [req-052dd2ae-4a2c-4866-8c3c-bf2aa95df4e7 req-8ebe7c59-7c5f-4e12-9852-f1370a584c46 service nova] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Refreshing network info cache for port d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Start _get_guest_xml network_info=[{"id": "d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b", "address": "fa:16:3e:7b:b8:af", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dcfc4c-1d", "ovs_interfaceid": "d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:27:58 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:27:58 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:27:58 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Instance destroyed successfully.
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:25:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1322492588',display_name='tempest-ServerActionsTestOtherA-server-808956216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1322492588',id=25,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5j6CMFPtaQ+NzS5oVZzUHGOr//XCKKpYtJKLFlY6kOEcPffJeLFPf99va1dycVwlGqutcJsn1c271d+g8r5i8+XkpVYF0aKK7TyDm32HptGHWvYJyfbjsyYyV3AGqK6Q==',key_name='tempest-keypair-1752245754',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:25:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4815aedea48841188ed8797a0eb51925',ramdisk_id='',reservation_id='r-o280pvx3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1355855048',owner_user_name='tempest-ServerActionsTestOtherA-1355855048-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:27:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b34817b1868f40a38a32a51d0e970d51',uuid=7eff6940-9675-4c89-bd28-378a5db4369f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b05a2001-02cd-45af-9242-3d6246edcd0b", "address": "fa:16:3e:a4:7d:bb", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb05a2001-02", "ovs_interfaceid": "b05a2001-02cd-45af-9242-3d6246edcd0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Converting VIF {"id": "b05a2001-02cd-45af-9242-3d6246edcd0b", "address": "fa:16:3e:a4:7d:bb", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb05a2001-02", "ovs_interfaceid": "b05a2001-02cd-45af-9242-3d6246edcd0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:7d:bb,bridge_name='br-int',has_traffic_filtering=True,id=b05a2001-02cd-45af-9242-3d6246edcd0b,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb05a2001-02') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG os_vif [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:7d:bb,bridge_name='br-int',has_traffic_filtering=True,id=b05a2001-02cd-45af-9242-3d6246edcd0b,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb05a2001-02') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb05a2001-02, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:27:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-886177363',display_name='tempest-AttachVolumeNegativeTest-server-886177363',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-886177363',id=29,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPk0i4o/BUWjnY3jC/r4Q6xkYzs6FPZulOXDRz3PBrGup+1NRe9oc3qb5IaV0izUzG31ibaUMwYAftiC096v1uvX2COlvgwMfPIcPCEGA6mUpBK+9VN4koM4C0EGgQ04iw==',key_name='tempest-keypair-545815208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a555d708aa644d586d5edad7db837b4',ramdisk_id='',reservation_id='r-q8a3cqch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-979681322',owner_user_name='tempest-AttachVolumeNegativeTest-979681322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:27:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2f19a398fd9486fbef04eebad62a0cb',uuid=c5ba374a-821b-424c-aeaa-528a0164160e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b", "address": "fa:16:3e:7b:b8:af", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dcfc4c-1d", "ovs_interfaceid": "d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Converting VIF {"id": "d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b", "address": "fa:16:3e:7b:b8:af", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dcfc4c-1d", "ovs_interfaceid": "d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b8:af,bridge_name='br-int',has_traffic_filtering=True,id=d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b,network=Network(5029031b-e67b-4f60-bc17-781cbdc88b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dcfc4c-1d') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.objects.instance [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lazy-loading 'pci_devices' on Instance uuid c5ba374a-821b-424c-aeaa-528a0164160e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=396f2fa7-3bed-4a47-b7df-e5e98ac858ec) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:27:58 user nova-compute[74189]:   <uuid>c5ba374a-821b-424c-aeaa-528a0164160e</uuid>
Oct 25 21:27:58 user nova-compute[74189]:   <name>instance-0000001d</name>
Oct 25 21:27:58 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:27:58 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:27:58 user nova-compute[74189]:   <metadata>
Oct 25 21:27:58 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:27:58 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:27:58 user nova-compute[74189]:       <nova:name>tempest-AttachVolumeNegativeTest-server-886177363</nova:name>
Oct 25 21:27:58 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:27:58</nova:creationTime>
Oct 25 21:27:58 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:27:58 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:27:58 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:27:58 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:27:58 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:27:58 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:27:58 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:27:58 user nova-compute[74189]:       <nova:owner>
Oct 25 21:27:58 user nova-compute[74189]:         <nova:user uuid="a2f19a398fd9486fbef04eebad62a0cb">tempest-AttachVolumeNegativeTest-979681322-project-member</nova:user>
Oct 25 21:27:58 user nova-compute[74189]:         <nova:project uuid="4a555d708aa644d586d5edad7db837b4">tempest-AttachVolumeNegativeTest-979681322</nova:project>
Oct 25 21:27:58 user nova-compute[74189]:       </nova:owner>
Oct 25 21:27:58 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:27:58 user nova-compute[74189]:       <nova:ports>
Oct 25 21:27:58 user nova-compute[74189]:         <nova:port uuid="d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b">
Oct 25 21:27:58 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 25 21:27:58 user nova-compute[74189]:         </nova:port>
Oct 25 21:27:58 user nova-compute[74189]:       </nova:ports>
Oct 25 21:27:58 user nova-compute[74189]:     </nova:instance>
Oct 25 21:27:58 user nova-compute[74189]:   </metadata>
Oct 25 21:27:58 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:27:58 user nova-compute[74189]:     <system>
Oct 25 21:27:58 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:27:58 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:27:58 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:27:58 user nova-compute[74189]:       <entry name="serial">c5ba374a-821b-424c-aeaa-528a0164160e</entry>
Oct 25 21:27:58 user nova-compute[74189]:       <entry name="uuid">c5ba374a-821b-424c-aeaa-528a0164160e</entry>
Oct 25 21:27:58 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:27:58 user nova-compute[74189]:     </system>
Oct 25 21:27:58 user nova-compute[74189]:   </sysinfo>
Oct 25 21:27:58 user nova-compute[74189]:   <os>
Oct 25 21:27:58 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:27:58 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:27:58 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:27:58 user nova-compute[74189]:   </os>
Oct 25 21:27:58 user nova-compute[74189]:   <features>
Oct 25 21:27:58 user nova-compute[74189]:     <acpi/>
Oct 25 21:27:58 user nova-compute[74189]:     <apic/>
Oct 25 21:27:58 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:27:58 user nova-compute[74189]:   </features>
Oct 25 21:27:58 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:27:58 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:27:58 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:27:58 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:27:58 user nova-compute[74189]:   </clock>
Oct 25 21:27:58 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:27:58 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:27:58 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:27:58 user nova-compute[74189]:   </cpu>
Oct 25 21:27:58 user nova-compute[74189]:   <devices>
Oct 25 21:27:58 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:27:58 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:27:58 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/c5ba374a-821b-424c-aeaa-528a0164160e/disk"/>
Oct 25 21:27:58 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:27:58 user nova-compute[74189]:     </disk>
Oct 25 21:27:58 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:27:58 user nova-compute[74189]:       <mac address="fa:16:3e:7b:b8:af"/>
Oct 25 21:27:58 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:27:58 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:27:58 user nova-compute[74189]:       <target dev="tapd0dcfc4c-1d"/>
Oct 25 21:27:58 user nova-compute[74189]:     </interface>
Oct 25 21:27:58 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:27:58 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/c5ba374a-821b-424c-aeaa-528a0164160e/console.log" append="off"/>
Oct 25 21:27:58 user nova-compute[74189]:     </serial>
Oct 25 21:27:58 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:27:58 user nova-compute[74189]:     <video>
Oct 25 21:27:58 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:27:58 user nova-compute[74189]:     </video>
Oct 25 21:27:58 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:27:58 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:27:58 user nova-compute[74189]:     </rng>
Oct 25 21:27:58 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:27:58 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:27:58 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:27:58 user nova-compute[74189]:     </memballoon>
Oct 25 21:27:58 user nova-compute[74189]:   </devices>
Oct 25 21:27:58 user nova-compute[74189]: </domain>
Oct 25 21:27:58 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:27:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-886177363',display_name='tempest-AttachVolumeNegativeTest-server-886177363',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-886177363',id=29,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPk0i4o/BUWjnY3jC/r4Q6xkYzs6FPZulOXDRz3PBrGup+1NRe9oc3qb5IaV0izUzG31ibaUMwYAftiC096v1uvX2COlvgwMfPIcPCEGA6mUpBK+9VN4koM4C0EGgQ04iw==',key_name='tempest-keypair-545815208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a555d708aa644d586d5edad7db837b4',ramdisk_id='',reservation_id='r-q8a3cqch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-979681322',owner_user_name='tempest-AttachVolumeNegativeTest-979681322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:27:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2f19a398fd9486fbef04eebad62a0cb',uuid=c5ba374a-821b-424c-aeaa-528a0164160e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b", "address": "fa:16:3e:7b:b8:af", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dcfc4c-1d", "ovs_interfaceid": "d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Converting VIF {"id": "d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b", "address": "fa:16:3e:7b:b8:af", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dcfc4c-1d", "ovs_interfaceid": "d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b8:af,bridge_name='br-int',has_traffic_filtering=True,id=d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b,network=Network(5029031b-e67b-4f60-bc17-781cbdc88b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dcfc4c-1d') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG os_vif [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b8:af,bridge_name='br-int',has_traffic_filtering=True,id=d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b,network=Network(5029031b-e67b-4f60-bc17-781cbdc88b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dcfc4c-1d') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5bda592-c5da-5947-b5f9-5db3e681048a', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:27:58 user nova-compute[74189]: INFO os_vif [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:7d:bb,bridge_name='br-int',has_traffic_filtering=True,id=b05a2001-02cd-45af-9242-3d6246edcd0b,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb05a2001-02')
Oct 25 21:27:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HQGOgDXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:27:58 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 21:27:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0dcfc4c-1d, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0dcfc4c-1d, col_values=(('qos', UUID('9bae8659-b9bf-4921-aeca-4802d45258df')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0dcfc4c-1d, col_values=(('external_ids', {'iface-id': 'd0dcfc4c-1d4e-4aa5-b430-4117e7bc058b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:b8:af', 'vm-uuid': 'c5ba374a-821b-424c-aeaa-528a0164160e'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[43445816-31da-486f-afde-bc86d2c95ea0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:27:58 user nova-compute[74189]: No targets found.
Oct 25 21:27:58 user nova-compute[74189]: iSNS:
Oct 25 21:27:58 user nova-compute[74189]: No targets found.
Oct 25 21:27:58 user nova-compute[74189]: STATIC:
Oct 25 21:27:58 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a
Oct 25 21:27:58 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:27:58 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:27:58 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d
Oct 25 21:27:58 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:27:58 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:27:58 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e
Oct 25 21:27:58 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:27:58 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:27:58 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:27:58 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:27:58 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:27:58 user nova-compute[74189]: FIRMWARE:
Oct 25 21:27:58 user nova-compute[74189]: No targets found.
Oct 25 21:27:58 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:27:58 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:27:58 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:58 user nova-compute[74189]: INFO os_vif [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b8:af,bridge_name='br-int',has_traffic_filtering=True,id=d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b,network=Network(5029031b-e67b-4f60-bc17-781cbdc88b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dcfc4c-1d')
Oct 25 21:27:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e60c0f-706b-4b07-a47f-82b57b4e3ab5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee8a443-ace7-4f41-b9a3-e1fb89f24740]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:27:58 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:27:58 user nova-compute[74189]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:27:58 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:27:58 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:27:58 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:27:58 user nova-compute[74189]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:27:58 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:27:58 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3044b3c70>, {}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Disconnecting from: [] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.092s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] <== disconnect_volume: return (93ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:27:58 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Deleting instance files /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f_del
Oct 25 21:27:58 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Deletion of /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f_del complete
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] No VIF found with MAC fa:16:3e:7b:b8:af, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:58 user nova-compute[74189]: INFO nova.virt.block_device [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Booting with volume 148fadc7-8c60-4425-8451-634634e85cf1 at /dev/vdb
Oct 25 21:27:58 user nova-compute[74189]: DEBUG os_brick.utils [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e53f62-7db4-408c-8966-864d9a67ad9e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.network.neutron [req-052dd2ae-4a2c-4866-8c3c-bf2aa95df4e7 req-8ebe7c59-7c5f-4e12-9852-f1370a584c46 service nova] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Updated VIF entry in instance network info cache for port d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.network.neutron [req-052dd2ae-4a2c-4866-8c3c-bf2aa95df4e7 req-8ebe7c59-7c5f-4e12-9852-f1370a584c46 service nova] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Updating instance_info_cache with network_info: [{"id": "d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b", "address": "fa:16:3e:7b:b8:af", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dcfc4c-1d", "ovs_interfaceid": "d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-052dd2ae-4a2c-4866-8c3c-bf2aa95df4e7 req-8ebe7c59-7c5f-4e12-9852-f1370a584c46 service nova] Releasing lock "refresh_cache-c5ba374a-821b-424c-aeaa-528a0164160e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.029s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52a7faa-4852-48ad-9f65-397a96406e44]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27ee0db-3068-41e9-ad0a-3a70e43f323d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3f129d-ce64-47a1-864e-6765fe5cf980]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:27:58 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:27:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1556a6ee-0720-48e4-a430-f9ac7037b417]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG os_brick.utils [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Updating existing volume attachment record: 6544ce86-92ab-4612-b8a4-b8a71f17f0ad {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.compute.manager [req-b1f62226-3e95-479c-b3c3-db4b9765d276 req-75fdd38b-2e5b-4541-9fee-990a4db36b45 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Received event network-vif-plugged-b0bbbcbc-085e-476f-b600-f1d684f23beb {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b1f62226-3e95-479c-b3c3-db4b9765d276 req-75fdd38b-2e5b-4541-9fee-990a4db36b45 service nova] Acquiring lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b1f62226-3e95-479c-b3c3-db4b9765d276 req-75fdd38b-2e5b-4541-9fee-990a4db36b45 service nova] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b1f62226-3e95-479c-b3c3-db4b9765d276 req-75fdd38b-2e5b-4541-9fee-990a4db36b45 service nova] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:27:58 user nova-compute[74189]: DEBUG nova.compute.manager [req-b1f62226-3e95-479c-b3c3-db4b9765d276 req-75fdd38b-2e5b-4541-9fee-990a4db36b45 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] No waiting events found dispatching network-vif-plugged-b0bbbcbc-085e-476f-b600-f1d684f23beb {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:27:58 user nova-compute[74189]: WARNING nova.compute.manager [req-b1f62226-3e95-479c-b3c3-db4b9765d276 req-75fdd38b-2e5b-4541-9fee-990a4db36b45 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Received unexpected event network-vif-plugged-b0bbbcbc-085e-476f-b600-f1d684f23beb for instance with vm_state stopped and task_state None.
Oct 25 21:27:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:27:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:00 user nova-compute[74189]: DEBUG nova.compute.manager [req-d60d130e-5c91-4230-bec0-5ca25cb6e400 req-89716553-ddb7-4f87-be91-e7c3fdb75949 service nova] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Received event network-vif-plugged-d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:28:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d60d130e-5c91-4230-bec0-5ca25cb6e400 req-89716553-ddb7-4f87-be91-e7c3fdb75949 service nova] Acquiring lock "c5ba374a-821b-424c-aeaa-528a0164160e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:28:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d60d130e-5c91-4230-bec0-5ca25cb6e400 req-89716553-ddb7-4f87-be91-e7c3fdb75949 service nova] Lock "c5ba374a-821b-424c-aeaa-528a0164160e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:28:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d60d130e-5c91-4230-bec0-5ca25cb6e400 req-89716553-ddb7-4f87-be91-e7c3fdb75949 service nova] Lock "c5ba374a-821b-424c-aeaa-528a0164160e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:28:00 user nova-compute[74189]: DEBUG nova.compute.manager [req-d60d130e-5c91-4230-bec0-5ca25cb6e400 req-89716553-ddb7-4f87-be91-e7c3fdb75949 service nova] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] No waiting events found dispatching network-vif-plugged-d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:28:00 user nova-compute[74189]: WARNING nova.compute.manager [req-d60d130e-5c91-4230-bec0-5ca25cb6e400 req-89716553-ddb7-4f87-be91-e7c3fdb75949 service nova] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Received unexpected event network-vif-plugged-d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b for instance with vm_state building and task_state spawning.
Oct 25 21:28:00 user nova-compute[74189]: DEBUG nova.compute.manager [req-d60d130e-5c91-4230-bec0-5ca25cb6e400 req-89716553-ddb7-4f87-be91-e7c3fdb75949 service nova] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Received event network-vif-plugged-d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:28:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d60d130e-5c91-4230-bec0-5ca25cb6e400 req-89716553-ddb7-4f87-be91-e7c3fdb75949 service nova] Acquiring lock "c5ba374a-821b-424c-aeaa-528a0164160e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:28:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d60d130e-5c91-4230-bec0-5ca25cb6e400 req-89716553-ddb7-4f87-be91-e7c3fdb75949 service nova] Lock "c5ba374a-821b-424c-aeaa-528a0164160e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:28:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d60d130e-5c91-4230-bec0-5ca25cb6e400 req-89716553-ddb7-4f87-be91-e7c3fdb75949 service nova] Lock "c5ba374a-821b-424c-aeaa-528a0164160e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:28:00 user nova-compute[74189]: DEBUG nova.compute.manager [req-d60d130e-5c91-4230-bec0-5ca25cb6e400 req-89716553-ddb7-4f87-be91-e7c3fdb75949 service nova] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] No waiting events found dispatching network-vif-plugged-d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:28:00 user nova-compute[74189]: WARNING nova.compute.manager [req-d60d130e-5c91-4230-bec0-5ca25cb6e400 req-89716553-ddb7-4f87-be91-e7c3fdb75949 service nova] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Received unexpected event network-vif-plugged-d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b for instance with vm_state building and task_state spawning.
Oct 25 21:28:02 user nova-compute[74189]: DEBUG nova.compute.manager [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:28:02 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:28:02 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Instance spawned successfully.
Oct 25 21:28:02 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:28:02 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:28:02 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:28:02 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:28:02 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:28:02 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:28:02 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:28:02 user nova-compute[74189]: INFO nova.compute.manager [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Took 6.72 seconds to spawn the instance on the hypervisor.
Oct 25 21:28:02 user nova-compute[74189]: DEBUG nova.compute.manager [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:28:02 user nova-compute[74189]: INFO nova.compute.manager [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Took 7.65 seconds to build instance.
Oct 25 21:28:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-52b3935c-1457-4878-a0bf-5c955689f125 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "c5ba374a-821b-424c-aeaa-528a0164160e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.772s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:28:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:04 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:28:07 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:28:07 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:28:07 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Rebuilding the list of instances to heal {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 21:28:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-d7c3a99a-ab38-4e88-896d-94ae51a09a48" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:28:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-d7c3a99a-ab38-4e88-896d-94ae51a09a48" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:28:07 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:28:07 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lazy-loading 'info_cache' on Instance uuid d7c3a99a-ab38-4e88-896d-94ae51a09a48 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:28:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:08 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Updating instance_info_cache with network_info: [{"id": "44169902-69da-4fe1-8292-a23e0ff15fc7", "address": "fa:16:3e:b9:37:c6", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44169902-69", "ovs_interfaceid": "44169902-69da-4fe1-8292-a23e0ff15fc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:28:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-d7c3a99a-ab38-4e88-896d-94ae51a09a48" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:28:08 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:28:08 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:28:08 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:28:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:28:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:28:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:28:08 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:28:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:10 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:28:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ba374a-821b-424c-aeaa-528a0164160e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ba374a-821b-424c-aeaa-528a0164160e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ba374a-821b-424c-aeaa-528a0164160e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ba374a-821b-424c-aeaa-528a0164160e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:11 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:28:11 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:28:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:28:12 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:28:12 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:28:12 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=7356MB free_disk=24.935070037841797GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:28:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:28:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:28:12 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance d7c3a99a-ab38-4e88-896d-94ae51a09a48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:28:12 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance af1d7b3c-9950-4b74-8f15-b31011ccfa24 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:28:12 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance de6b6789-b328-4c3b-8d24-07774d5dbe6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:28:12 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 932fe8ac-fdde-45c6-aa32-9bf866f19a4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:28:12 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 75071d8a-2ce2-43b5-99f6-23853399dc97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:28:12 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 0b4f80c4-98cc-440a-aac7-cd423b71a231 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:28:12 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:28:12 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 7eff6940-9675-4c89-bd28-378a5db4369f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:28:12 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance cdb13b8f-c136-4f2b-95b9-e464babac28a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:28:12 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance d6e14e1a-6ef7-4a47-afc7-096326de8f5e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:28:12 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 9a15fb16-8623-4a20-ae26-5f0aab29ec07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:28:12 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance c5ba374a-821b-424c-aeaa-528a0164160e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:28:12 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:28:12 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:28:13 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:28:13 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:28:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:13 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:28:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.536s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:28:13 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:28:13 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:28:13 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:28:13 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:28:13 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:28:13 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:28:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:28:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:28:16 user nova-compute[74189]: DEBUG nova.compute.manager [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:28:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:28:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:28:16 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:28:16 user nova-compute[74189]: INFO nova.compute.claims [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Claim successful on node user
Oct 25 21:28:17 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:28:17 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:28:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:28:17 user nova-compute[74189]: DEBUG nova.compute.manager [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:28:17 user nova-compute[74189]: DEBUG nova.compute.manager [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:28:17 user nova-compute[74189]: DEBUG nova.network.neutron [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:28:17 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:28:17 user nova-compute[74189]: DEBUG nova.compute.manager [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:28:17 user nova-compute[74189]: DEBUG nova.policy [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc377c1beaab443683a6d776f2f734ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acbb4f93936848a8949477ad124bf98e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:28:17 user nova-compute[74189]: INFO nova.virt.block_device [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Booting with volume-backed-image 30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd at /dev/vda
Oct 25 21:28:18 user nova-compute[74189]: DEBUG nova.network.neutron [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Successfully created port: 005bac46-8900-46a0-bb7f-d8672c6d2fc1 {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:28:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:28:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:18 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:28:18 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Creating image(s)
Oct 25 21:28:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "/opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:28:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "/opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:28:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "/opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:28:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.209s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:28:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:28:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:18 user nova-compute[74189]: DEBUG nova.network.neutron [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Successfully updated port: 005bac46-8900-46a0-bb7f-d8672c6d2fc1 {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:28:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "refresh_cache-9733d5c8-4476-4903-bd1b-16d43a54fdbd" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:28:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquired lock "refresh_cache-9733d5c8-4476-4903-bd1b-16d43a54fdbd" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:28:18 user nova-compute[74189]: DEBUG nova.network.neutron [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:28:18 user nova-compute[74189]: DEBUG nova.compute.manager [req-615293b7-7aba-488a-8ddd-992bd2b6f0f6 req-0078aa5c-9f7b-4279-8c1f-3f0a0c91eb8b service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Received event network-changed-005bac46-8900-46a0-bb7f-d8672c6d2fc1 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:28:18 user nova-compute[74189]: DEBUG nova.compute.manager [req-615293b7-7aba-488a-8ddd-992bd2b6f0f6 req-0078aa5c-9f7b-4279-8c1f-3f0a0c91eb8b service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Refreshing instance network info cache due to event network-changed-005bac46-8900-46a0-bb7f-d8672c6d2fc1. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:28:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-615293b7-7aba-488a-8ddd-992bd2b6f0f6 req-0078aa5c-9f7b-4279-8c1f-3f0a0c91eb8b service nova] Acquiring lock "refresh_cache-9733d5c8-4476-4903-bd1b-16d43a54fdbd" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:28:18 user nova-compute[74189]: DEBUG nova.network.neutron [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:28:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.189s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk 1073741824" returned: 0 in 0.054s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:28:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.181s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG nova.network.neutron [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Updating instance_info_cache with network_info: [{"id": "005bac46-8900-46a0-bb7f-d8672c6d2fc1", "address": "fa:16:3e:1d:ce:94", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap005bac46-89", "ovs_interfaceid": "005bac46-8900-46a0-bb7f-d8672c6d2fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Releasing lock "refresh_cache-9733d5c8-4476-4903-bd1b-16d43a54fdbd" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG nova.compute.manager [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Instance network_info: |[{"id": "005bac46-8900-46a0-bb7f-d8672c6d2fc1", "address": "fa:16:3e:1d:ce:94", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap005bac46-89", "ovs_interfaceid": "005bac46-8900-46a0-bb7f-d8672c6d2fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-615293b7-7aba-488a-8ddd-992bd2b6f0f6 req-0078aa5c-9f7b-4279-8c1f-3f0a0c91eb8b service nova] Acquired lock "refresh_cache-9733d5c8-4476-4903-bd1b-16d43a54fdbd" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG nova.network.neutron [req-615293b7-7aba-488a-8ddd-992bd2b6f0f6 req-0078aa5c-9f7b-4279-8c1f-3f0a0c91eb8b service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Refreshing network info cache for port 005bac46-8900-46a0-bb7f-d8672c6d2fc1 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Cannot resize image /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Ensure instance console log exists: /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Start _get_guest_xml network_info=[{"id": "b05a2001-02cd-45af-9242-3d6246edcd0b", "address": "fa:16:3e:a4:7d:bb", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb05a2001-02", "ovs_interfaceid": "b05a2001-02cd-45af-9242-3d6246edcd0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HQGOgDXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7eff6940-9675-4c89-bd28-378a5db4369f', 'attached_at': '', 'detached_at': '', 'volume_id': '148fadc7-8c60-4425-8451-634634e85cf1', 'serial': '148fadc7-8c60-4425-8451-634634e85cf1'}, 'attachment_id': '6544ce86-92ab-4612-b8a4-b8a71f17f0ad', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:28:19 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 25 21:28:19 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 25 21:28:19 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG nova.objects.instance [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7eff6940-9675-4c89-bd28-378a5db4369f {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HQGOgDXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:28:19 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 21:28:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:28:19 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 21:28:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:28:19 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[342e4a42-7777-40a8-8601-388870f076ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:28:19 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[de78caa4-073c-44df-9685-a431c9af42b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1] added
Oct 25 21:28:19 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[703ca37e-a98d-4214-a792-c9607c77c3ca]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbf9382-580d-4426-9d92-920f0a7fdde5]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HQGOgDXa {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HQGOgDXa" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ff8e17-42a4-44a9-8c26-ae78a89b1325]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HQGOgDXa'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[164d2c3a-0998-4b83-8c8f-4cf7f40c4dd4]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc5a0cf-a38b-4c28-899e-d03279b57fb6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:28:19 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:28:19 user nova-compute[74189]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:28:19 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:28:19 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:28:19 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:28:19 user nova-compute[74189]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:28:19 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:28:19 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16ae1a0-326c-41bc-8b44-17edf31a9593]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1, portal: 172.16.0.220,3260]
Oct 25 21:28:19 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1, portal: 172.16.0.220,3260] successful.
Oct 25 21:28:19 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9216c4a3-3eb8-47c4-a24b-280d3b7c032d]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e77b7b-6a9b-49a8-819d-72b8e4fff31e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:28:19 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:28:19 user nova-compute[74189]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:28:19 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:28:19 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:28:19 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:28:19 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:28:19 user nova-compute[74189]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:28:19 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:28:19 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:28:19 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72ada01-c171-47a7-9938-65c222314789]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: None {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG nova.network.neutron [req-615293b7-7aba-488a-8ddd-992bd2b6f0f6 req-0078aa5c-9f7b-4279-8c1f-3f0a0c91eb8b service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Updated VIF entry in instance network info cache for port 005bac46-8900-46a0-bb7f-d8672c6d2fc1. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:28:19 user nova-compute[74189]: DEBUG nova.network.neutron [req-615293b7-7aba-488a-8ddd-992bd2b6f0f6 req-0078aa5c-9f7b-4279-8c1f-3f0a0c91eb8b service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Updating instance_info_cache with network_info: [{"id": "005bac46-8900-46a0-bb7f-d8672c6d2fc1", "address": "fa:16:3e:1d:ce:94", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap005bac46-89", "ovs_interfaceid": "005bac46-8900-46a0-bb7f-d8672c6d2fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:28:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-615293b7-7aba-488a-8ddd-992bd2b6f0f6 req-0078aa5c-9f7b-4279-8c1f-3f0a0c91eb8b service nova] Releasing lock "refresh_cache-9733d5c8-4476-4903-bd1b-16d43a54fdbd" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:28:20 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:28:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HQGOgDXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:28:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:28:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23431663938383263', 'path': '/dev/sdc'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:28:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431663938383263', 'path': '/dev/sdc'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:28:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T21:25:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1322492588',display_name='tempest-ServerActionsTestOtherA-server-808956216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1322492588',id=25,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5j6CMFPtaQ+NzS5oVZzUHGOr//XCKKpYtJKLFlY6kOEcPffJeLFPf99va1dycVwlGqutcJsn1c271d+g8r5i8+XkpVYF0aKK7TyDm32HptGHWvYJyfbjsyYyV3AGqK6Q==',key_name='tempest-keypair-1752245754',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:25:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4815aedea48841188ed8797a0eb51925',ramdisk_id='',reservation_id='r-o280pvx3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1355855048',owner_user_name='tempest-ServerActionsTestOtherA-1355855048-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:27:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b34817b1868f40a38a32a51d0e970d51',uuid=7eff6940-9675-4c89-bd28-378a5db4369f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b05a2001-02cd-45af-9242-3d6246edcd0b", "address": "fa:16:3e:a4:7d:bb", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb05a2001-02", "ovs_interfaceid": "b05a2001-02cd-45af-9242-3d6246edcd0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:28:20 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Converting VIF {"id": "b05a2001-02cd-45af-9242-3d6246edcd0b", "address": "fa:16:3e:a4:7d:bb", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb05a2001-02", "ovs_interfaceid": "b05a2001-02cd-45af-9242-3d6246edcd0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:28:20 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:7d:bb,bridge_name='br-int',has_traffic_filtering=True,id=b05a2001-02cd-45af-9242-3d6246edcd0b,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb05a2001-02') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:28:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:28:20 user nova-compute[74189]:   <uuid>7eff6940-9675-4c89-bd28-378a5db4369f</uuid>
Oct 25 21:28:20 user nova-compute[74189]:   <name>instance-00000019</name>
Oct 25 21:28:20 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:28:20 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:28:20 user nova-compute[74189]:   <metadata>
Oct 25 21:28:20 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:28:20 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:28:20 user nova-compute[74189]:       <nova:name>tempest-ServerActionsTestOtherA-server-808956216</nova:name>
Oct 25 21:28:20 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:28:19</nova:creationTime>
Oct 25 21:28:20 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:28:20 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:28:20 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:28:20 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:28:20 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:28:20 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:28:20 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:28:20 user nova-compute[74189]:       <nova:owner>
Oct 25 21:28:20 user nova-compute[74189]:         <nova:user uuid="b34817b1868f40a38a32a51d0e970d51">tempest-ServerActionsTestOtherA-1355855048-project-member</nova:user>
Oct 25 21:28:20 user nova-compute[74189]:         <nova:project uuid="4815aedea48841188ed8797a0eb51925">tempest-ServerActionsTestOtherA-1355855048</nova:project>
Oct 25 21:28:20 user nova-compute[74189]:       </nova:owner>
Oct 25 21:28:20 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:28:20 user nova-compute[74189]:       <nova:ports>
Oct 25 21:28:20 user nova-compute[74189]:         <nova:port uuid="b05a2001-02cd-45af-9242-3d6246edcd0b">
Oct 25 21:28:20 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 21:28:20 user nova-compute[74189]:         </nova:port>
Oct 25 21:28:20 user nova-compute[74189]:       </nova:ports>
Oct 25 21:28:20 user nova-compute[74189]:     </nova:instance>
Oct 25 21:28:20 user nova-compute[74189]:   </metadata>
Oct 25 21:28:20 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:28:20 user nova-compute[74189]:     <system>
Oct 25 21:28:20 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:28:20 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:28:20 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:28:20 user nova-compute[74189]:       <entry name="serial">7eff6940-9675-4c89-bd28-378a5db4369f</entry>
Oct 25 21:28:20 user nova-compute[74189]:       <entry name="uuid">7eff6940-9675-4c89-bd28-378a5db4369f</entry>
Oct 25 21:28:20 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:28:20 user nova-compute[74189]:     </system>
Oct 25 21:28:20 user nova-compute[74189]:   </sysinfo>
Oct 25 21:28:20 user nova-compute[74189]:   <os>
Oct 25 21:28:20 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:28:20 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:28:20 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:28:20 user nova-compute[74189]:   </os>
Oct 25 21:28:20 user nova-compute[74189]:   <features>
Oct 25 21:28:20 user nova-compute[74189]:     <acpi/>
Oct 25 21:28:20 user nova-compute[74189]:     <apic/>
Oct 25 21:28:20 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:28:20 user nova-compute[74189]:   </features>
Oct 25 21:28:20 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:28:20 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:28:20 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:28:20 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:28:20 user nova-compute[74189]:   </clock>
Oct 25 21:28:20 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:28:20 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:28:20 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:28:20 user nova-compute[74189]:   </cpu>
Oct 25 21:28:20 user nova-compute[74189]:   <devices>
Oct 25 21:28:20 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:28:20 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:28:20 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk"/>
Oct 25 21:28:20 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:28:20 user nova-compute[74189]:     </disk>
Oct 25 21:28:20 user nova-compute[74189]:     <disk type="block" device="disk">
Oct 25 21:28:20 user nova-compute[74189]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:28:20 user nova-compute[74189]:       <source dev="/dev/sdc"/>
Oct 25 21:28:20 user nova-compute[74189]:       <target dev="vdb" bus="virtio"/>
Oct 25 21:28:20 user nova-compute[74189]:       <serial>148fadc7-8c60-4425-8451-634634e85cf1</serial>
Oct 25 21:28:20 user nova-compute[74189]:     </disk>
Oct 25 21:28:20 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:28:20 user nova-compute[74189]:       <mac address="fa:16:3e:a4:7d:bb"/>
Oct 25 21:28:20 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:28:20 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:28:20 user nova-compute[74189]:       <target dev="tapb05a2001-02"/>
Oct 25 21:28:20 user nova-compute[74189]:     </interface>
Oct 25 21:28:20 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:28:20 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/console.log" append="off"/>
Oct 25 21:28:20 user nova-compute[74189]:     </serial>
Oct 25 21:28:20 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:28:20 user nova-compute[74189]:     <video>
Oct 25 21:28:20 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:28:20 user nova-compute[74189]:     </video>
Oct 25 21:28:20 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:28:20 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:28:20 user nova-compute[74189]:     </rng>
Oct 25 21:28:20 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:28:20 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:28:20 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:28:20 user nova-compute[74189]:     </memballoon>
Oct 25 21:28:20 user nova-compute[74189]:   </devices>
Oct 25 21:28:20 user nova-compute[74189]: </domain>
Oct 25 21:28:20 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:28:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T21:25:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1322492588',display_name='tempest-ServerActionsTestOtherA-server-808956216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1322492588',id=25,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5j6CMFPtaQ+NzS5oVZzUHGOr//XCKKpYtJKLFlY6kOEcPffJeLFPf99va1dycVwlGqutcJsn1c271d+g8r5i8+XkpVYF0aKK7TyDm32HptGHWvYJyfbjsyYyV3AGqK6Q==',key_name='tempest-keypair-1752245754',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:25:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4815aedea48841188ed8797a0eb51925',ramdisk_id='',reservation_id='r-o280pvx3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1355855048',owner_user_name='tempest-ServerActionsTestOtherA-1355855048-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:27:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b34817b1868f40a38a32a51d0e970d51',uuid=7eff6940-9675-4c89-bd28-378a5db4369f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b05a2001-02cd-45af-9242-3d6246edcd0b", "address": "fa:16:3e:a4:7d:bb", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb05a2001-02", "ovs_interfaceid": "b05a2001-02cd-45af-9242-3d6246edcd0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:28:20 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Converting VIF {"id": "b05a2001-02cd-45af-9242-3d6246edcd0b", "address": "fa:16:3e:a4:7d:bb", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb05a2001-02", "ovs_interfaceid": "b05a2001-02cd-45af-9242-3d6246edcd0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:28:20 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:7d:bb,bridge_name='br-int',has_traffic_filtering=True,id=b05a2001-02cd-45af-9242-3d6246edcd0b,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb05a2001-02') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:28:20 user nova-compute[74189]: DEBUG os_vif [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:7d:bb,bridge_name='br-int',has_traffic_filtering=True,id=b05a2001-02cd-45af-9242-3d6246edcd0b,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb05a2001-02') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:28:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:28:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:28:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b7555bea-e492-5617-a085-8f3e45d3e796', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:28:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:28:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb05a2001-02, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:28:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb05a2001-02, col_values=(('qos', UUID('45677459-69e1-46e8-972f-dcb80a416a17')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:28:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb05a2001-02, col_values=(('external_ids', {'iface-id': 'b05a2001-02cd-45af-9242-3d6246edcd0b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:7d:bb', 'vm-uuid': '7eff6940-9675-4c89-bd28-378a5db4369f'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:28:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:28:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:20 user nova-compute[74189]: INFO os_vif [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:7d:bb,bridge_name='br-int',has_traffic_filtering=True,id=b05a2001-02cd-45af-9242-3d6246edcd0b,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb05a2001-02')
Oct 25 21:28:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:28:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:28:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] No VIF found with MAC fa:16:3e:a4:7d:bb, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:28:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:22 user nova-compute[74189]: INFO nova.compute.manager [None req-7fa7cfcc-46ec-4e53-bf93-c1e8689987ed tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Unrescuing
Oct 25 21:28:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7fa7cfcc-46ec-4e53-bf93-c1e8689987ed tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Acquiring lock "refresh_cache-75071d8a-2ce2-43b5-99f6-23853399dc97" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:28:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7fa7cfcc-46ec-4e53-bf93-c1e8689987ed tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Acquired lock "refresh_cache-75071d8a-2ce2-43b5-99f6-23853399dc97" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:28:22 user nova-compute[74189]: DEBUG nova.network.neutron [None req-7fa7cfcc-46ec-4e53-bf93-c1e8689987ed tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:28:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:22 user nova-compute[74189]: DEBUG nova.compute.manager [req-e17f8bf6-49d8-4188-afd4-cb7bb590d661 req-030d09e4-c482-4761-a4e0-75612dbe5064 service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Received event network-vif-plugged-b05a2001-02cd-45af-9242-3d6246edcd0b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:28:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e17f8bf6-49d8-4188-afd4-cb7bb590d661 req-030d09e4-c482-4761-a4e0-75612dbe5064 service nova] Acquiring lock "7eff6940-9675-4c89-bd28-378a5db4369f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:28:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e17f8bf6-49d8-4188-afd4-cb7bb590d661 req-030d09e4-c482-4761-a4e0-75612dbe5064 service nova] Lock "7eff6940-9675-4c89-bd28-378a5db4369f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:28:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e17f8bf6-49d8-4188-afd4-cb7bb590d661 req-030d09e4-c482-4761-a4e0-75612dbe5064 service nova] Lock "7eff6940-9675-4c89-bd28-378a5db4369f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:28:22 user nova-compute[74189]: DEBUG nova.compute.manager [req-e17f8bf6-49d8-4188-afd4-cb7bb590d661 req-030d09e4-c482-4761-a4e0-75612dbe5064 service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] No waiting events found dispatching network-vif-plugged-b05a2001-02cd-45af-9242-3d6246edcd0b {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:28:22 user nova-compute[74189]: WARNING nova.compute.manager [req-e17f8bf6-49d8-4188-afd4-cb7bb590d661 req-030d09e4-c482-4761-a4e0-75612dbe5064 service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Received unexpected event network-vif-plugged-b05a2001-02cd-45af-9242-3d6246edcd0b for instance with vm_state active and task_state rebuild_spawning.
Oct 25 21:28:23 user nova-compute[74189]: DEBUG nova.network.neutron [None req-7fa7cfcc-46ec-4e53-bf93-c1e8689987ed tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Updating instance_info_cache with network_info: [{"id": "54123e00-9921-4807-b1f7-79073453a82f", "address": "fa:16:3e:02:6a:1d", "network": {"id": "3159e1a7-f60f-4768-9e06-a92287d19dd6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-119288589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046417147a924afdbc8b72333c362261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54123e00-99", "ovs_interfaceid": "54123e00-9921-4807-b1f7-79073453a82f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:28:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7fa7cfcc-46ec-4e53-bf93-c1e8689987ed tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Releasing lock "refresh_cache-75071d8a-2ce2-43b5-99f6-23853399dc97" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:28:23 user nova-compute[74189]: DEBUG nova.objects.instance [None req-7fa7cfcc-46ec-4e53-bf93-c1e8689987ed tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lazy-loading 'flavor' on Instance uuid 75071d8a-2ce2-43b5-99f6-23853399dc97 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:28:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:23 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Instance destroyed successfully.
Oct 25 21:28:24 user nova-compute[74189]: DEBUG nova.compute.manager [req-7533beca-3987-4998-b416-f6999262419e req-723c66dc-a3ef-4fbf-aa27-7d66929225f0 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Received event network-vif-unplugged-54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:28:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7533beca-3987-4998-b416-f6999262419e req-723c66dc-a3ef-4fbf-aa27-7d66929225f0 service nova] Acquiring lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:28:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7533beca-3987-4998-b416-f6999262419e req-723c66dc-a3ef-4fbf-aa27-7d66929225f0 service nova] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:28:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7533beca-3987-4998-b416-f6999262419e req-723c66dc-a3ef-4fbf-aa27-7d66929225f0 service nova] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:28:24 user nova-compute[74189]: DEBUG nova.compute.manager [req-7533beca-3987-4998-b416-f6999262419e req-723c66dc-a3ef-4fbf-aa27-7d66929225f0 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] No waiting events found dispatching network-vif-unplugged-54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:28:24 user nova-compute[74189]: WARNING nova.compute.manager [req-7533beca-3987-4998-b416-f6999262419e req-723c66dc-a3ef-4fbf-aa27-7d66929225f0 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Received unexpected event network-vif-unplugged-54123e00-9921-4807-b1f7-79073453a82f for instance with vm_state rescued and task_state unrescuing.
Oct 25 21:28:24 user nova-compute[74189]: DEBUG nova.compute.manager [req-6677aa69-51c0-4047-92b3-bbb17757e214 req-7a738b5c-a78a-47d5-ad66-16dc3bda4dd6 service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Received event network-vif-plugged-b05a2001-02cd-45af-9242-3d6246edcd0b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:28:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-6677aa69-51c0-4047-92b3-bbb17757e214 req-7a738b5c-a78a-47d5-ad66-16dc3bda4dd6 service nova] Acquiring lock "7eff6940-9675-4c89-bd28-378a5db4369f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:28:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-6677aa69-51c0-4047-92b3-bbb17757e214 req-7a738b5c-a78a-47d5-ad66-16dc3bda4dd6 service nova] Lock "7eff6940-9675-4c89-bd28-378a5db4369f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:28:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-6677aa69-51c0-4047-92b3-bbb17757e214 req-7a738b5c-a78a-47d5-ad66-16dc3bda4dd6 service nova] Lock "7eff6940-9675-4c89-bd28-378a5db4369f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:28:24 user nova-compute[74189]: DEBUG nova.compute.manager [req-6677aa69-51c0-4047-92b3-bbb17757e214 req-7a738b5c-a78a-47d5-ad66-16dc3bda4dd6 service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] No waiting events found dispatching network-vif-plugged-b05a2001-02cd-45af-9242-3d6246edcd0b {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:28:24 user nova-compute[74189]: WARNING nova.compute.manager [req-6677aa69-51c0-4047-92b3-bbb17757e214 req-7a738b5c-a78a-47d5-ad66-16dc3bda4dd6 service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Received unexpected event network-vif-plugged-b05a2001-02cd-45af-9242-3d6246edcd0b for instance with vm_state active and task_state rebuild_spawning.
Oct 25 21:28:24 user nova-compute[74189]: DEBUG nova.compute.manager [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:28:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:28:24 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Instance spawned successfully.
Oct 25 21:28:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:28:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:28:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:28:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:28:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:28:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:28:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:28:24 user nova-compute[74189]: DEBUG nova.compute.manager [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:28:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:28:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:28:25 user nova-compute[74189]: DEBUG nova.objects.instance [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74189) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 25 21:28:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-697978cd-3320-4b4c-a359-ed33c3f9ba73 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.085s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:28:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-731673dc-102b-404f-9ade-5057840e2891 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Acquiring lock "f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:28:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-731673dc-102b-404f-9ade-5057840e2891 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Lock "f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:28:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-731673dc-102b-404f-9ade-5057840e2891 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Acquiring lock "f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:28:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-731673dc-102b-404f-9ade-5057840e2891 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Lock "f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:28:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-731673dc-102b-404f-9ade-5057840e2891 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Lock "f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:28:25 user nova-compute[74189]: INFO nova.compute.manager [None req-731673dc-102b-404f-9ade-5057840e2891 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Terminating instance
Oct 25 21:28:25 user nova-compute[74189]: DEBUG nova.compute.manager [None req-731673dc-102b-404f-9ade-5057840e2891 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:28:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:26 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Instance destroyed successfully.
Oct 25 21:28:26 user nova-compute[74189]: DEBUG nova.objects.instance [None req-731673dc-102b-404f-9ade-5057840e2891 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Lazy-loading 'resources' on Instance uuid f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-731673dc-102b-404f-9ade-5057840e2891 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:25:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1896830380',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1896830380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1896830',id=23,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmdmBlruzeO69b8Enhlo/WWJ0YMqZf3SEYOGNZgxbWOywXnXBY/txc7D1d00anmQoDKjG8hFHQyPcD7dAMqs7daE2pOCU7qcWVUQzQTxtvJrYb3LxLj5ggpAb+3qXxJAA==',key_name='tempest-keypair-103280081',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:25:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7fc56f5ca1b142d199c360c89d552569',ramdisk_id='',reservation_id='r-lmknv7mt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-758874110',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:25:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='581bc72458b64b3184021d2b39c96bac',uuid=f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3fce63c-7b53-4a74-ad26-0e547a9643a0", "address": "fa:16:3e:27:ed:f4", "network": {"id": "a10206fb-faee-4e14-9b44-b5e9274f7c92", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-96164946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fc56f5ca1b142d199c360c89d552569", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fce63c-7b", "ovs_interfaceid": "b3fce63c-7b53-4a74-ad26-0e547a9643a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-731673dc-102b-404f-9ade-5057840e2891 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Converting VIF {"id": "b3fce63c-7b53-4a74-ad26-0e547a9643a0", "address": "fa:16:3e:27:ed:f4", "network": {"id": "a10206fb-faee-4e14-9b44-b5e9274f7c92", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-96164946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fc56f5ca1b142d199c360c89d552569", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fce63c-7b", "ovs_interfaceid": "b3fce63c-7b53-4a74-ad26-0e547a9643a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-731673dc-102b-404f-9ade-5057840e2891 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:ed:f4,bridge_name='br-int',has_traffic_filtering=True,id=b3fce63c-7b53-4a74-ad26-0e547a9643a0,network=Network(a10206fb-faee-4e14-9b44-b5e9274f7c92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3fce63c-7b') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG os_vif [None req-731673dc-102b-404f-9ade-5057840e2891 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:ed:f4,bridge_name='br-int',has_traffic_filtering=True,id=b3fce63c-7b53-4a74-ad26-0e547a9643a0,network=Network(a10206fb-faee-4e14-9b44-b5e9274f7c92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3fce63c-7b') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3fce63c-7b, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e93912b-d2ac-4f76-a819-97f66eda2970) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:26 user nova-compute[74189]: INFO os_vif [None req-731673dc-102b-404f-9ade-5057840e2891 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:ed:f4,bridge_name='br-int',has_traffic_filtering=True,id=b3fce63c-7b53-4a74-ad26-0e547a9643a0,network=Network(a10206fb-faee-4e14-9b44-b5e9274f7c92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3fce63c-7b')
Oct 25 21:28:26 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-731673dc-102b-404f-9ade-5057840e2891 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Deleting instance files /opt/stack/data/nova/instances/f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d_del
Oct 25 21:28:26 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-731673dc-102b-404f-9ade-5057840e2891 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Deletion of /opt/stack/data/nova/instances/f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d_del complete
Oct 25 21:28:26 user nova-compute[74189]: DEBUG nova.compute.manager [req-27c33370-880f-4752-934d-56587761f404 req-42b5d16e-5bbd-4899-8403-fbf1831db337 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Received event network-changed-54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG nova.compute.manager [req-27c33370-880f-4752-934d-56587761f404 req-42b5d16e-5bbd-4899-8403-fbf1831db337 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Refreshing instance network info cache due to event network-changed-54123e00-9921-4807-b1f7-79073453a82f. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-27c33370-880f-4752-934d-56587761f404 req-42b5d16e-5bbd-4899-8403-fbf1831db337 service nova] Acquiring lock "refresh_cache-75071d8a-2ce2-43b5-99f6-23853399dc97" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-27c33370-880f-4752-934d-56587761f404 req-42b5d16e-5bbd-4899-8403-fbf1831db337 service nova] Acquired lock "refresh_cache-75071d8a-2ce2-43b5-99f6-23853399dc97" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG nova.network.neutron [req-27c33370-880f-4752-934d-56587761f404 req-42b5d16e-5bbd-4899-8403-fbf1831db337 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Refreshing network info cache for port 54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:28:26 user nova-compute[74189]: INFO nova.compute.manager [None req-731673dc-102b-404f-9ade-5057840e2891 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Took 1.11 seconds to destroy the instance on the hypervisor.
Oct 25 21:28:26 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-731673dc-102b-404f-9ade-5057840e2891 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG nova.network.neutron [req-27c33370-880f-4752-934d-56587761f404 req-42b5d16e-5bbd-4899-8403-fbf1831db337 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Updated VIF entry in instance network info cache for port 54123e00-9921-4807-b1f7-79073453a82f. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG nova.network.neutron [req-27c33370-880f-4752-934d-56587761f404 req-42b5d16e-5bbd-4899-8403-fbf1831db337 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Updating instance_info_cache with network_info: [{"id": "54123e00-9921-4807-b1f7-79073453a82f", "address": "fa:16:3e:02:6a:1d", "network": {"id": "3159e1a7-f60f-4768-9e06-a92287d19dd6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-119288589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046417147a924afdbc8b72333c362261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54123e00-99", "ovs_interfaceid": "54123e00-9921-4807-b1f7-79073453a82f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-27c33370-880f-4752-934d-56587761f404 req-42b5d16e-5bbd-4899-8403-fbf1831db337 service nova] Releasing lock "refresh_cache-75071d8a-2ce2-43b5-99f6-23853399dc97" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG nova.compute.manager [req-27c33370-880f-4752-934d-56587761f404 req-42b5d16e-5bbd-4899-8403-fbf1831db337 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Received event network-vif-plugged-54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-27c33370-880f-4752-934d-56587761f404 req-42b5d16e-5bbd-4899-8403-fbf1831db337 service nova] Acquiring lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-27c33370-880f-4752-934d-56587761f404 req-42b5d16e-5bbd-4899-8403-fbf1831db337 service nova] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-27c33370-880f-4752-934d-56587761f404 req-42b5d16e-5bbd-4899-8403-fbf1831db337 service nova] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG nova.compute.manager [req-27c33370-880f-4752-934d-56587761f404 req-42b5d16e-5bbd-4899-8403-fbf1831db337 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] No waiting events found dispatching network-vif-plugged-54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:28:26 user nova-compute[74189]: WARNING nova.compute.manager [req-27c33370-880f-4752-934d-56587761f404 req-42b5d16e-5bbd-4899-8403-fbf1831db337 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Received unexpected event network-vif-plugged-54123e00-9921-4807-b1f7-79073453a82f for instance with vm_state rescued and task_state unrescuing.
Oct 25 21:28:26 user nova-compute[74189]: DEBUG nova.compute.manager [req-27c33370-880f-4752-934d-56587761f404 req-42b5d16e-5bbd-4899-8403-fbf1831db337 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Received event network-changed-54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG nova.compute.manager [req-27c33370-880f-4752-934d-56587761f404 req-42b5d16e-5bbd-4899-8403-fbf1831db337 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Refreshing instance network info cache due to event network-changed-54123e00-9921-4807-b1f7-79073453a82f. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-27c33370-880f-4752-934d-56587761f404 req-42b5d16e-5bbd-4899-8403-fbf1831db337 service nova] Acquiring lock "refresh_cache-75071d8a-2ce2-43b5-99f6-23853399dc97" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-27c33370-880f-4752-934d-56587761f404 req-42b5d16e-5bbd-4899-8403-fbf1831db337 service nova] Acquired lock "refresh_cache-75071d8a-2ce2-43b5-99f6-23853399dc97" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG nova.network.neutron [req-27c33370-880f-4752-934d-56587761f404 req-42b5d16e-5bbd-4899-8403-fbf1831db337 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Refreshing network info cache for port 54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG nova.compute.manager [req-f65fe001-a813-49b8-ad48-fcb48b2ba21d req-e39ee9d6-b11e-4d64-a565-67acb62a56bf service nova] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Received event network-vif-unplugged-b3fce63c-7b53-4a74-ad26-0e547a9643a0 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f65fe001-a813-49b8-ad48-fcb48b2ba21d req-e39ee9d6-b11e-4d64-a565-67acb62a56bf service nova] Acquiring lock "f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f65fe001-a813-49b8-ad48-fcb48b2ba21d req-e39ee9d6-b11e-4d64-a565-67acb62a56bf service nova] Lock "f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f65fe001-a813-49b8-ad48-fcb48b2ba21d req-e39ee9d6-b11e-4d64-a565-67acb62a56bf service nova] Lock "f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG nova.compute.manager [req-f65fe001-a813-49b8-ad48-fcb48b2ba21d req-e39ee9d6-b11e-4d64-a565-67acb62a56bf service nova] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] No waiting events found dispatching network-vif-unplugged-b3fce63c-7b53-4a74-ad26-0e547a9643a0 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG nova.compute.manager [req-f65fe001-a813-49b8-ad48-fcb48b2ba21d req-e39ee9d6-b11e-4d64-a565-67acb62a56bf service nova] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Received event network-vif-unplugged-b3fce63c-7b53-4a74-ad26-0e547a9643a0 for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG nova.compute.manager [req-f65fe001-a813-49b8-ad48-fcb48b2ba21d req-e39ee9d6-b11e-4d64-a565-67acb62a56bf service nova] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Received event network-vif-plugged-b3fce63c-7b53-4a74-ad26-0e547a9643a0 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f65fe001-a813-49b8-ad48-fcb48b2ba21d req-e39ee9d6-b11e-4d64-a565-67acb62a56bf service nova] Acquiring lock "f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f65fe001-a813-49b8-ad48-fcb48b2ba21d req-e39ee9d6-b11e-4d64-a565-67acb62a56bf service nova] Lock "f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f65fe001-a813-49b8-ad48-fcb48b2ba21d req-e39ee9d6-b11e-4d64-a565-67acb62a56bf service nova] Lock "f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:28:26 user nova-compute[74189]: DEBUG nova.compute.manager [req-f65fe001-a813-49b8-ad48-fcb48b2ba21d req-e39ee9d6-b11e-4d64-a565-67acb62a56bf service nova] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] No waiting events found dispatching network-vif-plugged-b3fce63c-7b53-4a74-ad26-0e547a9643a0 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:28:26 user nova-compute[74189]: WARNING nova.compute.manager [req-f65fe001-a813-49b8-ad48-fcb48b2ba21d req-e39ee9d6-b11e-4d64-a565-67acb62a56bf service nova] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Received unexpected event network-vif-plugged-b3fce63c-7b53-4a74-ad26-0e547a9643a0 for instance with vm_state active and task_state deleting.
Oct 25 21:28:27 user nova-compute[74189]: DEBUG nova.network.neutron [req-27c33370-880f-4752-934d-56587761f404 req-42b5d16e-5bbd-4899-8403-fbf1831db337 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Updated VIF entry in instance network info cache for port 54123e00-9921-4807-b1f7-79073453a82f. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:28:27 user nova-compute[74189]: DEBUG nova.network.neutron [req-27c33370-880f-4752-934d-56587761f404 req-42b5d16e-5bbd-4899-8403-fbf1831db337 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Updating instance_info_cache with network_info: [{"id": "54123e00-9921-4807-b1f7-79073453a82f", "address": "fa:16:3e:02:6a:1d", "network": {"id": "3159e1a7-f60f-4768-9e06-a92287d19dd6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-119288589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046417147a924afdbc8b72333c362261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54123e00-99", "ovs_interfaceid": "54123e00-9921-4807-b1f7-79073453a82f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:28:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-27c33370-880f-4752-934d-56587761f404 req-42b5d16e-5bbd-4899-8403-fbf1831db337 service nova] Releasing lock "refresh_cache-75071d8a-2ce2-43b5-99f6-23853399dc97" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:28:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-27c33370-880f-4752-934d-56587761f404 req-42b5d16e-5bbd-4899-8403-fbf1831db337 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Received event network-vif-plugged-54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:28:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-27c33370-880f-4752-934d-56587761f404 req-42b5d16e-5bbd-4899-8403-fbf1831db337 service nova] Acquiring lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:28:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-27c33370-880f-4752-934d-56587761f404 req-42b5d16e-5bbd-4899-8403-fbf1831db337 service nova] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:28:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-27c33370-880f-4752-934d-56587761f404 req-42b5d16e-5bbd-4899-8403-fbf1831db337 service nova] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:28:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-27c33370-880f-4752-934d-56587761f404 req-42b5d16e-5bbd-4899-8403-fbf1831db337 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] No waiting events found dispatching network-vif-plugged-54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:28:27 user nova-compute[74189]: WARNING nova.compute.manager [req-27c33370-880f-4752-934d-56587761f404 req-42b5d16e-5bbd-4899-8403-fbf1831db337 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Received unexpected event network-vif-plugged-54123e00-9921-4807-b1f7-79073453a82f for instance with vm_state rescued and task_state unrescuing.
Oct 25 21:28:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-27c33370-880f-4752-934d-56587761f404 req-42b5d16e-5bbd-4899-8403-fbf1831db337 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Received event network-vif-plugged-54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:28:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-27c33370-880f-4752-934d-56587761f404 req-42b5d16e-5bbd-4899-8403-fbf1831db337 service nova] Acquiring lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:28:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-27c33370-880f-4752-934d-56587761f404 req-42b5d16e-5bbd-4899-8403-fbf1831db337 service nova] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:28:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-27c33370-880f-4752-934d-56587761f404 req-42b5d16e-5bbd-4899-8403-fbf1831db337 service nova] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:28:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-27c33370-880f-4752-934d-56587761f404 req-42b5d16e-5bbd-4899-8403-fbf1831db337 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] No waiting events found dispatching network-vif-plugged-54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:28:27 user nova-compute[74189]: WARNING nova.compute.manager [req-27c33370-880f-4752-934d-56587761f404 req-42b5d16e-5bbd-4899-8403-fbf1831db337 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Received unexpected event network-vif-plugged-54123e00-9921-4807-b1f7-79073453a82f for instance with vm_state rescued and task_state unrescuing.
Oct 25 21:28:27 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:28:27 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Took 1.02 seconds to deallocate network for instance.
Oct 25 21:28:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-9d36173f-70f7-40d0-b1ab-ef89f7c033c6 req-e2e07568-b084-4968-ac9b-eb3971de9b80 service nova] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Received event network-vif-deleted-b3fce63c-7b53-4a74-ad26-0e547a9643a0 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:28:27 user nova-compute[74189]: INFO nova.compute.manager [req-9d36173f-70f7-40d0-b1ab-ef89f7c033c6 req-e2e07568-b084-4968-ac9b-eb3971de9b80 service nova] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Neutron deleted interface b3fce63c-7b53-4a74-ad26-0e547a9643a0; detaching it from the instance and deleting it from the info cache
Oct 25 21:28:27 user nova-compute[74189]: DEBUG nova.network.neutron [req-9d36173f-70f7-40d0-b1ab-ef89f7c033c6 req-e2e07568-b084-4968-ac9b-eb3971de9b80 service nova] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:28:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-9d36173f-70f7-40d0-b1ab-ef89f7c033c6 req-e2e07568-b084-4968-ac9b-eb3971de9b80 service nova] [instance: f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d] Detach interface failed, port_id=b3fce63c-7b53-4a74-ad26-0e547a9643a0, reason: Instance f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d could not be found. {{(pid=74189) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 21:28:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-731673dc-102b-404f-9ade-5057840e2891 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:28:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-731673dc-102b-404f-9ade-5057840e2891 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:28:27 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-731673dc-102b-404f-9ade-5057840e2891 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:28:27 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-731673dc-102b-404f-9ade-5057840e2891 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:28:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-731673dc-102b-404f-9ade-5057840e2891 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.463s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:28:27 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-731673dc-102b-404f-9ade-5057840e2891 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Deleted allocations for instance f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d
Oct 25 21:28:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-731673dc-102b-404f-9ade-5057840e2891 tempest-TestServerVolumeAttachScenarioOldVersion-758874110 tempest-TestServerVolumeAttachScenarioOldVersion-758874110-project-member] Lock "f37a1bab-a9e5-4d5b-8ecc-49b63c5ea74d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.863s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:28:28 user nova-compute[74189]: DEBUG nova.compute.manager [None req-7fa7cfcc-46ec-4e53-bf93-c1e8689987ed tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:28:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:38 user nova-compute[74189]: DEBUG os_brick.utils [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:28:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:38 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[15eec49d-3edd-41a7-abab-1823fd3c106d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:38 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7cb117-5747-4491-ba6c-65498d00bdce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:38 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc217cf1-7a62-40a0-8188-c644348f797f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:38 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc9fe88-8ae6-4c16-927f-9bbc34e4449c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:28:38 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:28:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:28:38 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:28:38 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82f353d-74a3-4a28-b35c-2a3cbabce561]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:38 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:28:38 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:28:38 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:28:38 user nova-compute[74189]: DEBUG os_brick.utils [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:28:38 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Updating existing volume attachment record: f7ce213a-53f4-462e-b55d-5dfdc627c35f {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:28:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:28:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 21:28:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:28:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:28:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:46 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:49 user nova-compute[74189]: DEBUG nova.compute.manager [req-a1269043-1b33-4f55-8371-260ea9d5f061 req-24d2f1d2-0115-4390-878a-92a8396c5def service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Received event network-changed-1d25f7eb-3650-4049-a6b9-4fe9ff701593 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:28:49 user nova-compute[74189]: DEBUG nova.compute.manager [req-a1269043-1b33-4f55-8371-260ea9d5f061 req-24d2f1d2-0115-4390-878a-92a8396c5def service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Refreshing instance network info cache due to event network-changed-1d25f7eb-3650-4049-a6b9-4fe9ff701593. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:28:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a1269043-1b33-4f55-8371-260ea9d5f061 req-24d2f1d2-0115-4390-878a-92a8396c5def service nova] Acquiring lock "refresh_cache-d6e14e1a-6ef7-4a47-afc7-096326de8f5e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:28:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a1269043-1b33-4f55-8371-260ea9d5f061 req-24d2f1d2-0115-4390-878a-92a8396c5def service nova] Acquired lock "refresh_cache-d6e14e1a-6ef7-4a47-afc7-096326de8f5e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:28:49 user nova-compute[74189]: DEBUG nova.network.neutron [req-a1269043-1b33-4f55-8371-260ea9d5f061 req-24d2f1d2-0115-4390-878a-92a8396c5def service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Refreshing network info cache for port 1d25f7eb-3650-4049-a6b9-4fe9ff701593 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:28:49 user nova-compute[74189]: DEBUG nova.network.neutron [req-a1269043-1b33-4f55-8371-260ea9d5f061 req-24d2f1d2-0115-4390-878a-92a8396c5def service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Updated VIF entry in instance network info cache for port 1d25f7eb-3650-4049-a6b9-4fe9ff701593. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:28:49 user nova-compute[74189]: DEBUG nova.network.neutron [req-a1269043-1b33-4f55-8371-260ea9d5f061 req-24d2f1d2-0115-4390-878a-92a8396c5def service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Updating instance_info_cache with network_info: [{"id": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "address": "fa:16:3e:58:36:23", "network": {"id": "1fce8fb6-f20e-4de3-80ec-3d74154c0e23", "bridge": "br-int", "label": "tempest-TestShelveInstance-1146708282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef48aafc7b54ce5aeda52b0b52f2714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d25f7eb-36", "ovs_interfaceid": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:28:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a1269043-1b33-4f55-8371-260ea9d5f061 req-24d2f1d2-0115-4390-878a-92a8396c5def service nova] Releasing lock "refresh_cache-d6e14e1a-6ef7-4a47-afc7-096326de8f5e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:28:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Acquiring lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:28:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:28:49 user nova-compute[74189]: INFO nova.compute.manager [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Shelve offloading
Oct 25 21:28:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:50 user nova-compute[74189]: DEBUG nova.compute.manager [req-66a43563-29ae-41da-bbf1-b35d5f5e5864 req-02048346-d3ae-48b1-b667-9c9fe6840c91 service nova] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Received event network-changed-99d99cc1-710e-41b6-8239-79f4dbc9183a {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:28:50 user nova-compute[74189]: DEBUG nova.compute.manager [req-66a43563-29ae-41da-bbf1-b35d5f5e5864 req-02048346-d3ae-48b1-b667-9c9fe6840c91 service nova] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Refreshing instance network info cache due to event network-changed-99d99cc1-710e-41b6-8239-79f4dbc9183a. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:28:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-66a43563-29ae-41da-bbf1-b35d5f5e5864 req-02048346-d3ae-48b1-b667-9c9fe6840c91 service nova] Acquiring lock "refresh_cache-9a15fb16-8623-4a20-ae26-5f0aab29ec07" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:28:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-66a43563-29ae-41da-bbf1-b35d5f5e5864 req-02048346-d3ae-48b1-b667-9c9fe6840c91 service nova] Acquired lock "refresh_cache-9a15fb16-8623-4a20-ae26-5f0aab29ec07" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:28:50 user nova-compute[74189]: DEBUG nova.network.neutron [req-66a43563-29ae-41da-bbf1-b35d5f5e5864 req-02048346-d3ae-48b1-b667-9c9fe6840c91 service nova] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Refreshing network info cache for port 99d99cc1-710e-41b6-8239-79f4dbc9183a {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:28:50 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Instance destroyed successfully.
Oct 25 21:28:50 user nova-compute[74189]: DEBUG nova.compute.manager [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:28:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Acquiring lock "refresh_cache-d6e14e1a-6ef7-4a47-afc7-096326de8f5e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:28:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Acquired lock "refresh_cache-d6e14e1a-6ef7-4a47-afc7-096326de8f5e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:28:50 user nova-compute[74189]: DEBUG nova.network.neutron [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:28:50 user nova-compute[74189]: DEBUG nova.network.neutron [req-66a43563-29ae-41da-bbf1-b35d5f5e5864 req-02048346-d3ae-48b1-b667-9c9fe6840c91 service nova] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Updated VIF entry in instance network info cache for port 99d99cc1-710e-41b6-8239-79f4dbc9183a. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:28:50 user nova-compute[74189]: DEBUG nova.network.neutron [req-66a43563-29ae-41da-bbf1-b35d5f5e5864 req-02048346-d3ae-48b1-b667-9c9fe6840c91 service nova] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Updating instance_info_cache with network_info: [{"id": "99d99cc1-710e-41b6-8239-79f4dbc9183a", "address": "fa:16:3e:09:c7:d1", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d99cc1-71", "ovs_interfaceid": "99d99cc1-710e-41b6-8239-79f4dbc9183a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:28:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-66a43563-29ae-41da-bbf1-b35d5f5e5864 req-02048346-d3ae-48b1-b667-9c9fe6840c91 service nova] Releasing lock "refresh_cache-9a15fb16-8623-4a20-ae26-5f0aab29ec07" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:28:51 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:51 user nova-compute[74189]: DEBUG nova.network.neutron [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Updating instance_info_cache with network_info: [{"id": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "address": "fa:16:3e:58:36:23", "network": {"id": "1fce8fb6-f20e-4de3-80ec-3d74154c0e23", "bridge": "br-int", "label": "tempest-TestShelveInstance-1146708282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef48aafc7b54ce5aeda52b0b52f2714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d25f7eb-36", "ovs_interfaceid": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:28:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Releasing lock "refresh_cache-d6e14e1a-6ef7-4a47-afc7-096326de8f5e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:28:51 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Instance destroyed successfully.
Oct 25 21:28:51 user nova-compute[74189]: DEBUG nova.objects.instance [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lazy-loading 'resources' on Instance uuid d6e14e1a-6ef7-4a47-afc7-096326de8f5e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:28:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:26:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1213251010',display_name='tempest-TestShelveInstance-server-1213251010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1213251010',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNqUIHf3I8RhYrvivy/tUrkctgg0VuWe78qUcgCaXcqN8tRyHKb0x17tdtbNu6jPaS71Or0GKwjH1tiyjOQJpFf+EUe1BDFHzAeH5wwreHNU2pAmWFu7FPqZaEfm+f0xA==',key_name='tempest-TestShelveInstance-290074196',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:27:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ef48aafc7b54ce5aeda52b0b52f2714',ramdisk_id='',reservation_id='r-fduvh40c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-715930903',owner_user_name='tempest-TestShelveInstance-715930903-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:27:24Z,user_data=None,user_id='0a958107c53f4eeb832f6040969c8a24',uuid=d6e14e1a-6ef7-4a47-afc7-096326de8f5e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "address": "fa:16:3e:58:36:23", "network": {"id": "1fce8fb6-f20e-4de3-80ec-3d74154c0e23", "bridge": "br-int", "label": "tempest-TestShelveInstance-1146708282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef48aafc7b54ce5aeda52b0b52f2714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d25f7eb-36", "ovs_interfaceid": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:28:51 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Converting VIF {"id": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "address": "fa:16:3e:58:36:23", "network": {"id": "1fce8fb6-f20e-4de3-80ec-3d74154c0e23", "bridge": "br-int", "label": "tempest-TestShelveInstance-1146708282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef48aafc7b54ce5aeda52b0b52f2714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d25f7eb-36", "ovs_interfaceid": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:28:51 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:36:23,bridge_name='br-int',has_traffic_filtering=True,id=1d25f7eb-3650-4049-a6b9-4fe9ff701593,network=Network(1fce8fb6-f20e-4de3-80ec-3d74154c0e23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d25f7eb-36') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:28:51 user nova-compute[74189]: DEBUG os_vif [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:36:23,bridge_name='br-int',has_traffic_filtering=True,id=1d25f7eb-3650-4049-a6b9-4fe9ff701593,network=Network(1fce8fb6-f20e-4de3-80ec-3d74154c0e23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d25f7eb-36') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:28:51 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:51 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d25f7eb-36, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:28:51 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:51 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:28:51 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:51 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:51 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7aab7493-7896-4a66-9384-6c6eb5b6d994) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:28:51 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:51 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:28:51 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:51 user nova-compute[74189]: INFO os_vif [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:36:23,bridge_name='br-int',has_traffic_filtering=True,id=1d25f7eb-3650-4049-a6b9-4fe9ff701593,network=Network(1fce8fb6-f20e-4de3-80ec-3d74154c0e23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d25f7eb-36')
Oct 25 21:28:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:28:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bBkaEFvy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:28:51 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:28:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:28:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:28:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:51 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7af782d-45eb-4a4b-b5b4-0c58e5cec1dd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:28:51 user nova-compute[74189]: No targets found.
Oct 25 21:28:51 user nova-compute[74189]: iSNS:
Oct 25 21:28:51 user nova-compute[74189]: No targets found.
Oct 25 21:28:51 user nova-compute[74189]: STATIC:
Oct 25 21:28:51 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a
Oct 25 21:28:51 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:28:51 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:28:51 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d
Oct 25 21:28:51 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:28:51 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:28:51 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e
Oct 25 21:28:51 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:28:51 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:28:51 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1
Oct 25 21:28:51 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:28:51 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:28:51 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:28:51 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:28:51 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:28:51 user nova-compute[74189]: FIRMWARE:
Oct 25 21:28:51 user nova-compute[74189]: No targets found.
Oct 25 21:28:51 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:28:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:28:51 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:28:51 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:28:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:28:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a024c0b-f0a6-44f1-8080-67a910f06e4f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f559f1-4939-483d-8487-6fcd24fde0f7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:28:52 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:28:52 user nova-compute[74189]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:28:52 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:28:52 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:28:52 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:28:52 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:28:52 user nova-compute[74189]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:28:52 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:28:52 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:28:52 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3041db400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e'): ({'sde'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Removing single pathed devices sde {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ed0bec-557c-464e-8800-7e0ac25481d1]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15df5b2-4a2c-43e5-aa1b-6dcc18582fad]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Flushing IO for device /dev/sde {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9d00d9-5c87-43ef-a9ba-5a300ee24433]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6a01f2-7ab4-4a84-8f40-6f768c79f2ab]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] SCSI volumes sde have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0435a5-8836-4a29-9f82-e5a4c4d6d444]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG nova.compute.manager [req-53816fb0-fb87-4dcb-b3c3-31b2c4b1a79a req-11b9e73b-2835-40dc-92a1-940f6a9b3565 service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Received event network-vif-unplugged-1d25f7eb-3650-4049-a6b9-4fe9ff701593 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-53816fb0-fb87-4dcb-b3c3-31b2c4b1a79a req-11b9e73b-2835-40dc-92a1-940f6a9b3565 service nova] Acquiring lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-53816fb0-fb87-4dcb-b3c3-31b2c4b1a79a req-11b9e73b-2835-40dc-92a1-940f6a9b3565 service nova] Lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-53816fb0-fb87-4dcb-b3c3-31b2c4b1a79a req-11b9e73b-2835-40dc-92a1-940f6a9b3565 service nova] Lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG nova.compute.manager [req-53816fb0-fb87-4dcb-b3c3-31b2c4b1a79a req-11b9e73b-2835-40dc-92a1-940f6a9b3565 service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] No waiting events found dispatching network-vif-unplugged-1d25f7eb-3650-4049-a6b9-4fe9ff701593 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:28:52 user nova-compute[74189]: WARNING nova.compute.manager [req-53816fb0-fb87-4dcb-b3c3-31b2c4b1a79a req-11b9e73b-2835-40dc-92a1-940f6a9b3565 service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Received unexpected event network-vif-unplugged-1d25f7eb-3650-4049-a6b9-4fe9ff701593 for instance with vm_state active and task_state shelving.
Oct 25 21:28:52 user nova-compute[74189]: DEBUG nova.compute.manager [req-53816fb0-fb87-4dcb-b3c3-31b2c4b1a79a req-11b9e73b-2835-40dc-92a1-940f6a9b3565 service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Received event network-vif-plugged-1d25f7eb-3650-4049-a6b9-4fe9ff701593 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-53816fb0-fb87-4dcb-b3c3-31b2c4b1a79a req-11b9e73b-2835-40dc-92a1-940f6a9b3565 service nova] Acquiring lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-53816fb0-fb87-4dcb-b3c3-31b2c4b1a79a req-11b9e73b-2835-40dc-92a1-940f6a9b3565 service nova] Lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-53816fb0-fb87-4dcb-b3c3-31b2c4b1a79a req-11b9e73b-2835-40dc-92a1-940f6a9b3565 service nova] Lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG nova.compute.manager [req-53816fb0-fb87-4dcb-b3c3-31b2c4b1a79a req-11b9e73b-2835-40dc-92a1-940f6a9b3565 service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] No waiting events found dispatching network-vif-plugged-1d25f7eb-3650-4049-a6b9-4fe9ff701593 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:28:52 user nova-compute[74189]: WARNING nova.compute.manager [req-53816fb0-fb87-4dcb-b3c3-31b2c4b1a79a req-11b9e73b-2835-40dc-92a1-940f6a9b3565 service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Received unexpected event network-vif-plugged-1d25f7eb-3650-4049-a6b9-4fe9ff701593 for instance with vm_state active and task_state shelving.
Oct 25 21:28:52 user nova-compute[74189]: DEBUG nova.compute.manager [req-53816fb0-fb87-4dcb-b3c3-31b2c4b1a79a req-11b9e73b-2835-40dc-92a1-940f6a9b3565 service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Received event network-changed-1d25f7eb-3650-4049-a6b9-4fe9ff701593 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG nova.compute.manager [req-53816fb0-fb87-4dcb-b3c3-31b2c4b1a79a req-11b9e73b-2835-40dc-92a1-940f6a9b3565 service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Refreshing instance network info cache due to event network-changed-1d25f7eb-3650-4049-a6b9-4fe9ff701593. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-53816fb0-fb87-4dcb-b3c3-31b2c4b1a79a req-11b9e73b-2835-40dc-92a1-940f6a9b3565 service nova] Acquiring lock "refresh_cache-d6e14e1a-6ef7-4a47-afc7-096326de8f5e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-53816fb0-fb87-4dcb-b3c3-31b2c4b1a79a req-11b9e73b-2835-40dc-92a1-940f6a9b3565 service nova] Acquired lock "refresh_cache-d6e14e1a-6ef7-4a47-afc7-096326de8f5e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG nova.network.neutron [req-53816fb0-fb87-4dcb-b3c3-31b2c4b1a79a req-11b9e73b-2835-40dc-92a1-940f6a9b3565 service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Refreshing network info cache for port 1d25f7eb-3650-4049-a6b9-4fe9ff701593 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdc53bb-5f1d-4270-a1ae-3c238e58f86c]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e, portal: 172.16.0.220,3260]
Oct 25 21:28:52 user nova-compute[74189]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e, portal: 172.16.0.220,3260] successful.
Oct 25 21:28:52 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab06bad-ef8b-4d17-9589-02e740ba728a]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] <== disconnect_volume: return (381ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:28:52 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Deleting instance files /opt/stack/data/nova/instances/d6e14e1a-6ef7-4a47-afc7-096326de8f5e_del
Oct 25 21:28:52 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Deletion of /opt/stack/data/nova/instances/d6e14e1a-6ef7-4a47-afc7-096326de8f5e_del complete
Oct 25 21:28:52 user nova-compute[74189]: DEBUG nova.network.neutron [req-53816fb0-fb87-4dcb-b3c3-31b2c4b1a79a req-11b9e73b-2835-40dc-92a1-940f6a9b3565 service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Updated VIF entry in instance network info cache for port 1d25f7eb-3650-4049-a6b9-4fe9ff701593. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG nova.network.neutron [req-53816fb0-fb87-4dcb-b3c3-31b2c4b1a79a req-11b9e73b-2835-40dc-92a1-940f6a9b3565 service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Updating instance_info_cache with network_info: [{"id": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "address": "fa:16:3e:58:36:23", "network": {"id": "1fce8fb6-f20e-4de3-80ec-3d74154c0e23", "bridge": null, "label": "tempest-TestShelveInstance-1146708282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef48aafc7b54ce5aeda52b0b52f2714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap1d25f7eb-36", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:28:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-53816fb0-fb87-4dcb-b3c3-31b2c4b1a79a req-11b9e73b-2835-40dc-92a1-940f6a9b3565 service nova] Releasing lock "refresh_cache-d6e14e1a-6ef7-4a47-afc7-096326de8f5e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:28:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "cdb13b8f-c136-4f2b-95b9-e464babac28a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:28:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "cdb13b8f-c136-4f2b-95b9-e464babac28a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:28:53 user nova-compute[74189]: DEBUG nova.objects.instance [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lazy-loading 'flavor' on Instance uuid cdb13b8f-c136-4f2b-95b9-e464babac28a {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:28:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "cdb13b8f-c136-4f2b-95b9-e464babac28a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:28:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "cdb13b8f-c136-4f2b-95b9-e464babac28a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:28:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "cdb13b8f-c136-4f2b-95b9-e464babac28a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:28:53 user nova-compute[74189]: INFO nova.compute.manager [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Attaching volume 0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e to /dev/vdb
Oct 25 21:28:53 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:53 user nova-compute[74189]: DEBUG os_brick.utils [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:28:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:53 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d9b09f-0eff-4e5d-9e35-e4feff5069c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:53 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8293a471-65a7-4954-9739-b59a33c99600]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:53 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[30aed780-d408-42d2-b86e-7d5988247dbb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:53 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5260fd-8e70-4e67-b4ca-7fea47018b55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:28:53 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Deleted allocations for instance d6e14e1a-6ef7-4a47-afc7-096326de8f5e
Oct 25 21:28:53 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:28:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:28:53 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:28:53 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d50a379-7357-4a34-bc69-65a25adcef06]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:53 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:28:53 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:28:53 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:28:53 user nova-compute[74189]: DEBUG os_brick.utils [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:28:53 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Updating existing volume attachment record: 5a504ed0-9565-40b9-bfd6-c9062d831d30 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:28:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:28:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:28:53 user nova-compute[74189]: DEBUG nova.objects.instance [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lazy-loading 'numa_topology' on Instance uuid d6e14e1a-6ef7-4a47-afc7-096326de8f5e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:28:53 user nova-compute[74189]: DEBUG nova.objects.base [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Object Instance<d6e14e1a-6ef7-4a47-afc7-096326de8f5e> lazy-loaded attributes: resources,numa_topology {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:28:54 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:28:54 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:28:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:28:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d2e657a4-6a1c-46a8-b4c6-8ff1764eb4ef tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.373s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:28:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Acquiring lock "75071d8a-2ce2-43b5-99f6-23853399dc97" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:28:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:28:56 user nova-compute[74189]: INFO nova.compute.manager [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Detaching volume 4f257f0f-5b89-4c0f-8120-b1b725384c6a
Oct 25 21:28:56 user nova-compute[74189]: INFO nova.virt.block_device [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Attempting to driver detach volume 4f257f0f-5b89-4c0f-8120-b1b725384c6a from mountpoint /dev/vdb
Oct 25 21:28:56 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Attempting to detach device vdb from instance 75071d8a-2ce2-43b5-99f6-23853399dc97 from the persistent domain config. {{(pid=74189) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 21:28:56 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:28:56 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:28:56 user nova-compute[74189]:   <source dev="/dev/sdd"/>
Oct 25 21:28:56 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:28:56 user nova-compute[74189]:   <serial>4f257f0f-5b89-4c0f-8120-b1b725384c6a</serial>
Oct 25 21:28:56 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:28:56 user nova-compute[74189]: </disk>
Oct 25 21:28:56 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:28:56 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Successfully detached device vdb from instance 75071d8a-2ce2-43b5-99f6-23853399dc97 from the persistent domain config.
Oct 25 21:28:56 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 75071d8a-2ce2-43b5-99f6-23853399dc97 from the live domain config. {{(pid=74189) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 21:28:56 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:28:56 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:28:56 user nova-compute[74189]:   <source dev="/dev/sdd"/>
Oct 25 21:28:56 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:28:56 user nova-compute[74189]:   <serial>4f257f0f-5b89-4c0f-8120-b1b725384c6a</serial>
Oct 25 21:28:56 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:28:56 user nova-compute[74189]: </disk>
Oct 25 21:28:56 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:28:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:56 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 75071d8a-2ce2-43b5-99f6-23853399dc97 {{(pid=74189) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG nova.compute.manager [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:28:58 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Creating image(s)
Oct 25 21:28:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Did not create local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Ensure instance console log exists: /opt/stack/data/nova/instances/9733d5c8-4476-4903-bd1b-16d43a54fdbd/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Start _get_guest_xml network_info=[{"id": "005bac46-8900-46a0-bb7f-d8672c6d2fc1", "address": "fa:16:3e:1d:ce:94", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap005bac46-89", "ovs_interfaceid": "005bac46-8900-46a0-bb7f-d8672c6d2fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vTqMWNCD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9733d5c8-4476-4903-bd1b-16d43a54fdbd', 'attached_at': '', 'detached_at': '', 'volume_id': 'dfec83e7-d226-4e7e-958d-1d53f9ddcbce', 'serial': 'dfec83e7-d226-4e7e-958d-1d53f9ddcbce'}, 'attachment_id': 'f7ce213a-53f4-462e-b55d-5dfdc627c35f', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:28:58 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:28:58 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:28:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vTqMWNCD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:28:58 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:28:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:28:58 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:28:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:28:58 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7fddcd-d621-4739-aae1-ebba4c05f726]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:28:58 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a299ae5c-6665-48ce-9c37-e6f8fd6d408e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce] added
Oct 25 21:28:58 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[531571ac-43d7-458f-9318-c59867c08f03]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d52bdd-4e16-4497-b64d-6a93f43b9368]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vTqMWNCD {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vTqMWNCD" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e5a5d1-4b1e-4d78-ade2-4afcf785169e]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vTqMWNCD'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1218cffa-c212-48bd-a01d-98e94b67fa5c]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[654b23e4-914d-4be7-bb8c-ba72f571e003]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:28:58 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:28:58 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:28:58 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:28:58 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:28:58 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:28:58 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:28:58 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:28:58 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2311d950-62d1-4060-8d62-a3d013734bba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce, portal: 172.16.0.220,3260]
Oct 25 21:28:58 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce, portal: 172.16.0.220,3260] successful.
Oct 25 21:28:58 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fb132c-beac-45be-809e-a31b31913286]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e735c83b-3faf-483a-9d31-b9752302ad4a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:28:58 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:28:58 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:28:58 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:28:58 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:28:58 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:28:58 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:28:58 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:28:58 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:28:58 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:28:58 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddae4c1-9cb2-41b2-a749-dc1158cf418f]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: None {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:28:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:59 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:28:59 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vTqMWNCD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:28:59 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:28:59 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23933643762383134', 'path': '/dev/sde'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:28:59 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933643762383134', 'path': '/dev/sde'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:28:59 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:28:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1402889467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1402889467',id=30,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='acbb4f93936848a8949477ad124bf98e',ramdisk_id='',reservation_id='r-d1r52c8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-571481303',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:28:17Z,user_data=None,user_id='fc377c1beaab443683a6d776f2f734ff',uuid=9733d5c8-4476-4903-bd1b-16d43a54fdbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "005bac46-8900-46a0-bb7f-d8672c6d2fc1", "address": "fa:16:3e:1d:ce:94", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap005bac46-89", "ovs_interfaceid": "005bac46-8900-46a0-bb7f-d8672c6d2fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:28:59 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Converting VIF {"id": "005bac46-8900-46a0-bb7f-d8672c6d2fc1", "address": "fa:16:3e:1d:ce:94", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap005bac46-89", "ovs_interfaceid": "005bac46-8900-46a0-bb7f-d8672c6d2fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:28:59 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:ce:94,bridge_name='br-int',has_traffic_filtering=True,id=005bac46-8900-46a0-bb7f-d8672c6d2fc1,network=Network(f202171f-dfd8-4a19-9321-788318413ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap005bac46-89') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:28:59 user nova-compute[74189]: DEBUG nova.objects.instance [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lazy-loading 'pci_devices' on Instance uuid 9733d5c8-4476-4903-bd1b-16d43a54fdbd {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:28:59 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:28:59 user nova-compute[74189]:   <uuid>9733d5c8-4476-4903-bd1b-16d43a54fdbd</uuid>
Oct 25 21:28:59 user nova-compute[74189]:   <name>instance-0000001e</name>
Oct 25 21:28:59 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:28:59 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:28:59 user nova-compute[74189]:   <metadata>
Oct 25 21:28:59 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:28:59 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:28:59 user nova-compute[74189]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1402889467</nova:name>
Oct 25 21:28:59 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:28:58</nova:creationTime>
Oct 25 21:28:59 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:28:59 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:28:59 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:28:59 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:28:59 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:28:59 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:28:59 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:28:59 user nova-compute[74189]:       <nova:owner>
Oct 25 21:28:59 user nova-compute[74189]:         <nova:user uuid="fc377c1beaab443683a6d776f2f734ff">tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member</nova:user>
Oct 25 21:28:59 user nova-compute[74189]:         <nova:project uuid="acbb4f93936848a8949477ad124bf98e">tempest-ServerBootFromVolumeStableRescueTest-571481303</nova:project>
Oct 25 21:28:59 user nova-compute[74189]:       </nova:owner>
Oct 25 21:28:59 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:28:59 user nova-compute[74189]:       <nova:ports>
Oct 25 21:28:59 user nova-compute[74189]:         <nova:port uuid="005bac46-8900-46a0-bb7f-d8672c6d2fc1">
Oct 25 21:28:59 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 25 21:28:59 user nova-compute[74189]:         </nova:port>
Oct 25 21:28:59 user nova-compute[74189]:       </nova:ports>
Oct 25 21:28:59 user nova-compute[74189]:     </nova:instance>
Oct 25 21:28:59 user nova-compute[74189]:   </metadata>
Oct 25 21:28:59 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:28:59 user nova-compute[74189]:     <system>
Oct 25 21:28:59 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:28:59 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:28:59 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:28:59 user nova-compute[74189]:       <entry name="serial">9733d5c8-4476-4903-bd1b-16d43a54fdbd</entry>
Oct 25 21:28:59 user nova-compute[74189]:       <entry name="uuid">9733d5c8-4476-4903-bd1b-16d43a54fdbd</entry>
Oct 25 21:28:59 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:28:59 user nova-compute[74189]:     </system>
Oct 25 21:28:59 user nova-compute[74189]:   </sysinfo>
Oct 25 21:28:59 user nova-compute[74189]:   <os>
Oct 25 21:28:59 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:28:59 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:28:59 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:28:59 user nova-compute[74189]:   </os>
Oct 25 21:28:59 user nova-compute[74189]:   <features>
Oct 25 21:28:59 user nova-compute[74189]:     <acpi/>
Oct 25 21:28:59 user nova-compute[74189]:     <apic/>
Oct 25 21:28:59 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:28:59 user nova-compute[74189]:   </features>
Oct 25 21:28:59 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:28:59 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:28:59 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:28:59 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:28:59 user nova-compute[74189]:   </clock>
Oct 25 21:28:59 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:28:59 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:28:59 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:28:59 user nova-compute[74189]:   </cpu>
Oct 25 21:28:59 user nova-compute[74189]:   <devices>
Oct 25 21:28:59 user nova-compute[74189]:     <disk type="block" device="disk">
Oct 25 21:28:59 user nova-compute[74189]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:28:59 user nova-compute[74189]:       <source dev="/dev/sde"/>
Oct 25 21:28:59 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:28:59 user nova-compute[74189]:       <serial>dfec83e7-d226-4e7e-958d-1d53f9ddcbce</serial>
Oct 25 21:28:59 user nova-compute[74189]:     </disk>
Oct 25 21:28:59 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:28:59 user nova-compute[74189]:       <mac address="fa:16:3e:1d:ce:94"/>
Oct 25 21:28:59 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:28:59 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:28:59 user nova-compute[74189]:       <target dev="tap005bac46-89"/>
Oct 25 21:28:59 user nova-compute[74189]:     </interface>
Oct 25 21:28:59 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:28:59 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/9733d5c8-4476-4903-bd1b-16d43a54fdbd/console.log" append="off"/>
Oct 25 21:28:59 user nova-compute[74189]:     </serial>
Oct 25 21:28:59 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:28:59 user nova-compute[74189]:     <video>
Oct 25 21:28:59 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:28:59 user nova-compute[74189]:     </video>
Oct 25 21:28:59 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:28:59 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:28:59 user nova-compute[74189]:     </rng>
Oct 25 21:28:59 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:28:59 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:28:59 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:28:59 user nova-compute[74189]:     </memballoon>
Oct 25 21:28:59 user nova-compute[74189]:   </devices>
Oct 25 21:28:59 user nova-compute[74189]: </domain>
Oct 25 21:28:59 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:28:59 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:28:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1402889467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1402889467',id=30,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='acbb4f93936848a8949477ad124bf98e',ramdisk_id='',reservation_id='r-d1r52c8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-571481303',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:28:17Z,user_data=None,user_id='fc377c1beaab443683a6d776f2f734ff',uuid=9733d5c8-4476-4903-bd1b-16d43a54fdbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "005bac46-8900-46a0-bb7f-d8672c6d2fc1", "address": "fa:16:3e:1d:ce:94", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap005bac46-89", "ovs_interfaceid": "005bac46-8900-46a0-bb7f-d8672c6d2fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:28:59 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Converting VIF {"id": "005bac46-8900-46a0-bb7f-d8672c6d2fc1", "address": "fa:16:3e:1d:ce:94", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap005bac46-89", "ovs_interfaceid": "005bac46-8900-46a0-bb7f-d8672c6d2fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:28:59 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:ce:94,bridge_name='br-int',has_traffic_filtering=True,id=005bac46-8900-46a0-bb7f-d8672c6d2fc1,network=Network(f202171f-dfd8-4a19-9321-788318413ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap005bac46-89') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:28:59 user nova-compute[74189]: DEBUG os_vif [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:ce:94,bridge_name='br-int',has_traffic_filtering=True,id=005bac46-8900-46a0-bb7f-d8672c6d2fc1,network=Network(f202171f-dfd8-4a19-9321-788318413ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap005bac46-89') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:28:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:28:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:28:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '00ba3e1c-9617-5585-9548-9affcbccd06d', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:28:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:28:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap005bac46-89, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:28:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap005bac46-89, col_values=(('qos', UUID('fb256f93-1dc6-4f2e-91bf-d4aa1bde3efc')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:28:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap005bac46-89, col_values=(('external_ids', {'iface-id': '005bac46-8900-46a0-bb7f-d8672c6d2fc1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:ce:94', 'vm-uuid': '9733d5c8-4476-4903-bd1b-16d43a54fdbd'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:28:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:28:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:28:59 user nova-compute[74189]: INFO os_vif [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:ce:94,bridge_name='br-int',has_traffic_filtering=True,id=005bac46-8900-46a0-bb7f-d8672c6d2fc1,network=Network(f202171f-dfd8-4a19-9321-788318413ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap005bac46-89')
Oct 25 21:28:59 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:28:59 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] No VIF found with MAC fa:16:3e:1d:ce:94, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:29:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:01 user nova-compute[74189]: DEBUG nova.compute.manager [req-00c8e4b1-8950-44ae-aefa-5dbb2c41dfee req-3e0ff09e-9337-4a42-a94a-5b9cb48dfc43 service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Received event network-vif-plugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:29:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-00c8e4b1-8950-44ae-aefa-5dbb2c41dfee req-3e0ff09e-9337-4a42-a94a-5b9cb48dfc43 service nova] Acquiring lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:29:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-00c8e4b1-8950-44ae-aefa-5dbb2c41dfee req-3e0ff09e-9337-4a42-a94a-5b9cb48dfc43 service nova] Lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:29:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-00c8e4b1-8950-44ae-aefa-5dbb2c41dfee req-3e0ff09e-9337-4a42-a94a-5b9cb48dfc43 service nova] Lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:29:01 user nova-compute[74189]: DEBUG nova.compute.manager [req-00c8e4b1-8950-44ae-aefa-5dbb2c41dfee req-3e0ff09e-9337-4a42-a94a-5b9cb48dfc43 service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] No waiting events found dispatching network-vif-plugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:29:01 user nova-compute[74189]: WARNING nova.compute.manager [req-00c8e4b1-8950-44ae-aefa-5dbb2c41dfee req-3e0ff09e-9337-4a42-a94a-5b9cb48dfc43 service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Received unexpected event network-vif-plugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 for instance with vm_state building and task_state spawning.
Oct 25 21:29:03 user nova-compute[74189]: DEBUG nova.compute.manager [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:29:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:29:03 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Instance spawned successfully.
Oct 25 21:29:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:29:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:29:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:29:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:29:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:29:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:29:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:29:03 user nova-compute[74189]: INFO nova.compute.manager [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Took 5.03 seconds to spawn the instance on the hypervisor.
Oct 25 21:29:03 user nova-compute[74189]: DEBUG nova.compute.manager [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:29:03 user nova-compute[74189]: INFO nova.compute.manager [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Took 46.46 seconds to build instance.
Oct 25 21:29:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3a5c9e67-fcf2-4f56-86e9-009f2e08bce1 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 46.563s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:29:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-fb5af55b-572a-4efa-aa14-a685d62e8dbb req-28a1a753-b97b-447f-aac8-d55e6a15f0db service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Received event network-vif-plugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:29:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-fb5af55b-572a-4efa-aa14-a685d62e8dbb req-28a1a753-b97b-447f-aac8-d55e6a15f0db service nova] Acquiring lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:29:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-fb5af55b-572a-4efa-aa14-a685d62e8dbb req-28a1a753-b97b-447f-aac8-d55e6a15f0db service nova] Lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:29:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-fb5af55b-572a-4efa-aa14-a685d62e8dbb req-28a1a753-b97b-447f-aac8-d55e6a15f0db service nova] Lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:29:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-fb5af55b-572a-4efa-aa14-a685d62e8dbb req-28a1a753-b97b-447f-aac8-d55e6a15f0db service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] No waiting events found dispatching network-vif-plugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:29:03 user nova-compute[74189]: WARNING nova.compute.manager [req-fb5af55b-572a-4efa-aa14-a685d62e8dbb req-28a1a753-b97b-447f-aac8-d55e6a15f0db service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Received unexpected event network-vif-plugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 for instance with vm_state active and task_state None.
Oct 25 21:29:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "7de30b3e-49a6-4493-8ff5-3740d9a796e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:29:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "7de30b3e-49a6-4493-8ff5-3740d9a796e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:29:04 user nova-compute[74189]: DEBUG nova.compute.manager [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:29:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:29:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:29:04 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:29:04 user nova-compute[74189]: INFO nova.compute.claims [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Claim successful on node user
Oct 25 21:29:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:04 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:29:04 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:29:04 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:29:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.457s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:29:04 user nova-compute[74189]: DEBUG nova.compute.manager [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:29:04 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:29:04 user nova-compute[74189]: DEBUG nova.compute.manager [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:29:04 user nova-compute[74189]: DEBUG nova.network.neutron [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:29:04 user nova-compute[74189]: DEBUG nova.compute.manager [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:29:05 user nova-compute[74189]: INFO nova.virt.block_device [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Booting with volume snapshot d00d2e4d-0c90-41b6-a5e8-c3461f6122a0 at /dev/vda
Oct 25 21:29:05 user nova-compute[74189]: DEBUG nova.policy [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '77a27a7ebb4a458097c901871c378bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e893e8f3f58e4e15920d313b6391682c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:29:05 user nova-compute[74189]: DEBUG nova.network.neutron [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Successfully created port: 904c11d7-fd7b-46dc-b821-42186bfa849c {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:29:06 user nova-compute[74189]: DEBUG nova.network.neutron [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Successfully updated port: 904c11d7-fd7b-46dc-b821-42186bfa849c {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:29:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "refresh_cache-7de30b3e-49a6-4493-8ff5-3740d9a796e8" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:29:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquired lock "refresh_cache-7de30b3e-49a6-4493-8ff5-3740d9a796e8" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:29:06 user nova-compute[74189]: DEBUG nova.network.neutron [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:29:06 user nova-compute[74189]: DEBUG nova.compute.manager [req-fccf136f-8511-4226-b046-5199972da487 req-61bb1cf6-6a29-4ec5-950f-d6bc133b45f8 service nova] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Received event network-changed-904c11d7-fd7b-46dc-b821-42186bfa849c {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:29:06 user nova-compute[74189]: DEBUG nova.compute.manager [req-fccf136f-8511-4226-b046-5199972da487 req-61bb1cf6-6a29-4ec5-950f-d6bc133b45f8 service nova] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Refreshing instance network info cache due to event network-changed-904c11d7-fd7b-46dc-b821-42186bfa849c. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:29:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-fccf136f-8511-4226-b046-5199972da487 req-61bb1cf6-6a29-4ec5-950f-d6bc133b45f8 service nova] Acquiring lock "refresh_cache-7de30b3e-49a6-4493-8ff5-3740d9a796e8" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:29:06 user nova-compute[74189]: DEBUG nova.network.neutron [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:29:06 user nova-compute[74189]: DEBUG nova.network.neutron [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Updating instance_info_cache with network_info: [{"id": "904c11d7-fd7b-46dc-b821-42186bfa849c", "address": "fa:16:3e:21:11:86", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904c11d7-fd", "ovs_interfaceid": "904c11d7-fd7b-46dc-b821-42186bfa849c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:29:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Releasing lock "refresh_cache-7de30b3e-49a6-4493-8ff5-3740d9a796e8" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:29:06 user nova-compute[74189]: DEBUG nova.compute.manager [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Instance network_info: |[{"id": "904c11d7-fd7b-46dc-b821-42186bfa849c", "address": "fa:16:3e:21:11:86", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904c11d7-fd", "ovs_interfaceid": "904c11d7-fd7b-46dc-b821-42186bfa849c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:29:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-fccf136f-8511-4226-b046-5199972da487 req-61bb1cf6-6a29-4ec5-950f-d6bc133b45f8 service nova] Acquired lock "refresh_cache-7de30b3e-49a6-4493-8ff5-3740d9a796e8" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:29:06 user nova-compute[74189]: DEBUG nova.network.neutron [req-fccf136f-8511-4226-b046-5199972da487 req-61bb1cf6-6a29-4ec5-950f-d6bc133b45f8 service nova] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Refreshing network info cache for port 904c11d7-fd7b-46dc-b821-42186bfa849c {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:29:07 user nova-compute[74189]: DEBUG nova.network.neutron [req-fccf136f-8511-4226-b046-5199972da487 req-61bb1cf6-6a29-4ec5-950f-d6bc133b45f8 service nova] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Updated VIF entry in instance network info cache for port 904c11d7-fd7b-46dc-b821-42186bfa849c. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:29:07 user nova-compute[74189]: DEBUG nova.network.neutron [req-fccf136f-8511-4226-b046-5199972da487 req-61bb1cf6-6a29-4ec5-950f-d6bc133b45f8 service nova] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Updating instance_info_cache with network_info: [{"id": "904c11d7-fd7b-46dc-b821-42186bfa849c", "address": "fa:16:3e:21:11:86", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904c11d7-fd", "ovs_interfaceid": "904c11d7-fd7b-46dc-b821-42186bfa849c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:29:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-fccf136f-8511-4226-b046-5199972da487 req-61bb1cf6-6a29-4ec5-950f-d6bc133b45f8 service nova] Releasing lock "refresh_cache-7de30b3e-49a6-4493-8ff5-3740d9a796e8" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:29:07 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:29:07 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:29:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-af1d7b3c-9950-4b74-8f15-b31011ccfa24" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:29:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-af1d7b3c-9950-4b74-8f15-b31011ccfa24" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:29:07 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:29:08 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Updating instance_info_cache with network_info: [{"id": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "address": "fa:16:3e:03:8e:2f", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4cdb73-9d", "ovs_interfaceid": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:29:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-af1d7b3c-9950-4b74-8f15-b31011ccfa24" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:29:08 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:29:08 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:29:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:29:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:29:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:29:08 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:29:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:09 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:29:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ba374a-821b-424c-aeaa-528a0164160e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ba374a-821b-424c-aeaa-528a0164160e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ba374a-821b-424c-aeaa-528a0164160e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ba374a-821b-424c-aeaa-528a0164160e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:11 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:29:11 user nova-compute[74189]: DEBUG os_brick.utils [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:29:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:11 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:29:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:11 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[83dcaec8-f428-46b5-a679-c44a89433818]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:11 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbb362b-6f6c-4358-a1cf-3db4aa906d2a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:11 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdd4fed-fb7b-4591-89d3-01bd8a16b4e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:11 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eee975a-a451-4a93-8403-23bc8e56b215]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:29:11 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:29:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:29:11 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:29:11 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4960d5bb-ce47-4470-a5c5-2c49036da991]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:11 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:29:11 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:29:11 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:29:11 user nova-compute[74189]: DEBUG os_brick.utils [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] <== get_connector_properties: return (181ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:29:11 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Updating existing volume attachment record: 753f2a04-f248-43b9-9653-713a0f7e20c4 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:29:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:11 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:29:12 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:29:12 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:29:12 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=7427MB free_disk=24.895553588867188GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance d7c3a99a-ab38-4e88-896d-94ae51a09a48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance af1d7b3c-9950-4b74-8f15-b31011ccfa24 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance de6b6789-b328-4c3b-8d24-07774d5dbe6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 932fe8ac-fdde-45c6-aa32-9bf866f19a4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 75071d8a-2ce2-43b5-99f6-23853399dc97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 0b4f80c4-98cc-440a-aac7-cd423b71a231 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 7eff6940-9675-4c89-bd28-378a5db4369f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance cdb13b8f-c136-4f2b-95b9-e464babac28a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 9a15fb16-8623-4a20-ae26-5f0aab29ec07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance c5ba374a-821b-424c-aeaa-528a0164160e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 9733d5c8-4476-4903-bd1b-16d43a54fdbd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 7de30b3e-49a6-4493-8ff5-3740d9a796e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cromsGNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:29:12 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:29:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:29:12 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:29:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:29:12 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:29:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aaee646-9f55-461b-b24e-18219028eca6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:29:12 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c0c8d7-65ef-4c84-ace4-d83551bdd0fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e] added
Oct 25 21:29:12 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c37d66-a12b-4746-857b-81168d5b2dc9]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cf424c-03cc-4f94-953d-6e586bec7336]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cromsGNV {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cromsGNV" returned: 0 in 0.064s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[db283b5b-b4ac-4b21-ac71-f2e4453db252]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cromsGNV'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ef96f0-c833-454b-8657-9bac5bcf7ea2]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb2780e-1fe2-4011-bdb4-d2c5ba19b009]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:29:12 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:29:12 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:29:12 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:29:12 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:29:12 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:29:12 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:29:12 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:29:12 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:29:12 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:29:12 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[024e83be-ef15-4eb9-929b-1a67da5565b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e, portal: 172.16.0.220,3260]
Oct 25 21:29:12 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e, portal: 172.16.0.220,3260] successful.
Oct 25 21:29:12 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:12 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:29:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:13 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e425443-fee2-49c5-ac6e-53332829586e]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:13 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:13 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:29:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.621s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:29:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:13 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[26be3be0-95d5-4b13-b074-cebbc0c24254]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:13 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:29:13 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:29:13 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:29:13 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:29:13 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:29:13 user nova-compute[74189]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:29:13 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:29:13 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:29:13 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:29:13 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:29:13 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:29:13 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:29:13 user nova-compute[74189]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:29:13 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:29:13 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.380s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:29:13 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:29:13 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] HCTL ('37', '-', '-', 0) found on session 34 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:29:13 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:29:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:13 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e38e1d-f373-4a78-895d-88fc34966cfe]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:13 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: None {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:29:13 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:29:13 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:29:13 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:29:13 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:29:13 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:29:13 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:29:13 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:29:14 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:29:14 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cromsGNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:29:14 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:29:14 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] <== connect_volume: return (1410ms) {'type': 'block', 'scsi_wwn': '26433613434363239', 'path': '/dev/sdf'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:29:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433613434363239', 'path': '/dev/sdf'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:29:14 user nova-compute[74189]: DEBUG nova.objects.instance [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lazy-loading 'flavor' on Instance uuid cdb13b8f-c136-4f2b-95b9-e464babac28a {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:29:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 21:29:14 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:29:14 user nova-compute[74189]:   <source dev="/dev/sdf"/>
Oct 25 21:29:14 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:29:14 user nova-compute[74189]:   <serial>0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e</serial>
Oct 25 21:29:14 user nova-compute[74189]: </disk>
Oct 25 21:29:14 user nova-compute[74189]:  {{(pid=74189) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 21:29:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:29:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 21:29:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:29:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:29:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:29:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:29:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] No VIF found with MAC fa:16:3e:7f:d7:49, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:29:14 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:29:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e8edb41e-e40d-40e0-9778-af24cb1a3e47 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "cdb13b8f-c136-4f2b-95b9-e464babac28a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.457s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:29:16 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 75071d8a-2ce2-43b5-99f6-23853399dc97 is timed out.
Oct 25 21:29:16 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Successfully detached device vdb from instance 75071d8a-2ce2-43b5-99f6-23853399dc97 from the live domain config.
Oct 25 21:29:16 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:29:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ojGqQAgJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:29:16 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:29:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:29:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:29:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a45437-2ab4-41a6-b3d5-4bd2bbcaa668]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:29:17 user nova-compute[74189]: No targets found.
Oct 25 21:29:17 user nova-compute[74189]: iSNS:
Oct 25 21:29:17 user nova-compute[74189]: No targets found.
Oct 25 21:29:17 user nova-compute[74189]: STATIC:
Oct 25 21:29:17 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a
Oct 25 21:29:17 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:29:17 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:29:17 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce
Oct 25 21:29:17 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:29:17 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:29:17 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d
Oct 25 21:29:17 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:29:17 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:29:17 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1
Oct 25 21:29:17 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:29:17 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:29:17 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e
Oct 25 21:29:17 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:29:17 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:29:17 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:29:17 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:29:17 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:29:17 user nova-compute[74189]: FIRMWARE:
Oct 25 21:29:17 user nova-compute[74189]: No targets found.
Oct 25 21:29:17 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:29:17 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:29:17 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a7526d-42ba-4509-9510-39882fcf6e7e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d8c3cf-fdfa-4419-bf1d-18e4183e9a3d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:29:17 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:29:17 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:29:17 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:29:17 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:29:17 user nova-compute[74189]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:29:17 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:29:17 user nova-compute[74189]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a (non-flash)
Oct 25 21:29:17 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:29:17 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:29:17 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:29:17 user nova-compute[74189]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:29:17 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2e422eb00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a'): ({'sdd'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Removing single pathed devices sdd {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.071s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c7803f-c2bb-4abf-9dd6-d074f14180bf]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a98b18-ce37-47bb-b137-d2c980b31942]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Flushing IO for device /dev/sdd {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[361637a9-ad8b-4410-b8a4-4e529e680ba9]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.104s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a104a0d-d8ad-43bd-bb1a-2b2c81778a7a]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] SCSI volumes sdd have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9100b6a0-b40d-482b-9349-c4906f97fde1]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a754bf2-ccc9-4cc6-9220-9322c02c9bfe]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a, portal: 172.16.0.220,3260]
Oct 25 21:29:17 user nova-compute[74189]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a, portal: 172.16.0.220,3260] successful.
Oct 25 21:29:17 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f257f0f-5b89-4c0f-8120-b1b725384c6a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6caf705d-c421-4b94-b2d4-8982ba2996dc]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.486s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] <== disconnect_volume: return (487ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:29:17 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:29:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:18 user nova-compute[74189]: DEBUG nova.objects.instance [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lazy-loading 'flavor' on Instance uuid 75071d8a-2ce2-43b5-99f6-23853399dc97 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:29:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-806f93bf-4645-46d9-af5d-a0fec568b1a8 tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.230s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:29:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "a57b1185-270e-40d0-a55e-986960826169" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:29:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "a57b1185-270e-40d0-a55e-986960826169" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:29:25 user nova-compute[74189]: INFO nova.compute.manager [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Unshelving
Oct 25 21:29:25 user nova-compute[74189]: INFO nova.virt.block_device [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Booting with volume 2bcb1620-6d87-4ef3-9136-841c00fbe245 at /dev/vdc
Oct 25 21:29:25 user nova-compute[74189]: DEBUG os_brick.utils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:29:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:26 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b57396d-bfa0-44b0-8c4c-882c23b8be0c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:26 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[accd85d2-39fe-4b9d-8446-138bcf5253c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:26 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadfc896-0372-4dfd-8b3e-18a0ee21e6f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:26 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad18d99f-fc2d-4993-9cba-4fde7c7ab617]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:29:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:29:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:29:26 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:29:26 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6143e2e-08c1-4fe4-87a4-5d58bc182acb]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:29:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:29:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:29:26 user nova-compute[74189]: DEBUG os_brick.utils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:29:26 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Updating existing volume attachment record: 9eb46014-6a4b-4381-bdb3-7065701ffb64 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:29:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:28 user nova-compute[74189]: DEBUG nova.compute.manager [req-e703fbf4-db98-464e-bf55-dcd4b0803e5a req-40a7279e-d538-4f69-a6c5-a82f892e08a2 service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Received event network-changed-6a146bba-178b-4b17-be10-0410392d8b06 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:29:28 user nova-compute[74189]: DEBUG nova.compute.manager [req-e703fbf4-db98-464e-bf55-dcd4b0803e5a req-40a7279e-d538-4f69-a6c5-a82f892e08a2 service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Refreshing instance network info cache due to event network-changed-6a146bba-178b-4b17-be10-0410392d8b06. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:29:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e703fbf4-db98-464e-bf55-dcd4b0803e5a req-40a7279e-d538-4f69-a6c5-a82f892e08a2 service nova] Acquiring lock "refresh_cache-cdb13b8f-c136-4f2b-95b9-e464babac28a" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:29:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e703fbf4-db98-464e-bf55-dcd4b0803e5a req-40a7279e-d538-4f69-a6c5-a82f892e08a2 service nova] Acquired lock "refresh_cache-cdb13b8f-c136-4f2b-95b9-e464babac28a" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:29:28 user nova-compute[74189]: DEBUG nova.network.neutron [req-e703fbf4-db98-464e-bf55-dcd4b0803e5a req-40a7279e-d538-4f69-a6c5-a82f892e08a2 service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Refreshing network info cache for port 6a146bba-178b-4b17-be10-0410392d8b06 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:29:29 user nova-compute[74189]: DEBUG nova.network.neutron [req-e703fbf4-db98-464e-bf55-dcd4b0803e5a req-40a7279e-d538-4f69-a6c5-a82f892e08a2 service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Updated VIF entry in instance network info cache for port 6a146bba-178b-4b17-be10-0410392d8b06. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:29:29 user nova-compute[74189]: DEBUG nova.network.neutron [req-e703fbf4-db98-464e-bf55-dcd4b0803e5a req-40a7279e-d538-4f69-a6c5-a82f892e08a2 service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Updating instance_info_cache with network_info: [{"id": "6a146bba-178b-4b17-be10-0410392d8b06", "address": "fa:16:3e:7f:d7:49", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a146bba-17", "ovs_interfaceid": "6a146bba-178b-4b17-be10-0410392d8b06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:29:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e703fbf4-db98-464e-bf55-dcd4b0803e5a req-40a7279e-d538-4f69-a6c5-a82f892e08a2 service nova] Releasing lock "refresh_cache-cdb13b8f-c136-4f2b-95b9-e464babac28a" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:29:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG nova.compute.manager [req-1651c07c-bf7e-451f-87a2-087f3e141fa7 req-dff197fc-88af-46b6-b377-0cd7d08ccad6 service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Received event network-changed-6a146bba-178b-4b17-be10-0410392d8b06 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG nova.compute.manager [req-1651c07c-bf7e-451f-87a2-087f3e141fa7 req-dff197fc-88af-46b6-b377-0cd7d08ccad6 service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Refreshing instance network info cache due to event network-changed-6a146bba-178b-4b17-be10-0410392d8b06. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1651c07c-bf7e-451f-87a2-087f3e141fa7 req-dff197fc-88af-46b6-b377-0cd7d08ccad6 service nova] Acquiring lock "refresh_cache-cdb13b8f-c136-4f2b-95b9-e464babac28a" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1651c07c-bf7e-451f-87a2-087f3e141fa7 req-dff197fc-88af-46b6-b377-0cd7d08ccad6 service nova] Acquired lock "refresh_cache-cdb13b8f-c136-4f2b-95b9-e464babac28a" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG nova.network.neutron [req-1651c07c-bf7e-451f-87a2-087f3e141fa7 req-dff197fc-88af-46b6-b377-0cd7d08ccad6 service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Refreshing network info cache for port 6a146bba-178b-4b17-be10-0410392d8b06 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG nova.compute.manager [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:29:31 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Creating image(s)
Oct 25 21:29:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Did not create local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Ensure instance console log exists: /opt/stack/data/nova/instances/7de30b3e-49a6-4493-8ff5-3740d9a796e8/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Start _get_guest_xml network_info=[{"id": "904c11d7-fd7b-46dc-b821-42186bfa849c", "address": "fa:16:3e:21:11:86", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904c11d7-fd", "ovs_interfaceid": "904c11d7-fd7b-46dc-b821-42186bfa849c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-25T21:28:52Z,direct_url=<?>,disk_format='qcow2',id=b64caa99-d310-4900-ad4b-0ce6aa60ba58,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1783744060',owner='e893e8f3f58e4e15920d313b6391682c',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-25T21:28:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bDWejPzJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7de30b3e-49a6-4493-8ff5-3740d9a796e8', 'attached_at': '', 'detached_at': '', 'volume_id': 'da9b2db9-b83b-42a8-92a5-8d1e921ca740', 'serial': 'da9b2db9-b83b-42a8-92a5-8d1e921ca740'}, 'attachment_id': '753f2a04-f248-43b9-9653-713a0f7e20c4', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:29:31 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:29:31 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:29:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-25T21:28:52Z,direct_url=<?>,disk_format='qcow2',id=b64caa99-d310-4900-ad4b-0ce6aa60ba58,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1783744060',owner='e893e8f3f58e4e15920d313b6391682c',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-25T21:28:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bDWejPzJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:29:31 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:29:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:29:31 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:29:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:29:31 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:29:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea3d882-5e00-4cab-904d-42c7cb96fb2a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:29:31 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc88242e-7d5e-4ac8-a6ae-e2c91c06764d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740] added
Oct 25 21:29:31 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b1ef30-e788-4752-ab76-972fa5a1be0b]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[460a8b9c-1bb6-4fbe-9e59-7ba39d2ec5ed]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bDWejPzJ {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bDWejPzJ" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed10e50a-6d09-4165-8673-b28ab5d9b48f]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bDWejPzJ'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c363344-dfd1-4ed4-a763-bb5448a3e7cc]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[615fd6e8-2616-4c19-924e-efe4ae21e8ca]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:29:31 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:29:31 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:29:31 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:29:31 user nova-compute[74189]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:29:31 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:29:31 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:29:31 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:29:31 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:29:31 user nova-compute[74189]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:29:31 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4699cd13-6d02-44d9-81b5-228ea39494d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740, portal: 172.16.0.220,3260]
Oct 25 21:29:31 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740, portal: 172.16.0.220,3260] successful.
Oct 25 21:29:31 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2cf8b6-bf0a-4578-b32e-e8ffea71e6f6]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d73f629-b6e5-4172-a85b-34e53114f87b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:29:32 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:29:32 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:29:32 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:29:32 user nova-compute[74189]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:29:32 user nova-compute[74189]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 (non-flash)
Oct 25 21:29:32 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:29:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:29:32 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:29:32 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:29:32 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:29:32 user nova-compute[74189]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:29:32 user nova-compute[74189]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 (non-flash)
Oct 25 21:29:32 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:29:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:29:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:29:32 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:29:32 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:29:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84900a1-ecf0-4768-ab44-c53ef76eff22]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:32 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: None {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:29:32 user nova-compute[74189]: DEBUG nova.network.neutron [req-1651c07c-bf7e-451f-87a2-087f3e141fa7 req-dff197fc-88af-46b6-b377-0cd7d08ccad6 service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Updated VIF entry in instance network info cache for port 6a146bba-178b-4b17-be10-0410392d8b06. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:29:32 user nova-compute[74189]: DEBUG nova.network.neutron [req-1651c07c-bf7e-451f-87a2-087f3e141fa7 req-dff197fc-88af-46b6-b377-0cd7d08ccad6 service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Updating instance_info_cache with network_info: [{"id": "6a146bba-178b-4b17-be10-0410392d8b06", "address": "fa:16:3e:7f:d7:49", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a146bba-17", "ovs_interfaceid": "6a146bba-178b-4b17-be10-0410392d8b06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:29:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1651c07c-bf7e-451f-87a2-087f3e141fa7 req-dff197fc-88af-46b6-b377-0cd7d08ccad6 service nova] Releasing lock "refresh_cache-cdb13b8f-c136-4f2b-95b9-e464babac28a" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:29:33 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:29:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bDWejPzJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:29:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:29:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26430636535343938', 'path': '/dev/sdd'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:29:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430636535343938', 'path': '/dev/sdd'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:29:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:29:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2012476369',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2012476369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2012476369',id=31,image_ref='b64caa99-d310-4900-ad4b-0ce6aa60ba58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGcd2NdOqvtPqi4vbwcnpBc7KZCWXmeDR0I7AfqwdAA3GAJGwlH20k6sw0kEe4q6786bynct8kulGnGLlJGM8vevZq4Q/LbhxoPX5lNGCxZWHfC9peKfRs8ik60rz5dAHA==',key_name='tempest-keypair-719428534',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e893e8f3f58e4e15920d313b6391682c',ramdisk_id='',reservation_id='r-qvavmn7c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1934687878',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1934687878-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1934687878',owner_user_name='tempest-TestVolumeBootPattern-1934687878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:29:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77a27a7ebb4a458097c901871c378bc8',uuid=7de30b3e-49a6-4493-8ff5-3740d9a796e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "904c11d7-fd7b-46dc-b821-42186bfa849c", "address": "fa:16:3e:21:11:86", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904c11d7-fd", "ovs_interfaceid": "904c11d7-fd7b-46dc-b821-42186bfa849c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:29:33 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converting VIF {"id": "904c11d7-fd7b-46dc-b821-42186bfa849c", "address": "fa:16:3e:21:11:86", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904c11d7-fd", "ovs_interfaceid": "904c11d7-fd7b-46dc-b821-42186bfa849c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:29:33 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:11:86,bridge_name='br-int',has_traffic_filtering=True,id=904c11d7-fd7b-46dc-b821-42186bfa849c,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904c11d7-fd') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:29:33 user nova-compute[74189]: DEBUG nova.objects.instance [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lazy-loading 'pci_devices' on Instance uuid 7de30b3e-49a6-4493-8ff5-3740d9a796e8 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:29:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:29:33 user nova-compute[74189]:   <uuid>7de30b3e-49a6-4493-8ff5-3740d9a796e8</uuid>
Oct 25 21:29:33 user nova-compute[74189]:   <name>instance-0000001f</name>
Oct 25 21:29:33 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:29:33 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:29:33 user nova-compute[74189]:   <metadata>
Oct 25 21:29:33 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:29:33 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:29:33 user nova-compute[74189]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-2012476369</nova:name>
Oct 25 21:29:33 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:29:31</nova:creationTime>
Oct 25 21:29:33 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:29:33 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:29:33 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:29:33 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:29:33 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:29:33 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:29:33 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:29:33 user nova-compute[74189]:       <nova:owner>
Oct 25 21:29:33 user nova-compute[74189]:         <nova:user uuid="77a27a7ebb4a458097c901871c378bc8">tempest-TestVolumeBootPattern-1934687878-project-member</nova:user>
Oct 25 21:29:33 user nova-compute[74189]:         <nova:project uuid="e893e8f3f58e4e15920d313b6391682c">tempest-TestVolumeBootPattern-1934687878</nova:project>
Oct 25 21:29:33 user nova-compute[74189]:       </nova:owner>
Oct 25 21:29:33 user nova-compute[74189]:       <nova:root type="image" uuid="b64caa99-d310-4900-ad4b-0ce6aa60ba58"/>
Oct 25 21:29:33 user nova-compute[74189]:       <nova:ports>
Oct 25 21:29:33 user nova-compute[74189]:         <nova:port uuid="904c11d7-fd7b-46dc-b821-42186bfa849c">
Oct 25 21:29:33 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 25 21:29:33 user nova-compute[74189]:         </nova:port>
Oct 25 21:29:33 user nova-compute[74189]:       </nova:ports>
Oct 25 21:29:33 user nova-compute[74189]:     </nova:instance>
Oct 25 21:29:33 user nova-compute[74189]:   </metadata>
Oct 25 21:29:33 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:29:33 user nova-compute[74189]:     <system>
Oct 25 21:29:33 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:29:33 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:29:33 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:29:33 user nova-compute[74189]:       <entry name="serial">7de30b3e-49a6-4493-8ff5-3740d9a796e8</entry>
Oct 25 21:29:33 user nova-compute[74189]:       <entry name="uuid">7de30b3e-49a6-4493-8ff5-3740d9a796e8</entry>
Oct 25 21:29:33 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:29:33 user nova-compute[74189]:     </system>
Oct 25 21:29:33 user nova-compute[74189]:   </sysinfo>
Oct 25 21:29:33 user nova-compute[74189]:   <os>
Oct 25 21:29:33 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:29:33 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:29:33 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:29:33 user nova-compute[74189]:   </os>
Oct 25 21:29:33 user nova-compute[74189]:   <features>
Oct 25 21:29:33 user nova-compute[74189]:     <acpi/>
Oct 25 21:29:33 user nova-compute[74189]:     <apic/>
Oct 25 21:29:33 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:29:33 user nova-compute[74189]:   </features>
Oct 25 21:29:33 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:29:33 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:29:33 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:29:33 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:29:33 user nova-compute[74189]:   </clock>
Oct 25 21:29:33 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:29:33 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:29:33 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:29:33 user nova-compute[74189]:   </cpu>
Oct 25 21:29:33 user nova-compute[74189]:   <devices>
Oct 25 21:29:33 user nova-compute[74189]:     <disk type="block" device="disk">
Oct 25 21:29:33 user nova-compute[74189]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:29:33 user nova-compute[74189]:       <source dev="/dev/sdd"/>
Oct 25 21:29:33 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:29:33 user nova-compute[74189]:       <serial>da9b2db9-b83b-42a8-92a5-8d1e921ca740</serial>
Oct 25 21:29:33 user nova-compute[74189]:     </disk>
Oct 25 21:29:33 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:29:33 user nova-compute[74189]:       <mac address="fa:16:3e:21:11:86"/>
Oct 25 21:29:33 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:29:33 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:29:33 user nova-compute[74189]:       <target dev="tap904c11d7-fd"/>
Oct 25 21:29:33 user nova-compute[74189]:     </interface>
Oct 25 21:29:33 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:29:33 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/7de30b3e-49a6-4493-8ff5-3740d9a796e8/console.log" append="off"/>
Oct 25 21:29:33 user nova-compute[74189]:     </serial>
Oct 25 21:29:33 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:29:33 user nova-compute[74189]:     <video>
Oct 25 21:29:33 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:29:33 user nova-compute[74189]:     </video>
Oct 25 21:29:33 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:29:33 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:29:33 user nova-compute[74189]:     </rng>
Oct 25 21:29:33 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:29:33 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:29:33 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:29:33 user nova-compute[74189]:     </memballoon>
Oct 25 21:29:33 user nova-compute[74189]:   </devices>
Oct 25 21:29:33 user nova-compute[74189]: </domain>
Oct 25 21:29:33 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:29:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:29:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2012476369',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2012476369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2012476369',id=31,image_ref='b64caa99-d310-4900-ad4b-0ce6aa60ba58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGcd2NdOqvtPqi4vbwcnpBc7KZCWXmeDR0I7AfqwdAA3GAJGwlH20k6sw0kEe4q6786bynct8kulGnGLlJGM8vevZq4Q/LbhxoPX5lNGCxZWHfC9peKfRs8ik60rz5dAHA==',key_name='tempest-keypair-719428534',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e893e8f3f58e4e15920d313b6391682c',ramdisk_id='',reservation_id='r-qvavmn7c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1934687878',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1934687878-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1934687878',owner_user_name='tempest-TestVolumeBootPattern-1934687878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:29:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77a27a7ebb4a458097c901871c378bc8',uuid=7de30b3e-49a6-4493-8ff5-3740d9a796e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "904c11d7-fd7b-46dc-b821-42186bfa849c", "address": "fa:16:3e:21:11:86", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904c11d7-fd", "ovs_interfaceid": "904c11d7-fd7b-46dc-b821-42186bfa849c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:29:33 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converting VIF {"id": "904c11d7-fd7b-46dc-b821-42186bfa849c", "address": "fa:16:3e:21:11:86", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904c11d7-fd", "ovs_interfaceid": "904c11d7-fd7b-46dc-b821-42186bfa849c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:29:33 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:11:86,bridge_name='br-int',has_traffic_filtering=True,id=904c11d7-fd7b-46dc-b821-42186bfa849c,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904c11d7-fd') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:29:33 user nova-compute[74189]: DEBUG os_vif [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:11:86,bridge_name='br-int',has_traffic_filtering=True,id=904c11d7-fd7b-46dc-b821-42186bfa849c,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904c11d7-fd') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:29:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:29:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:29:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad97afac-eff7-5262-b0a7-320a123e1050', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:29:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:29:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap904c11d7-fd, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:29:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap904c11d7-fd, col_values=(('qos', UUID('bce6f4f8-d536-4e10-96c3-e1afd00eef30')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:29:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap904c11d7-fd, col_values=(('external_ids', {'iface-id': '904c11d7-fd7b-46dc-b821-42186bfa849c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:11:86', 'vm-uuid': '7de30b3e-49a6-4493-8ff5-3740d9a796e8'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:29:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:29:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:33 user nova-compute[74189]: INFO os_vif [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:11:86,bridge_name='br-int',has_traffic_filtering=True,id=904c11d7-fd7b-46dc-b821-42186bfa849c,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904c11d7-fd')
Oct 25 21:29:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:29:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] No VIF found with MAC fa:16:3e:21:11:86, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:29:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:34 user nova-compute[74189]: DEBUG nova.compute.manager [req-e30f4994-08b6-4be0-980a-4ebe50c4e4e4 req-14b634fe-c2b0-4571-a9ee-b8ad9d146b23 service nova] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Received event network-vif-plugged-904c11d7-fd7b-46dc-b821-42186bfa849c {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:29:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e30f4994-08b6-4be0-980a-4ebe50c4e4e4 req-14b634fe-c2b0-4571-a9ee-b8ad9d146b23 service nova] Acquiring lock "7de30b3e-49a6-4493-8ff5-3740d9a796e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:29:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e30f4994-08b6-4be0-980a-4ebe50c4e4e4 req-14b634fe-c2b0-4571-a9ee-b8ad9d146b23 service nova] Lock "7de30b3e-49a6-4493-8ff5-3740d9a796e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:29:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e30f4994-08b6-4be0-980a-4ebe50c4e4e4 req-14b634fe-c2b0-4571-a9ee-b8ad9d146b23 service nova] Lock "7de30b3e-49a6-4493-8ff5-3740d9a796e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:29:34 user nova-compute[74189]: DEBUG nova.compute.manager [req-e30f4994-08b6-4be0-980a-4ebe50c4e4e4 req-14b634fe-c2b0-4571-a9ee-b8ad9d146b23 service nova] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] No waiting events found dispatching network-vif-plugged-904c11d7-fd7b-46dc-b821-42186bfa849c {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:29:34 user nova-compute[74189]: WARNING nova.compute.manager [req-e30f4994-08b6-4be0-980a-4ebe50c4e4e4 req-14b634fe-c2b0-4571-a9ee-b8ad9d146b23 service nova] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Received unexpected event network-vif-plugged-904c11d7-fd7b-46dc-b821-42186bfa849c for instance with vm_state building and task_state spawning.
Oct 25 21:29:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:36 user nova-compute[74189]: DEBUG nova.compute.manager [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:29:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:29:36 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Instance spawned successfully.
Oct 25 21:29:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:29:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:29:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:29:36 user nova-compute[74189]: INFO nova.compute.manager [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Took 5.08 seconds to spawn the instance on the hypervisor.
Oct 25 21:29:36 user nova-compute[74189]: DEBUG nova.compute.manager [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:29:36 user nova-compute[74189]: DEBUG nova.compute.manager [req-bd27f17c-bf47-43e9-a17b-e3f2796ba160 req-ac35f2d9-cb22-48cf-981d-834c6bc022f7 service nova] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Received event network-vif-plugged-904c11d7-fd7b-46dc-b821-42186bfa849c {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:29:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bd27f17c-bf47-43e9-a17b-e3f2796ba160 req-ac35f2d9-cb22-48cf-981d-834c6bc022f7 service nova] Acquiring lock "7de30b3e-49a6-4493-8ff5-3740d9a796e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:29:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bd27f17c-bf47-43e9-a17b-e3f2796ba160 req-ac35f2d9-cb22-48cf-981d-834c6bc022f7 service nova] Lock "7de30b3e-49a6-4493-8ff5-3740d9a796e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:29:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bd27f17c-bf47-43e9-a17b-e3f2796ba160 req-ac35f2d9-cb22-48cf-981d-834c6bc022f7 service nova] Lock "7de30b3e-49a6-4493-8ff5-3740d9a796e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:29:36 user nova-compute[74189]: DEBUG nova.compute.manager [req-bd27f17c-bf47-43e9-a17b-e3f2796ba160 req-ac35f2d9-cb22-48cf-981d-834c6bc022f7 service nova] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] No waiting events found dispatching network-vif-plugged-904c11d7-fd7b-46dc-b821-42186bfa849c {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:29:36 user nova-compute[74189]: WARNING nova.compute.manager [req-bd27f17c-bf47-43e9-a17b-e3f2796ba160 req-ac35f2d9-cb22-48cf-981d-834c6bc022f7 service nova] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Received unexpected event network-vif-plugged-904c11d7-fd7b-46dc-b821-42186bfa849c for instance with vm_state building and task_state spawning.
Oct 25 21:29:36 user nova-compute[74189]: INFO nova.compute.manager [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Took 32.41 seconds to build instance.
Oct 25 21:29:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dd379a1e-42d3-4389-99cf-2d18634d6726 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "7de30b3e-49a6-4493-8ff5-3740d9a796e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.550s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:29:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "cdb13b8f-c136-4f2b-95b9-e464babac28a" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:29:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "cdb13b8f-c136-4f2b-95b9-e464babac28a" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:29:41 user nova-compute[74189]: INFO nova.compute.manager [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Rebooting instance
Oct 25 21:29:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "refresh_cache-cdb13b8f-c136-4f2b-95b9-e464babac28a" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:29:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquired lock "refresh_cache-cdb13b8f-c136-4f2b-95b9-e464babac28a" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:29:42 user nova-compute[74189]: DEBUG nova.network.neutron [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:29:43 user nova-compute[74189]: DEBUG nova.network.neutron [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Updating instance_info_cache with network_info: [{"id": "6a146bba-178b-4b17-be10-0410392d8b06", "address": "fa:16:3e:7f:d7:49", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a146bba-17", "ovs_interfaceid": "6a146bba-178b-4b17-be10-0410392d8b06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:29:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Releasing lock "refresh_cache-cdb13b8f-c136-4f2b-95b9-e464babac28a" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:29:43 user nova-compute[74189]: DEBUG nova.compute.manager [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:29:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:43 user nova-compute[74189]: DEBUG nova.compute.manager [req-070e0b62-6338-4501-8674-7de6fc3d8b8e req-f8593b52-797b-40d4-a7e8-ade9988c6b0e service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Received event network-vif-unplugged-6a146bba-178b-4b17-be10-0410392d8b06 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:29:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-070e0b62-6338-4501-8674-7de6fc3d8b8e req-f8593b52-797b-40d4-a7e8-ade9988c6b0e service nova] Acquiring lock "cdb13b8f-c136-4f2b-95b9-e464babac28a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:29:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-070e0b62-6338-4501-8674-7de6fc3d8b8e req-f8593b52-797b-40d4-a7e8-ade9988c6b0e service nova] Lock "cdb13b8f-c136-4f2b-95b9-e464babac28a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:29:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-070e0b62-6338-4501-8674-7de6fc3d8b8e req-f8593b52-797b-40d4-a7e8-ade9988c6b0e service nova] Lock "cdb13b8f-c136-4f2b-95b9-e464babac28a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:29:43 user nova-compute[74189]: DEBUG nova.compute.manager [req-070e0b62-6338-4501-8674-7de6fc3d8b8e req-f8593b52-797b-40d4-a7e8-ade9988c6b0e service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] No waiting events found dispatching network-vif-unplugged-6a146bba-178b-4b17-be10-0410392d8b06 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:29:43 user nova-compute[74189]: WARNING nova.compute.manager [req-070e0b62-6338-4501-8674-7de6fc3d8b8e req-f8593b52-797b-40d4-a7e8-ade9988c6b0e service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Received unexpected event network-vif-unplugged-6a146bba-178b-4b17-be10-0410392d8b06 for instance with vm_state active and task_state reboot_started_hard.
Oct 25 21:29:44 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Instance destroyed successfully.
Oct 25 21:29:44 user nova-compute[74189]: DEBUG nova.objects.instance [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lazy-loading 'resources' on Instance uuid cdb13b8f-c136-4f2b-95b9-e464babac28a {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:26:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-203509859',display_name='tempest-TestMinimumBasicScenario-server-203509859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-203509859',id=26,image_ref='aa2b6cc1-286b-43bf-b15c-d93296dcd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4z0OWc1huBv+7er3wDTCce5Gzj47ISPUaomWnov/1ylLmTYrJ3U3snYabzU/u51yiodhiArIMzrX6ZmmAOGafBpcWVPHiXEEAfzqGtBPL3XnJzz4AaxgWLjIB8rVfOCg==',key_name='tempest-TestMinimumBasicScenario-2109189230',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:27:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ee1339c959b4cbebeefd550fc436c61',ramdisk_id='',reservation_id='r-vdjf4bu6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa2b6cc1-286b-43bf-b15c-d93296dcd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1857244532',owner_user_name='tempest-TestMinimumBasicScenario-1857244532-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:29:43Z,user_data=None,user_id='a829dcf4095d45ab868a0ea904e9bfce',uuid=cdb13b8f-c136-4f2b-95b9-e464babac28a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a146bba-178b-4b17-be10-0410392d8b06", "address": "fa:16:3e:7f:d7:49", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a146bba-17", "ovs_interfaceid": "6a146bba-178b-4b17-be10-0410392d8b06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Converting VIF {"id": "6a146bba-178b-4b17-be10-0410392d8b06", "address": "fa:16:3e:7f:d7:49", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a146bba-17", "ovs_interfaceid": "6a146bba-178b-4b17-be10-0410392d8b06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:d7:49,bridge_name='br-int',has_traffic_filtering=True,id=6a146bba-178b-4b17-be10-0410392d8b06,network=Network(d0eb2495-d624-4f66-91a4-2d97b9461a19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a146bba-17') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_vif [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:d7:49,bridge_name='br-int',has_traffic_filtering=True,id=6a146bba-178b-4b17-be10-0410392d8b06,network=Network(d0eb2495-d624-4f66-91a4-2d97b9461a19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a146bba-17') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a146bba-17, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4b59741-5ce5-4802-a440-599bf3bb7b36) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:44 user nova-compute[74189]: INFO os_vif [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:d7:49,bridge_name='br-int',has_traffic_filtering=True,id=6a146bba-178b-4b17-be10-0410392d8b06,network=Network(d0eb2495-d624-4f66-91a4-2d97b9461a19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a146bba-17')
Oct 25 21:29:44 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cromsGNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:29:44 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb19ef7c-1bbc-4622-99e0-2970ece7c8f9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:29:44 user nova-compute[74189]: No targets found.
Oct 25 21:29:44 user nova-compute[74189]: iSNS:
Oct 25 21:29:44 user nova-compute[74189]: No targets found.
Oct 25 21:29:44 user nova-compute[74189]: STATIC:
Oct 25 21:29:44 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce
Oct 25 21:29:44 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:29:44 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:29:44 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d
Oct 25 21:29:44 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:29:44 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:29:44 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740
Oct 25 21:29:44 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:29:44 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:29:44 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1
Oct 25 21:29:44 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:29:44 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:29:44 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e
Oct 25 21:29:44 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:29:44 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:29:44 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:29:44 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:29:44 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:29:44 user nova-compute[74189]: FIRMWARE:
Oct 25 21:29:44 user nova-compute[74189]: No targets found.
Oct 25 21:29:44 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:29:44 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:29:44 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[426a307d-c86d-487c-a8cc-7684f19574ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[df475ddc-4f71-4366-875f-5984da9aa4eb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:29:44 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:29:44 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:29:44 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:29:44 user nova-compute[74189]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:29:44 user nova-compute[74189]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 (non-flash)
Oct 25 21:29:44 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:29:44 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:29:44 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:29:44 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:29:44 user nova-compute[74189]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:29:44 user nova-compute[74189]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 (non-flash)
Oct 25 21:29:44 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2e422edd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e'): ({'sdf'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Removing single pathed devices sdf {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e345b382-d89b-4575-a3f7-e004ea65a8a0]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a89aa79-d09a-4026-8879-79dbb8e51ad5]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Flushing IO for device /dev/sdf {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[65982170-237f-4a70-92e3-f1e5c03add0c]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45f6dff-3123-479d-8272-fe004bce0992]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] SCSI volumes sdf have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[935c3b3e-281a-4905-b228-bb7988df7941]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac02c9be-2eef-4147-a341-ce76e671bf14]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e, portal: 172.16.0.220,3260]
Oct 25 21:29:44 user nova-compute[74189]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e, portal: 172.16.0.220,3260] successful.
Oct 25 21:29:44 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1219a22a-b264-4963-834a-ffefb3957f3e]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] <== disconnect_volume: return (330ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Start _get_guest_xml network_info=[{"id": "6a146bba-178b-4b17-be10-0410392d8b06", "address": "fa:16:3e:7f:d7:49", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a146bba-17", "ovs_interfaceid": "6a146bba-178b-4b17-be10-0410392d8b06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=aa2b6cc1-286b-43bf-b15c-d93296dcd109,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': 'aa2b6cc1-286b-43bf-b15c-d93296dcd109'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cromsGNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'cdb13b8f-c136-4f2b-95b9-e464babac28a', 'attached_at': '', 'detached_at': '', 'volume_id': '0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e', 'serial': '0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e'}, 'attachment_id': '5a504ed0-9565-40b9-bfd6-c9062d831d30', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:29:44 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:29:44 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:29:44 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=aa2b6cc1-286b-43bf-b15c-d93296dcd109,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG nova.objects.instance [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lazy-loading 'vcpu_model' on Instance uuid cdb13b8f-c136-4f2b-95b9-e464babac28a {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG nova.objects.base [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Object Instance<cdb13b8f-c136-4f2b-95b9-e464babac28a> lazy-loaded attributes: resources,vcpu_model {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cromsGNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:29:44 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:29:44 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:29:44 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05261fc-2bfa-436c-9adf-ff2f13c227bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:29:44 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[257c4e26-74ac-47da-ac09-25dda426631d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e] added
Oct 25 21:29:44 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c612e2-29f2-4e2f-b6c2-70c2d9bbaaf2]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdad3561-8737-4edf-8d02-fd42ec61b53f]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cromsGNV {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cromsGNV" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c055c9-9a90-46b1-92c7-08ff73d977d8]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cromsGNV'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f9c48a-7fba-43bc-80e3-3971c531535f]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c294dae-c917-4fe8-a313-a4e8688e6389]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:29:44 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:29:44 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:29:44 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:29:44 user nova-compute[74189]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 (non-flash)
Oct 25 21:29:44 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:29:44 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:29:44 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:29:44 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:29:44 user nova-compute[74189]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 (non-flash)
Oct 25 21:29:44 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d657c1a5-7ff9-461b-a749-36b6e40cff79]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e, portal: 172.16.0.220,3260]
Oct 25 21:29:44 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e, portal: 172.16.0.220,3260] successful.
Oct 25 21:29:44 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[764460e9-9c58-44c1-8127-0f9510e3d8eb]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[60035a4b-8078-4004-a003-d6db19eb459f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:29:44 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:29:44 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:29:44 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:29:44 user nova-compute[74189]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 (non-flash)
Oct 25 21:29:44 user nova-compute[74189]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:29:44 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:29:44 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:29:44 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:29:44 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:29:44 user nova-compute[74189]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 (non-flash)
Oct 25 21:29:44 user nova-compute[74189]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:29:44 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbeeb46-bccf-485e-bb4a-6f246d622708]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:29:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cromsGNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:29:45 user nova-compute[74189]: DEBUG nova.compute.manager [req-9b89e5a7-851e-47d9-86f3-572b27ca32f9 req-f0041fd5-5d0b-4c0d-9681-1fdf7334892f service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Received event network-vif-plugged-6a146bba-178b-4b17-be10-0410392d8b06 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:29:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9b89e5a7-851e-47d9-86f3-572b27ca32f9 req-f0041fd5-5d0b-4c0d-9681-1fdf7334892f service nova] Acquiring lock "cdb13b8f-c136-4f2b-95b9-e464babac28a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:29:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9b89e5a7-851e-47d9-86f3-572b27ca32f9 req-f0041fd5-5d0b-4c0d-9681-1fdf7334892f service nova] Lock "cdb13b8f-c136-4f2b-95b9-e464babac28a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:29:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9b89e5a7-851e-47d9-86f3-572b27ca32f9 req-f0041fd5-5d0b-4c0d-9681-1fdf7334892f service nova] Lock "cdb13b8f-c136-4f2b-95b9-e464babac28a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:29:45 user nova-compute[74189]: DEBUG nova.compute.manager [req-9b89e5a7-851e-47d9-86f3-572b27ca32f9 req-f0041fd5-5d0b-4c0d-9681-1fdf7334892f service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] No waiting events found dispatching network-vif-plugged-6a146bba-178b-4b17-be10-0410392d8b06 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:29:45 user nova-compute[74189]: WARNING nova.compute.manager [req-9b89e5a7-851e-47d9-86f3-572b27ca32f9 req-f0041fd5-5d0b-4c0d-9681-1fdf7334892f service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Received unexpected event network-vif-plugged-6a146bba-178b-4b17-be10-0410392d8b06 for instance with vm_state active and task_state reboot_started_hard.
Oct 25 21:29:45 user nova-compute[74189]: DEBUG nova.compute.manager [req-bfcaf7af-667c-49ee-a4e7-42cdcbb5bcb7 req-243ed7bb-96fb-4999-b00a-2b53b3cc4267 service nova] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Received event network-changed-d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:29:45 user nova-compute[74189]: DEBUG nova.compute.manager [req-bfcaf7af-667c-49ee-a4e7-42cdcbb5bcb7 req-243ed7bb-96fb-4999-b00a-2b53b3cc4267 service nova] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Refreshing instance network info cache due to event network-changed-d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:29:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bfcaf7af-667c-49ee-a4e7-42cdcbb5bcb7 req-243ed7bb-96fb-4999-b00a-2b53b3cc4267 service nova] Acquiring lock "refresh_cache-c5ba374a-821b-424c-aeaa-528a0164160e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:29:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bfcaf7af-667c-49ee-a4e7-42cdcbb5bcb7 req-243ed7bb-96fb-4999-b00a-2b53b3cc4267 service nova] Acquired lock "refresh_cache-c5ba374a-821b-424c-aeaa-528a0164160e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:29:45 user nova-compute[74189]: DEBUG nova.network.neutron [req-bfcaf7af-667c-49ee-a4e7-42cdcbb5bcb7 req-243ed7bb-96fb-4999-b00a-2b53b3cc4267 service nova] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Refreshing network info cache for port d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:29:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:29:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:29:45 user nova-compute[74189]: DEBUG nova.objects.instance [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lazy-loading 'pci_requests' on Instance uuid a57b1185-270e-40d0-a55e-986960826169 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:29:45 user nova-compute[74189]: DEBUG nova.objects.instance [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lazy-loading 'numa_topology' on Instance uuid a57b1185-270e-40d0-a55e-986960826169 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:29:45 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:29:45 user nova-compute[74189]: INFO nova.compute.claims [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Claim successful on node user
Oct 25 21:29:45 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:29:45 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26433613434363239', 'path': '/dev/sdf'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:29:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433613434363239', 'path': '/dev/sdf'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:29:46 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:26:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-203509859',display_name='tempest-TestMinimumBasicScenario-server-203509859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-203509859',id=26,image_ref='aa2b6cc1-286b-43bf-b15c-d93296dcd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4z0OWc1huBv+7er3wDTCce5Gzj47ISPUaomWnov/1ylLmTYrJ3U3snYabzU/u51yiodhiArIMzrX6ZmmAOGafBpcWVPHiXEEAfzqGtBPL3XnJzz4AaxgWLjIB8rVfOCg==',key_name='tempest-TestMinimumBasicScenario-2109189230',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:27:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ee1339c959b4cbebeefd550fc436c61',ramdisk_id='',reservation_id='r-vdjf4bu6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa2b6cc1-286b-43bf-b15c-d93296dcd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1857244532',owner_user_name='tempest-TestMinimumBasicScenario-1857244532-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:29:43Z,user_data=None,user_id='a829dcf4095d45ab868a0ea904e9bfce',uuid=cdb13b8f-c136-4f2b-95b9-e464babac28a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a146bba-178b-4b17-be10-0410392d8b06", "address": "fa:16:3e:7f:d7:49", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a146bba-17", "ovs_interfaceid": "6a146bba-178b-4b17-be10-0410392d8b06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:29:46 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Converting VIF {"id": "6a146bba-178b-4b17-be10-0410392d8b06", "address": "fa:16:3e:7f:d7:49", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a146bba-17", "ovs_interfaceid": "6a146bba-178b-4b17-be10-0410392d8b06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:29:46 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:d7:49,bridge_name='br-int',has_traffic_filtering=True,id=6a146bba-178b-4b17-be10-0410392d8b06,network=Network(d0eb2495-d624-4f66-91a4-2d97b9461a19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a146bba-17') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:29:46 user nova-compute[74189]: DEBUG nova.objects.instance [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lazy-loading 'pci_devices' on Instance uuid cdb13b8f-c136-4f2b-95b9-e464babac28a {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:29:46 user nova-compute[74189]: DEBUG nova.objects.base [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Object Instance<cdb13b8f-c136-4f2b-95b9-e464babac28a> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:29:46 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:29:46 user nova-compute[74189]:   <uuid>cdb13b8f-c136-4f2b-95b9-e464babac28a</uuid>
Oct 25 21:29:46 user nova-compute[74189]:   <name>instance-0000001a</name>
Oct 25 21:29:46 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:29:46 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:29:46 user nova-compute[74189]:   <metadata>
Oct 25 21:29:46 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:29:46 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:29:46 user nova-compute[74189]:       <nova:name>tempest-TestMinimumBasicScenario-server-203509859</nova:name>
Oct 25 21:29:46 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:29:44</nova:creationTime>
Oct 25 21:29:46 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:29:46 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:29:46 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:29:46 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:29:46 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:29:46 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:29:46 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:29:46 user nova-compute[74189]:       <nova:owner>
Oct 25 21:29:46 user nova-compute[74189]:         <nova:user uuid="a829dcf4095d45ab868a0ea904e9bfce">tempest-TestMinimumBasicScenario-1857244532-project-member</nova:user>
Oct 25 21:29:46 user nova-compute[74189]:         <nova:project uuid="3ee1339c959b4cbebeefd550fc436c61">tempest-TestMinimumBasicScenario-1857244532</nova:project>
Oct 25 21:29:46 user nova-compute[74189]:       </nova:owner>
Oct 25 21:29:46 user nova-compute[74189]:       <nova:root type="image" uuid="aa2b6cc1-286b-43bf-b15c-d93296dcd109"/>
Oct 25 21:29:46 user nova-compute[74189]:       <nova:ports>
Oct 25 21:29:46 user nova-compute[74189]:         <nova:port uuid="6a146bba-178b-4b17-be10-0410392d8b06">
Oct 25 21:29:46 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 25 21:29:46 user nova-compute[74189]:         </nova:port>
Oct 25 21:29:46 user nova-compute[74189]:       </nova:ports>
Oct 25 21:29:46 user nova-compute[74189]:     </nova:instance>
Oct 25 21:29:46 user nova-compute[74189]:   </metadata>
Oct 25 21:29:46 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:29:46 user nova-compute[74189]:     <system>
Oct 25 21:29:46 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:29:46 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:29:46 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:29:46 user nova-compute[74189]:       <entry name="serial">cdb13b8f-c136-4f2b-95b9-e464babac28a</entry>
Oct 25 21:29:46 user nova-compute[74189]:       <entry name="uuid">cdb13b8f-c136-4f2b-95b9-e464babac28a</entry>
Oct 25 21:29:46 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:29:46 user nova-compute[74189]:     </system>
Oct 25 21:29:46 user nova-compute[74189]:   </sysinfo>
Oct 25 21:29:46 user nova-compute[74189]:   <os>
Oct 25 21:29:46 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:29:46 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:29:46 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:29:46 user nova-compute[74189]:   </os>
Oct 25 21:29:46 user nova-compute[74189]:   <features>
Oct 25 21:29:46 user nova-compute[74189]:     <acpi/>
Oct 25 21:29:46 user nova-compute[74189]:     <apic/>
Oct 25 21:29:46 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:29:46 user nova-compute[74189]:   </features>
Oct 25 21:29:46 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:29:46 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:29:46 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:29:46 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:29:46 user nova-compute[74189]:   </clock>
Oct 25 21:29:46 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:29:46 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:29:46 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:29:46 user nova-compute[74189]:   </cpu>
Oct 25 21:29:46 user nova-compute[74189]:   <devices>
Oct 25 21:29:46 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:29:46 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:29:46 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk"/>
Oct 25 21:29:46 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:29:46 user nova-compute[74189]:     </disk>
Oct 25 21:29:46 user nova-compute[74189]:     <disk type="block" device="disk">
Oct 25 21:29:46 user nova-compute[74189]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:29:46 user nova-compute[74189]:       <source dev="/dev/sdf"/>
Oct 25 21:29:46 user nova-compute[74189]:       <target dev="vdb" bus="virtio"/>
Oct 25 21:29:46 user nova-compute[74189]:       <serial>0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e</serial>
Oct 25 21:29:46 user nova-compute[74189]:     </disk>
Oct 25 21:29:46 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:29:46 user nova-compute[74189]:       <mac address="fa:16:3e:7f:d7:49"/>
Oct 25 21:29:46 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:29:46 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:29:46 user nova-compute[74189]:       <target dev="tap6a146bba-17"/>
Oct 25 21:29:46 user nova-compute[74189]:     </interface>
Oct 25 21:29:46 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:29:46 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/console.log" append="off"/>
Oct 25 21:29:46 user nova-compute[74189]:     </serial>
Oct 25 21:29:46 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:29:46 user nova-compute[74189]:     <video>
Oct 25 21:29:46 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:29:46 user nova-compute[74189]:     </video>
Oct 25 21:29:46 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:29:46 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:29:46 user nova-compute[74189]:     </rng>
Oct 25 21:29:46 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:29:46 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:29:46 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:29:46 user nova-compute[74189]:     </memballoon>
Oct 25 21:29:46 user nova-compute[74189]:   </devices>
Oct 25 21:29:46 user nova-compute[74189]: </domain>
Oct 25 21:29:46 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:29:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:46 user nova-compute[74189]: DEBUG nova.network.neutron [req-bfcaf7af-667c-49ee-a4e7-42cdcbb5bcb7 req-243ed7bb-96fb-4999-b00a-2b53b3cc4267 service nova] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Updated VIF entry in instance network info cache for port d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:29:46 user nova-compute[74189]: DEBUG nova.network.neutron [req-bfcaf7af-667c-49ee-a4e7-42cdcbb5bcb7 req-243ed7bb-96fb-4999-b00a-2b53b3cc4267 service nova] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Updating instance_info_cache with network_info: [{"id": "d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b", "address": "fa:16:3e:7b:b8:af", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dcfc4c-1d", "ovs_interfaceid": "d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:29:46 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:29:46 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:29:46 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bfcaf7af-667c-49ee-a4e7-42cdcbb5bcb7 req-243ed7bb-96fb-4999-b00a-2b53b3cc4267 service nova] Releasing lock "refresh_cache-c5ba374a-821b-424c-aeaa-528a0164160e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:29:46 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.640s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:29:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:46 user nova-compute[74189]: INFO nova.network.neutron [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Updating port ecc4dd08-df4f-445b-81eb-b3946804aef8 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 25 21:29:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:46 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:29:46 user nova-compute[74189]: DEBUG nova.objects.instance [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lazy-loading 'trusted_certs' on Instance uuid cdb13b8f-c136-4f2b-95b9-e464babac28a {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:29:46 user nova-compute[74189]: DEBUG nova.objects.base [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Object Instance<cdb13b8f-c136-4f2b-95b9-e464babac28a> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:29:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/585e49721907e895ad71a4154c3a8aefaef1f6e2 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/585e49721907e895ad71a4154c3a8aefaef1f6e2 --force-share --output=json" returned: 0 in 0.172s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:46 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:29:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Cannot resize image /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG nova.objects.instance [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lazy-loading 'migration_context' on Instance uuid cdb13b8f-c136-4f2b-95b9-e464babac28a {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG nova.objects.base [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Object Instance<cdb13b8f-c136-4f2b-95b9-e464babac28a> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:26:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-203509859',display_name='tempest-TestMinimumBasicScenario-server-203509859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-203509859',id=26,image_ref='aa2b6cc1-286b-43bf-b15c-d93296dcd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4z0OWc1huBv+7er3wDTCce5Gzj47ISPUaomWnov/1ylLmTYrJ3U3snYabzU/u51yiodhiArIMzrX6ZmmAOGafBpcWVPHiXEEAfzqGtBPL3XnJzz4AaxgWLjIB8rVfOCg==',key_name='tempest-TestMinimumBasicScenario-2109189230',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:27:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='3ee1339c959b4cbebeefd550fc436c61',ramdisk_id='',reservation_id='r-vdjf4bu6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa2b6cc1-286b-43bf-b15c-d93296dcd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1857244532',owner_user_name='tempest-TestMinimumBasicScenario-1857244532-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:29:43Z,user_data=None,user_id='a829dcf4095d45ab868a0ea904e9bfce',uuid=cdb13b8f-c136-4f2b-95b9-e464babac28a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a146bba-178b-4b17-be10-0410392d8b06", "address": "fa:16:3e:7f:d7:49", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a146bba-17", "ovs_interfaceid": "6a146bba-178b-4b17-be10-0410392d8b06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Converting VIF {"id": "6a146bba-178b-4b17-be10-0410392d8b06", "address": "fa:16:3e:7f:d7:49", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a146bba-17", "ovs_interfaceid": "6a146bba-178b-4b17-be10-0410392d8b06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:d7:49,bridge_name='br-int',has_traffic_filtering=True,id=6a146bba-178b-4b17-be10-0410392d8b06,network=Network(d0eb2495-d624-4f66-91a4-2d97b9461a19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a146bba-17') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG os_vif [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:d7:49,bridge_name='br-int',has_traffic_filtering=True,id=6a146bba-178b-4b17-be10-0410392d8b06,network=Network(d0eb2495-d624-4f66-91a4-2d97b9461a19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a146bba-17') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ff0e20ed-a4bf-574f-a8b7-befb2fb9afd8', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a146bba-17, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a146bba-17, col_values=(('qos', UUID('ca6a64c3-5cac-48a0-9632-e383edc59aa1')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a146bba-17, col_values=(('external_ids', {'iface-id': '6a146bba-178b-4b17-be10-0410392d8b06', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:d7:49', 'vm-uuid': 'cdb13b8f-c136-4f2b-95b9-e464babac28a'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:47 user nova-compute[74189]: INFO os_vif [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:d7:49,bridge_name='br-int',has_traffic_filtering=True,id=6a146bba-178b-4b17-be10-0410392d8b06,network=Network(d0eb2495-d624-4f66-91a4-2d97b9461a19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a146bba-17')
Oct 25 21:29:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-400b378a-33e8-4d46-a961-625f9febecab tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Acquiring lock "75071d8a-2ce2-43b5-99f6-23853399dc97" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-400b378a-33e8-4d46-a961-625f9febecab tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-400b378a-33e8-4d46-a961-625f9febecab tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Acquiring lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-400b378a-33e8-4d46-a961-625f9febecab tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-400b378a-33e8-4d46-a961-625f9febecab tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:29:47 user nova-compute[74189]: INFO nova.compute.manager [None req-400b378a-33e8-4d46-a961-625f9febecab tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Terminating instance
Oct 25 21:29:47 user nova-compute[74189]: DEBUG nova.compute.manager [None req-400b378a-33e8-4d46-a961-625f9febecab tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG nova.objects.instance [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lazy-loading 'flavor' on Instance uuid de6b6789-b328-4c3b-8d24-07774d5dbe6d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "refresh_cache-de6b6789-b328-4c3b-8d24-07774d5dbe6d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquired lock "refresh_cache-de6b6789-b328-4c3b-8d24-07774d5dbe6d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG nova.network.neutron [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG nova.objects.instance [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lazy-loading 'info_cache' on Instance uuid de6b6789-b328-4c3b-8d24-07774d5dbe6d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG nova.objects.base [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Object Instance<de6b6789-b328-4c3b-8d24-07774d5dbe6d> lazy-loaded attributes: flavor,info_cache {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "refresh_cache-a57b1185-270e-40d0-a55e-986960826169" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquired lock "refresh_cache-a57b1185-270e-40d0-a55e-986960826169" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG nova.network.neutron [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG nova.compute.manager [req-18c1c8d3-8f83-457b-b9a7-9ce800bff6d6 req-68c9e263-a34d-4a0b-ae96-e4365d1e3812 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received event network-changed-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG nova.compute.manager [req-18c1c8d3-8f83-457b-b9a7-9ce800bff6d6 req-68c9e263-a34d-4a0b-ae96-e4365d1e3812 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Refreshing instance network info cache due to event network-changed-ecc4dd08-df4f-445b-81eb-b3946804aef8. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-18c1c8d3-8f83-457b-b9a7-9ce800bff6d6 req-68c9e263-a34d-4a0b-ae96-e4365d1e3812 service nova] Acquiring lock "refresh_cache-a57b1185-270e-40d0-a55e-986960826169" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG nova.compute.manager [req-57be20e5-d14b-4f90-a5dd-37908d0ef97f req-521bb781-2625-45b1-9ac2-9952e4250316 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Received event network-vif-unplugged-54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-57be20e5-d14b-4f90-a5dd-37908d0ef97f req-521bb781-2625-45b1-9ac2-9952e4250316 service nova] Acquiring lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-57be20e5-d14b-4f90-a5dd-37908d0ef97f req-521bb781-2625-45b1-9ac2-9952e4250316 service nova] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-57be20e5-d14b-4f90-a5dd-37908d0ef97f req-521bb781-2625-45b1-9ac2-9952e4250316 service nova] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG nova.compute.manager [req-57be20e5-d14b-4f90-a5dd-37908d0ef97f req-521bb781-2625-45b1-9ac2-9952e4250316 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] No waiting events found dispatching network-vif-unplugged-54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:29:47 user nova-compute[74189]: DEBUG nova.compute.manager [req-57be20e5-d14b-4f90-a5dd-37908d0ef97f req-521bb781-2625-45b1-9ac2-9952e4250316 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Received event network-vif-unplugged-54123e00-9921-4807-b1f7-79073453a82f for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.network.neutron [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Updating instance_info_cache with network_info: [{"id": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "address": "fa:16:3e:df:d0:7a", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bbbcbc-08", "ovs_interfaceid": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Releasing lock "refresh_cache-de6b6789-b328-4c3b-8d24-07774d5dbe6d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:29:48 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Instance destroyed successfully.
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.objects.instance [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lazy-loading 'resources' on Instance uuid de6b6789-b328-4c3b-8d24-07774d5dbe6d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.objects.base [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Object Instance<de6b6789-b328-4c3b-8d24-07774d5dbe6d> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:21:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1758392823',display_name='tempest-AttachVolumeTestJSON-server-1758392823',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1758392823',id=17,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPiYEbKeppJsHkf9Hx5OHRO2CLzGAPd2wBVnTnbTrf7OneA+NCoBGPS8Iup7Bh8CoPm7/VcfZ0KMuu8zfSepXMiLSwU39yVEsYz6SpCmvS4oU93LKx611A6fXbw0yJUBA==',key_name='tempest-keypair-2000039022',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:21:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d1d0f1deb7f04244920dae579032b287',ramdisk_id='',reservation_id='r-90yevjj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1213560671',owner_user_name='tempest-AttachVolumeTestJSON-1213560671-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:27:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e55da2b7458469e844fad1fe95cb695',uuid=de6b6789-b328-4c3b-8d24-07774d5dbe6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "address": "fa:16:3e:df:d0:7a", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bbbcbc-08", "ovs_interfaceid": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Converting VIF {"id": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "address": "fa:16:3e:df:d0:7a", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bbbcbc-08", "ovs_interfaceid": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:d0:7a,bridge_name='br-int',has_traffic_filtering=True,id=b0bbbcbc-085e-476f-b600-f1d684f23beb,network=Network(1d219ea7-a949-4c77-9cd1-79cc99d6ac42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bbbcbc-08') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG os_vif [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:d0:7a,bridge_name='br-int',has_traffic_filtering=True,id=b0bbbcbc-085e-476f-b600-f1d684f23beb,network=Network(1d219ea7-a949-4c77-9cd1-79cc99d6ac42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bbbcbc-08') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0bbbcbc-08, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.network.neutron [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Updating instance_info_cache with network_info: [{"id": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "address": "fa:16:3e:6b:ad:c5", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc4dd08-df", "ovs_interfaceid": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6737f0ab-0ff9-4893-bc33-eef7557963a0) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Releasing lock "refresh_cache-a57b1185-270e-40d0-a55e-986960826169" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:29:48 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Creating image(s)
Oct 25 21:29:48 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "/opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "/opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "/opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.objects.instance [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lazy-loading 'trusted_certs' on Instance uuid a57b1185-270e-40d0-a55e-986960826169 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-18c1c8d3-8f83-457b-b9a7-9ce800bff6d6 req-68c9e263-a34d-4a0b-ae96-e4365d1e3812 service nova] Acquired lock "refresh_cache-a57b1185-270e-40d0-a55e-986960826169" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.network.neutron [req-18c1c8d3-8f83-457b-b9a7-9ce800bff6d6 req-68c9e263-a34d-4a0b-ae96-e4365d1e3812 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Refreshing network info cache for port ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.objects.base [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Object Instance<a57b1185-270e-40d0-a55e-986960826169> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "fbf2ce42cb9248d36efe9eaf3f3104cd76c61fba" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "fbf2ce42cb9248d36efe9eaf3f3104cd76c61fba" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:29:48 user nova-compute[74189]: INFO os_vif [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:d0:7a,bridge_name='br-int',has_traffic_filtering=True,id=b0bbbcbc-085e-476f-b600-f1d684f23beb,network=Network(1d219ea7-a949-4c77-9cd1-79cc99d6ac42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bbbcbc-08')
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Start _get_guest_xml network_info=[{"id": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "address": "fa:16:3e:df:d0:7a", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bbbcbc-08", "ovs_interfaceid": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.objects.instance [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lazy-loading 'numa_topology' on Instance uuid de6b6789-b328-4c3b-8d24-07774d5dbe6d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.objects.base [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Object Instance<de6b6789-b328-4c3b-8d24-07774d5dbe6d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:29:48 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:29:48 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.objects.instance [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lazy-loading 'vcpu_model' on Instance uuid de6b6789-b328-4c3b-8d24-07774d5dbe6d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.objects.base [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Object Instance<de6b6789-b328-4c3b-8d24-07774d5dbe6d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:21:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1758392823',display_name='tempest-AttachVolumeTestJSON-server-1758392823',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1758392823',id=17,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPiYEbKeppJsHkf9Hx5OHRO2CLzGAPd2wBVnTnbTrf7OneA+NCoBGPS8Iup7Bh8CoPm7/VcfZ0KMuu8zfSepXMiLSwU39yVEsYz6SpCmvS4oU93LKx611A6fXbw0yJUBA==',key_name='tempest-keypair-2000039022',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:21:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d1d0f1deb7f04244920dae579032b287',ramdisk_id='',reservation_id='r-90yevjj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1213560671',owner_user_name='tempest-AttachVolumeTestJSON-1213560671-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:27:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e55da2b7458469e844fad1fe95cb695',uuid=de6b6789-b328-4c3b-8d24-07774d5dbe6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "address": "fa:16:3e:df:d0:7a", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bbbcbc-08", "ovs_interfaceid": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Converting VIF {"id": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "address": "fa:16:3e:df:d0:7a", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bbbcbc-08", "ovs_interfaceid": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:d0:7a,bridge_name='br-int',has_traffic_filtering=True,id=b0bbbcbc-085e-476f-b600-f1d684f23beb,network=Network(1d219ea7-a949-4c77-9cd1-79cc99d6ac42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bbbcbc-08') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG nova.objects.instance [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lazy-loading 'pci_devices' on Instance uuid de6b6789-b328-4c3b-8d24-07774d5dbe6d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:29:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbf2ce42cb9248d36efe9eaf3f3104cd76c61fba.part --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:49 user nova-compute[74189]: DEBUG nova.objects.base [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Object Instance<de6b6789-b328-4c3b-8d24-07774d5dbe6d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:29:49 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:29:49 user nova-compute[74189]:   <uuid>de6b6789-b328-4c3b-8d24-07774d5dbe6d</uuid>
Oct 25 21:29:49 user nova-compute[74189]:   <name>instance-00000011</name>
Oct 25 21:29:49 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:29:49 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:29:49 user nova-compute[74189]:   <metadata>
Oct 25 21:29:49 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:29:49 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:29:49 user nova-compute[74189]:       <nova:name>tempest-AttachVolumeTestJSON-server-1758392823</nova:name>
Oct 25 21:29:49 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:29:48</nova:creationTime>
Oct 25 21:29:49 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:29:49 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:29:49 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:29:49 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:29:49 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:29:49 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:29:49 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:29:49 user nova-compute[74189]:       <nova:owner>
Oct 25 21:29:49 user nova-compute[74189]:         <nova:user uuid="9e55da2b7458469e844fad1fe95cb695">tempest-AttachVolumeTestJSON-1213560671-project-member</nova:user>
Oct 25 21:29:49 user nova-compute[74189]:         <nova:project uuid="d1d0f1deb7f04244920dae579032b287">tempest-AttachVolumeTestJSON-1213560671</nova:project>
Oct 25 21:29:49 user nova-compute[74189]:       </nova:owner>
Oct 25 21:29:49 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:29:49 user nova-compute[74189]:       <nova:ports>
Oct 25 21:29:49 user nova-compute[74189]:         <nova:port uuid="b0bbbcbc-085e-476f-b600-f1d684f23beb">
Oct 25 21:29:49 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 21:29:49 user nova-compute[74189]:         </nova:port>
Oct 25 21:29:49 user nova-compute[74189]:       </nova:ports>
Oct 25 21:29:49 user nova-compute[74189]:     </nova:instance>
Oct 25 21:29:49 user nova-compute[74189]:   </metadata>
Oct 25 21:29:49 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:29:49 user nova-compute[74189]:     <system>
Oct 25 21:29:49 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:29:49 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:29:49 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:29:49 user nova-compute[74189]:       <entry name="serial">de6b6789-b328-4c3b-8d24-07774d5dbe6d</entry>
Oct 25 21:29:49 user nova-compute[74189]:       <entry name="uuid">de6b6789-b328-4c3b-8d24-07774d5dbe6d</entry>
Oct 25 21:29:49 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:29:49 user nova-compute[74189]:     </system>
Oct 25 21:29:49 user nova-compute[74189]:   </sysinfo>
Oct 25 21:29:49 user nova-compute[74189]:   <os>
Oct 25 21:29:49 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:29:49 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:29:49 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:29:49 user nova-compute[74189]:   </os>
Oct 25 21:29:49 user nova-compute[74189]:   <features>
Oct 25 21:29:49 user nova-compute[74189]:     <acpi/>
Oct 25 21:29:49 user nova-compute[74189]:     <apic/>
Oct 25 21:29:49 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:29:49 user nova-compute[74189]:   </features>
Oct 25 21:29:49 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:29:49 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:29:49 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:29:49 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:29:49 user nova-compute[74189]:   </clock>
Oct 25 21:29:49 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:29:49 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:29:49 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:29:49 user nova-compute[74189]:   </cpu>
Oct 25 21:29:49 user nova-compute[74189]:   <devices>
Oct 25 21:29:49 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:29:49 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:29:49 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk"/>
Oct 25 21:29:49 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:29:49 user nova-compute[74189]:     </disk>
Oct 25 21:29:49 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:29:49 user nova-compute[74189]:       <mac address="fa:16:3e:df:d0:7a"/>
Oct 25 21:29:49 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:29:49 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:29:49 user nova-compute[74189]:       <target dev="tapb0bbbcbc-08"/>
Oct 25 21:29:49 user nova-compute[74189]:     </interface>
Oct 25 21:29:49 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:29:49 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/console.log" append="off"/>
Oct 25 21:29:49 user nova-compute[74189]:     </serial>
Oct 25 21:29:49 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:29:49 user nova-compute[74189]:     <video>
Oct 25 21:29:49 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:29:49 user nova-compute[74189]:     </video>
Oct 25 21:29:49 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:29:49 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:29:49 user nova-compute[74189]:     </rng>
Oct 25 21:29:49 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:29:49 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:29:49 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:29:49 user nova-compute[74189]:     </memballoon>
Oct 25 21:29:49 user nova-compute[74189]:   </devices>
Oct 25 21:29:49 user nova-compute[74189]: </domain>
Oct 25 21:29:49 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:29:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:49 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Instance destroyed successfully.
Oct 25 21:29:49 user nova-compute[74189]: DEBUG nova.objects.instance [None req-400b378a-33e8-4d46-a961-625f9febecab tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lazy-loading 'resources' on Instance uuid 75071d8a-2ce2-43b5-99f6-23853399dc97 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:29:49 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-400b378a-33e8-4d46-a961-625f9febecab tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1061125685',display_name='tempest-ServerStableDeviceRescueTest-server-1061125685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1061125685',id=19,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC20gTviyjNJBjxArKToE8AgxJM88oQS6J0/B2LSO3z48gSESlt2Qa5Ij29DDLKcOPNYWCIhOLQrsgZVfD03v7gd4V+2bdXXxGL2qgyJABqFDgeQggV88dXUclIdYhAD0g==',key_name='tempest-keypair-1832175527',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:26:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='046417147a924afdbc8b72333c362261',ramdisk_id='',reservation_id='r-wm74eoqy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1979035755',owner_user_name='tempest-ServerStableDeviceRescueTest-1979035755-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:28:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e2a4908113594f96adeab0b362046568',uuid=75071d8a-2ce2-43b5-99f6-23853399dc97,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54123e00-9921-4807-b1f7-79073453a82f", "address": "fa:16:3e:02:6a:1d", "network": {"id": "3159e1a7-f60f-4768-9e06-a92287d19dd6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-119288589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046417147a924afdbc8b72333c362261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54123e00-99", "ovs_interfaceid": "54123e00-9921-4807-b1f7-79073453a82f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:29:49 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-400b378a-33e8-4d46-a961-625f9febecab tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Converting VIF {"id": "54123e00-9921-4807-b1f7-79073453a82f", "address": "fa:16:3e:02:6a:1d", "network": {"id": "3159e1a7-f60f-4768-9e06-a92287d19dd6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-119288589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046417147a924afdbc8b72333c362261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54123e00-99", "ovs_interfaceid": "54123e00-9921-4807-b1f7-79073453a82f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:29:49 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-400b378a-33e8-4d46-a961-625f9febecab tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:6a:1d,bridge_name='br-int',has_traffic_filtering=True,id=54123e00-9921-4807-b1f7-79073453a82f,network=Network(3159e1a7-f60f-4768-9e06-a92287d19dd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54123e00-99') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:29:49 user nova-compute[74189]: DEBUG os_vif [None req-400b378a-33e8-4d46-a961-625f9febecab tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:6a:1d,bridge_name='br-int',has_traffic_filtering=True,id=54123e00-9921-4807-b1f7-79073453a82f,network=Network(3159e1a7-f60f-4768-9e06-a92287d19dd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54123e00-99') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:29:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54123e00-99, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:29:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:29:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c3c54036-be82-4c23-ba0b-a03427c38f9d) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:29:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:29:49 user nova-compute[74189]: INFO os_vif [None req-400b378a-33e8-4d46-a961-625f9febecab tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:6a:1d,bridge_name='br-int',has_traffic_filtering=True,id=54123e00-9921-4807-b1f7-79073453a82f,network=Network(3159e1a7-f60f-4768-9e06-a92287d19dd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54123e00-99')
Oct 25 21:29:49 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-400b378a-33e8-4d46-a961-625f9febecab tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Deleting instance files /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97_del
Oct 25 21:29:49 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-400b378a-33e8-4d46-a961-625f9febecab tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Deletion of /opt/stack/data/nova/instances/75071d8a-2ce2-43b5-99f6-23853399dc97_del complete
Oct 25 21:29:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbf2ce42cb9248d36efe9eaf3f3104cd76c61fba.part --force-share --output=json" returned: 0 in 0.256s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:49 user nova-compute[74189]: DEBUG nova.virt.images [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] b646bcdf-ed18-4e0e-a4f7-3b15c220907d was qcow2, converting to raw {{(pid=74189) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 21:29:49 user nova-compute[74189]: DEBUG nova.privsep.utils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74189) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 21:29:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fbf2ce42cb9248d36efe9eaf3f3104cd76c61fba.part /opt/stack/data/nova/instances/_base/fbf2ce42cb9248d36efe9eaf3f3104cd76c61fba.converted {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:50 user nova-compute[74189]: INFO nova.compute.manager [None req-400b378a-33e8-4d46-a961-625f9febecab tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Took 2.80 seconds to destroy the instance on the hypervisor.
Oct 25 21:29:50 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-400b378a-33e8-4d46-a961-625f9febecab tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG nova.compute.manager [req-b1d6c449-aa94-490d-aa51-df9347033853 req-72267a24-b978-467f-8e13-e6cd8c45e419 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Received event network-vif-plugged-54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b1d6c449-aa94-490d-aa51-df9347033853 req-72267a24-b978-467f-8e13-e6cd8c45e419 service nova] Acquiring lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b1d6c449-aa94-490d-aa51-df9347033853 req-72267a24-b978-467f-8e13-e6cd8c45e419 service nova] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b1d6c449-aa94-490d-aa51-df9347033853 req-72267a24-b978-467f-8e13-e6cd8c45e419 service nova] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG nova.compute.manager [req-b1d6c449-aa94-490d-aa51-df9347033853 req-72267a24-b978-467f-8e13-e6cd8c45e419 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] No waiting events found dispatching network-vif-plugged-54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:29:50 user nova-compute[74189]: WARNING nova.compute.manager [req-b1d6c449-aa94-490d-aa51-df9347033853 req-72267a24-b978-467f-8e13-e6cd8c45e419 service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Received unexpected event network-vif-plugged-54123e00-9921-4807-b1f7-79073453a82f for instance with vm_state active and task_state deleting.
Oct 25 21:29:50 user nova-compute[74189]: DEBUG nova.compute.manager [req-b1d6c449-aa94-490d-aa51-df9347033853 req-72267a24-b978-467f-8e13-e6cd8c45e419 service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Received event network-vif-plugged-6a146bba-178b-4b17-be10-0410392d8b06 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b1d6c449-aa94-490d-aa51-df9347033853 req-72267a24-b978-467f-8e13-e6cd8c45e419 service nova] Acquiring lock "cdb13b8f-c136-4f2b-95b9-e464babac28a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b1d6c449-aa94-490d-aa51-df9347033853 req-72267a24-b978-467f-8e13-e6cd8c45e419 service nova] Lock "cdb13b8f-c136-4f2b-95b9-e464babac28a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b1d6c449-aa94-490d-aa51-df9347033853 req-72267a24-b978-467f-8e13-e6cd8c45e419 service nova] Lock "cdb13b8f-c136-4f2b-95b9-e464babac28a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG nova.compute.manager [req-b1d6c449-aa94-490d-aa51-df9347033853 req-72267a24-b978-467f-8e13-e6cd8c45e419 service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] No waiting events found dispatching network-vif-plugged-6a146bba-178b-4b17-be10-0410392d8b06 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:29:50 user nova-compute[74189]: WARNING nova.compute.manager [req-b1d6c449-aa94-490d-aa51-df9347033853 req-72267a24-b978-467f-8e13-e6cd8c45e419 service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Received unexpected event network-vif-plugged-6a146bba-178b-4b17-be10-0410392d8b06 for instance with vm_state active and task_state reboot_started_hard.
Oct 25 21:29:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG nova.objects.instance [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lazy-loading 'trusted_certs' on Instance uuid de6b6789-b328-4c3b-8d24-07774d5dbe6d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG nova.objects.base [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Object Instance<de6b6789-b328-4c3b-8d24-07774d5dbe6d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG nova.network.neutron [req-18c1c8d3-8f83-457b-b9a7-9ce800bff6d6 req-68c9e263-a34d-4a0b-ae96-e4365d1e3812 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Updated VIF entry in instance network info cache for port ecc4dd08-df4f-445b-81eb-b3946804aef8. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG nova.network.neutron [req-18c1c8d3-8f83-457b-b9a7-9ce800bff6d6 req-68c9e263-a34d-4a0b-ae96-e4365d1e3812 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Updating instance_info_cache with network_info: [{"id": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "address": "fa:16:3e:6b:ad:c5", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc4dd08-df", "ovs_interfaceid": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-18c1c8d3-8f83-457b-b9a7-9ce800bff6d6 req-68c9e263-a34d-4a0b-ae96-e4365d1e3812 service nova] Releasing lock "refresh_cache-a57b1185-270e-40d0-a55e-986960826169" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.266s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fbf2ce42cb9248d36efe9eaf3f3104cd76c61fba.part /opt/stack/data/nova/instances/_base/fbf2ce42cb9248d36efe9eaf3f3104cd76c61fba.converted" returned: 0 in 0.760s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbf2ce42cb9248d36efe9eaf3f3104cd76c61fba.converted --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Cannot resize image /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG nova.objects.instance [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lazy-loading 'migration_context' on Instance uuid de6b6789-b328-4c3b-8d24-07774d5dbe6d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG nova.objects.base [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Object Instance<de6b6789-b328-4c3b-8d24-07774d5dbe6d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:21:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1758392823',display_name='tempest-AttachVolumeTestJSON-server-1758392823',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1758392823',id=17,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPiYEbKeppJsHkf9Hx5OHRO2CLzGAPd2wBVnTnbTrf7OneA+NCoBGPS8Iup7Bh8CoPm7/VcfZ0KMuu8zfSepXMiLSwU39yVEsYz6SpCmvS4oU93LKx611A6fXbw0yJUBA==',key_name='tempest-keypair-2000039022',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:21:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='d1d0f1deb7f04244920dae579032b287',ramdisk_id='',reservation_id='r-90yevjj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1213560671',owner_user_name='tempest-AttachVolumeTestJSON-1213560671-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:27:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e55da2b7458469e844fad1fe95cb695',uuid=de6b6789-b328-4c3b-8d24-07774d5dbe6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "address": "fa:16:3e:df:d0:7a", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bbbcbc-08", "ovs_interfaceid": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Converting VIF {"id": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "address": "fa:16:3e:df:d0:7a", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bbbcbc-08", "ovs_interfaceid": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:d0:7a,bridge_name='br-int',has_traffic_filtering=True,id=b0bbbcbc-085e-476f-b600-f1d684f23beb,network=Network(1d219ea7-a949-4c77-9cd1-79cc99d6ac42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bbbcbc-08') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG os_vif [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:d0:7a,bridge_name='br-int',has_traffic_filtering=True,id=b0bbbcbc-085e-476f-b600-f1d684f23beb,network=Network(1d219ea7-a949-4c77-9cd1-79cc99d6ac42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bbbcbc-08') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15c15be6-9f0b-54e6-8f6c-4f53901d39e5', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0bbbcbc-08, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb0bbbcbc-08, col_values=(('qos', UUID('21f58b24-809a-471e-a2d6-12fb80d34ef3')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb0bbbcbc-08, col_values=(('external_ids', {'iface-id': 'b0bbbcbc-085e-476f-b600-f1d684f23beb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:d0:7a', 'vm-uuid': 'de6b6789-b328-4c3b-8d24-07774d5dbe6d'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:50 user nova-compute[74189]: INFO os_vif [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:d0:7a,bridge_name='br-int',has_traffic_filtering=True,id=b0bbbcbc-085e-476f-b600-f1d684f23beb,network=Network(1d219ea7-a949-4c77-9cd1-79cc99d6ac42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bbbcbc-08')
Oct 25 21:29:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbf2ce42cb9248d36efe9eaf3f3104cd76c61fba.converted --force-share --output=json" returned: 0 in 0.273s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "fbf2ce42cb9248d36efe9eaf3f3104cd76c61fba" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.654s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:29:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbf2ce42cb9248d36efe9eaf3f3104cd76c61fba --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:51 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:29:51 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Took 1.03 seconds to deallocate network for instance.
Oct 25 21:29:51 user nova-compute[74189]: DEBUG nova.compute.manager [req-7ea7d8a4-30a6-4d9d-bd60-24e97f39b12e req-598c04a4-a0fc-4cb0-8454-28ca133f1f7c service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Received event network-vif-deleted-54123e00-9921-4807-b1f7-79073453a82f {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:29:51 user nova-compute[74189]: INFO nova.compute.manager [req-7ea7d8a4-30a6-4d9d-bd60-24e97f39b12e req-598c04a4-a0fc-4cb0-8454-28ca133f1f7c service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Neutron deleted interface 54123e00-9921-4807-b1f7-79073453a82f; detaching it from the instance and deleting it from the info cache
Oct 25 21:29:51 user nova-compute[74189]: DEBUG nova.network.neutron [req-7ea7d8a4-30a6-4d9d-bd60-24e97f39b12e req-598c04a4-a0fc-4cb0-8454-28ca133f1f7c service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:29:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbf2ce42cb9248d36efe9eaf3f3104cd76c61fba --force-share --output=json" returned: 0 in 0.198s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "fbf2ce42cb9248d36efe9eaf3f3104cd76c61fba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:29:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "fbf2ce42cb9248d36efe9eaf3f3104cd76c61fba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:29:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbf2ce42cb9248d36efe9eaf3f3104cd76c61fba --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:51 user nova-compute[74189]: DEBUG nova.compute.manager [req-7ea7d8a4-30a6-4d9d-bd60-24e97f39b12e req-598c04a4-a0fc-4cb0-8454-28ca133f1f7c service nova] [instance: 75071d8a-2ce2-43b5-99f6-23853399dc97] Detach interface failed, port_id=54123e00-9921-4807-b1f7-79073453a82f, reason: Instance 75071d8a-2ce2-43b5-99f6-23853399dc97 could not be found. {{(pid=74189) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 21:29:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-400b378a-33e8-4d46-a961-625f9febecab tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:29:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-400b378a-33e8-4d46-a961-625f9febecab tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:29:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbf2ce42cb9248d36efe9eaf3f3104cd76c61fba --force-share --output=json" returned: 0 in 0.185s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbf2ce42cb9248d36efe9eaf3f3104cd76c61fba,backing_fmt=raw /opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbf2ce42cb9248d36efe9eaf3f3104cd76c61fba,backing_fmt=raw /opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk 1073741824" returned: 0 in 0.063s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "fbf2ce42cb9248d36efe9eaf3f3104cd76c61fba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:29:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbf2ce42cb9248d36efe9eaf3f3104cd76c61fba --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbf2ce42cb9248d36efe9eaf3f3104cd76c61fba --force-share --output=json" returned: 0 in 0.212s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:51 user nova-compute[74189]: DEBUG nova.objects.instance [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lazy-loading 'migration_context' on Instance uuid a57b1185-270e-40d0-a55e-986960826169 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:29:51 user nova-compute[74189]: DEBUG nova.objects.base [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Object Instance<a57b1185-270e-40d0-a55e-986960826169> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:29:51 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Rebasing disk image.
Oct 25 21:29:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:51 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-400b378a-33e8-4d46-a961-625f9febecab tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:29:51 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-400b378a-33e8-4d46-a961-625f9febecab tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:29:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-400b378a-33e8-4d46-a961-625f9febecab tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.587s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:29:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.198s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 -F raw /opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:51 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-400b378a-33e8-4d46-a961-625f9febecab tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Deleted allocations for instance 75071d8a-2ce2-43b5-99f6-23853399dc97
Oct 25 21:29:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-400b378a-33e8-4d46-a961-625f9febecab tempest-ServerStableDeviceRescueTest-1979035755 tempest-ServerStableDeviceRescueTest-1979035755-project-member] Lock "75071d8a-2ce2-43b5-99f6-23853399dc97" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.788s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:29:52 user nova-compute[74189]: DEBUG nova.compute.manager [req-04f86469-da18-4295-beb4-254b92d35560 req-021a1ea9-bd30-44ae-b549-999d320cfcfb service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Received event network-vif-plugged-6a146bba-178b-4b17-be10-0410392d8b06 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:29:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-04f86469-da18-4295-beb4-254b92d35560 req-021a1ea9-bd30-44ae-b549-999d320cfcfb service nova] Acquiring lock "cdb13b8f-c136-4f2b-95b9-e464babac28a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:29:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-04f86469-da18-4295-beb4-254b92d35560 req-021a1ea9-bd30-44ae-b549-999d320cfcfb service nova] Lock "cdb13b8f-c136-4f2b-95b9-e464babac28a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:29:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-04f86469-da18-4295-beb4-254b92d35560 req-021a1ea9-bd30-44ae-b549-999d320cfcfb service nova] Lock "cdb13b8f-c136-4f2b-95b9-e464babac28a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:29:52 user nova-compute[74189]: DEBUG nova.compute.manager [req-04f86469-da18-4295-beb4-254b92d35560 req-021a1ea9-bd30-44ae-b549-999d320cfcfb service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] No waiting events found dispatching network-vif-plugged-6a146bba-178b-4b17-be10-0410392d8b06 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:29:52 user nova-compute[74189]: WARNING nova.compute.manager [req-04f86469-da18-4295-beb4-254b92d35560 req-021a1ea9-bd30-44ae-b549-999d320cfcfb service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Received unexpected event network-vif-plugged-6a146bba-178b-4b17-be10-0410392d8b06 for instance with vm_state active and task_state reboot_started_hard.
Oct 25 21:29:52 user nova-compute[74189]: DEBUG nova.compute.manager [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:29:52 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:52 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Instance rebooted successfully.
Oct 25 21:29:52 user nova-compute[74189]: DEBUG nova.compute.manager [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:29:52 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:52 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f29f1447-7699-4ef7-ae5c-ee3f173067d8 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "cdb13b8f-c136-4f2b-95b9-e464babac28a" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 10.523s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "c5ba374a-821b-424c-aeaa-528a0164160e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "c5ba374a-821b-424c-aeaa-528a0164160e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG nova.objects.instance [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lazy-loading 'flavor' on Instance uuid c5ba374a-821b-424c-aeaa-528a0164160e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "c5ba374a-821b-424c-aeaa-528a0164160e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG nova.compute.manager [req-bcf47786-126a-4c45-a5c8-292f07bbf989 req-8c28304a-7b42-4861-a7a3-6302013c9bf4 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Received event network-vif-plugged-b0bbbcbc-085e-476f-b600-f1d684f23beb {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bcf47786-126a-4c45-a5c8-292f07bbf989 req-8c28304a-7b42-4861-a7a3-6302013c9bf4 service nova] Acquiring lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bcf47786-126a-4c45-a5c8-292f07bbf989 req-8c28304a-7b42-4861-a7a3-6302013c9bf4 service nova] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bcf47786-126a-4c45-a5c8-292f07bbf989 req-8c28304a-7b42-4861-a7a3-6302013c9bf4 service nova] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG nova.compute.manager [req-bcf47786-126a-4c45-a5c8-292f07bbf989 req-8c28304a-7b42-4861-a7a3-6302013c9bf4 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] No waiting events found dispatching network-vif-plugged-b0bbbcbc-085e-476f-b600-f1d684f23beb {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:29:53 user nova-compute[74189]: WARNING nova.compute.manager [req-bcf47786-126a-4c45-a5c8-292f07bbf989 req-8c28304a-7b42-4861-a7a3-6302013c9bf4 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Received unexpected event network-vif-plugged-b0bbbcbc-085e-476f-b600-f1d684f23beb for instance with vm_state stopped and task_state powering-on.
Oct 25 21:29:53 user nova-compute[74189]: DEBUG nova.compute.manager [req-bcf47786-126a-4c45-a5c8-292f07bbf989 req-8c28304a-7b42-4861-a7a3-6302013c9bf4 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Received event network-vif-plugged-b0bbbcbc-085e-476f-b600-f1d684f23beb {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bcf47786-126a-4c45-a5c8-292f07bbf989 req-8c28304a-7b42-4861-a7a3-6302013c9bf4 service nova] Acquiring lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bcf47786-126a-4c45-a5c8-292f07bbf989 req-8c28304a-7b42-4861-a7a3-6302013c9bf4 service nova] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bcf47786-126a-4c45-a5c8-292f07bbf989 req-8c28304a-7b42-4861-a7a3-6302013c9bf4 service nova] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG nova.compute.manager [req-bcf47786-126a-4c45-a5c8-292f07bbf989 req-8c28304a-7b42-4861-a7a3-6302013c9bf4 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] No waiting events found dispatching network-vif-plugged-b0bbbcbc-085e-476f-b600-f1d684f23beb {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:29:53 user nova-compute[74189]: WARNING nova.compute.manager [req-bcf47786-126a-4c45-a5c8-292f07bbf989 req-8c28304a-7b42-4861-a7a3-6302013c9bf4 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Received unexpected event network-vif-plugged-b0bbbcbc-085e-476f-b600-f1d684f23beb for instance with vm_state stopped and task_state powering-on.
Oct 25 21:29:53 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "c5ba374a-821b-424c-aeaa-528a0164160e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "c5ba374a-821b-424c-aeaa-528a0164160e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:29:53 user nova-compute[74189]: INFO nova.compute.manager [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Attaching volume 61840ac6-1bb6-4c6a-8381-b8f0694ae224 to /dev/vdb
Oct 25 21:29:53 user nova-compute[74189]: DEBUG os_brick.utils [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[933c9e92-3f8e-4b8f-923e-fa31434280e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[60117808-8c8d-4ac0-ab86-2415e6bc4165]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45415fb-ff70-4146-8c22-d2a1e83ca20f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[42380a28-73b7-4292-bbfb-23d4fd62f84b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:29:53 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:29:53 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c065e0fb-8bd3-4c9a-bc89-f85ff03e8479]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG os_brick.utils [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] <== get_connector_properties: return (310ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:29:53 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Updating existing volume attachment record: d85f62e5-cda9-494c-8114-f16a622e2f35 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 -F raw /opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk" returned: 0 in 3.164s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Ensure instance console log exists: /opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Start _get_guest_xml network_info=[{"id": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "address": "fa:16:3e:6b:ad:c5", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc4dd08-df", "ovs_interfaceid": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='652221e3d559e0b30113849363582f41',container_format='bare',created_at=2023-10-25T21:27:33Z,direct_url=<?>,disk_format='qcow2',id=b646bcdf-ed18-4e0e-a4f7-3b15c220907d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1746373749-shelved',owner='e45f8868c6a04e31ad1617ee6e9438a2',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-25T21:27:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GkbwPTQd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'a57b1185-270e-40d0-a55e-986960826169', 'attached_at': '', 'detached_at': '', 'volume_id': '2bcb1620-6d87-4ef3-9136-841c00fbe245', 'serial': '2bcb1620-6d87-4ef3-9136-841c00fbe245'}, 'attachment_id': '9eb46014-6a4b-4381-bdb3-7065701ffb64', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:29:55 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:29:55 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:29:55 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='652221e3d559e0b30113849363582f41',container_format='bare',created_at=2023-10-25T21:27:33Z,direct_url=<?>,disk_format='qcow2',id=b646bcdf-ed18-4e0e-a4f7-3b15c220907d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1746373749-shelved',owner='e45f8868c6a04e31ad1617ee6e9438a2',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-25T21:27:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG nova.objects.instance [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lazy-loading 'vcpu_model' on Instance uuid a57b1185-270e-40d0-a55e-986960826169 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG nova.objects.base [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Object Instance<a57b1185-270e-40d0-a55e-986960826169> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GkbwPTQd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:29:55 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:29:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:29:55 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:29:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:29:55 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 -p 172.16.0.220:3260" returned: 21 in 0.035s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7883e8-b65c-4dc3-9de7-50cdc6471263]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:29:55 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d38ffa-3357-454d-9b73-abf4198eedf7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245] added
Oct 25 21:29:55 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[afda78c8-c6ce-4e27-ab6b-75729e06bcaa]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[47897ab4-478c-40c1-b011-d0ef931e9c44]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GkbwPTQd {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GkbwPTQd" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75a8f82-eee4-4038-8362-0cb34d81864f]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GkbwPTQd'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed61102-d304-4f98-9746-05ff9ebcd8f3]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbf9ed2-00ab-4a43-8100-7aa4bf5350b1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:29:55 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:29:55 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:29:55 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:29:55 user nova-compute[74189]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 (non-flash)
Oct 25 21:29:55 user nova-compute[74189]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:29:55 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:29:55 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:29:55 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:29:55 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:29:55 user nova-compute[74189]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 (non-flash)
Oct 25 21:29:55 user nova-compute[74189]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:29:55 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG nova.compute.manager [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:29:55 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Instance rebooted successfully.
Oct 25 21:29:55 user nova-compute[74189]: DEBUG nova.compute.manager [None req-313a7433-25c8-45ac-9f15-09941eb40ac7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8b09c5-f9e2-462e-a175-fe97ce3212f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245, portal: 172.16.0.220,3260]
Oct 25 21:29:55 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245, portal: 172.16.0.220,3260] successful.
Oct 25 21:29:55 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aaed6a0-a4ed-41d9-aced-be0bae4a1a06]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6618b06-027e-4589-8c19-6ea9ca7ed031]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:29:55 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:29:55 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:29:55 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:29:55 user nova-compute[74189]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 (non-flash)
Oct 25 21:29:55 user nova-compute[74189]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:29:55 user nova-compute[74189]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 (non-flash)
Oct 25 21:29:55 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:29:55 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:29:55 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:29:55 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:29:55 user nova-compute[74189]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 (non-flash)
Oct 25 21:29:55 user nova-compute[74189]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:29:55 user nova-compute[74189]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 (non-flash)
Oct 25 21:29:55 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] HCTL ('39', '-', '-', 0) found on session 37 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1072df06-9ae8-428b-9960-d31217482c21]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Searching for a device in session 37 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GkbwPTQd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:29:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.431s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:29:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] <== connect_volume: return (1433ms) {'type': 'block', 'scsi_wwn': '26535343166343536', 'path': '/dev/sdh'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:29:56 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535343166343536', 'path': '/dev/sdh'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:29:56 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T21:25:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1746373749',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1746373749',id=24,image_ref='b646bcdf-ed18-4e0e-a4f7-3b15c220907d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-784432470',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:25:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e45f8868c6a04e31ad1617ee6e9438a2',ramdisk_id='',reservation_id='r-6cje6qbe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-846255404',owner_user_name='tempest-AttachVolumeShelveTestJSON-846255404-project-member',shelved_at='2023-10-25T21:27:38.241094',shelved_host='user',shelved_image_id='b646bcdf-ed18-4e0e-a4f7-3b15c220907d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:29:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6fb9b5c36f049c1af4ae44e11267264',uuid=a57b1185-270e-40d0-a55e-986960826169,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "address": "fa:16:3e:6b:ad:c5", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc4dd08-df", "ovs_interfaceid": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:29:56 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Converting VIF {"id": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "address": "fa:16:3e:6b:ad:c5", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc4dd08-df", "ovs_interfaceid": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:29:56 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ad:c5,bridge_name='br-int',has_traffic_filtering=True,id=ecc4dd08-df4f-445b-81eb-b3946804aef8,network=Network(09d8bdf6-f255-479c-aa38-55d468abf1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc4dd08-df') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:29:56 user nova-compute[74189]: DEBUG nova.objects.instance [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lazy-loading 'pci_devices' on Instance uuid a57b1185-270e-40d0-a55e-986960826169 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:29:56 user nova-compute[74189]: DEBUG nova.objects.base [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Object Instance<a57b1185-270e-40d0-a55e-986960826169> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:29:56 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:29:56 user nova-compute[74189]:   <uuid>a57b1185-270e-40d0-a55e-986960826169</uuid>
Oct 25 21:29:56 user nova-compute[74189]:   <name>instance-00000018</name>
Oct 25 21:29:56 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:29:56 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:29:56 user nova-compute[74189]:   <metadata>
Oct 25 21:29:56 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:29:56 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:29:56 user nova-compute[74189]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1746373749</nova:name>
Oct 25 21:29:56 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:29:55</nova:creationTime>
Oct 25 21:29:56 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:29:56 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:29:56 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:29:56 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:29:56 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:29:56 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:29:56 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:29:56 user nova-compute[74189]:       <nova:owner>
Oct 25 21:29:56 user nova-compute[74189]:         <nova:user uuid="e6fb9b5c36f049c1af4ae44e11267264">tempest-AttachVolumeShelveTestJSON-846255404-project-member</nova:user>
Oct 25 21:29:56 user nova-compute[74189]:         <nova:project uuid="e45f8868c6a04e31ad1617ee6e9438a2">tempest-AttachVolumeShelveTestJSON-846255404</nova:project>
Oct 25 21:29:56 user nova-compute[74189]:       </nova:owner>
Oct 25 21:29:56 user nova-compute[74189]:       <nova:root type="image" uuid="b646bcdf-ed18-4e0e-a4f7-3b15c220907d"/>
Oct 25 21:29:56 user nova-compute[74189]:       <nova:ports>
Oct 25 21:29:56 user nova-compute[74189]:         <nova:port uuid="ecc4dd08-df4f-445b-81eb-b3946804aef8">
Oct 25 21:29:56 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 25 21:29:56 user nova-compute[74189]:         </nova:port>
Oct 25 21:29:56 user nova-compute[74189]:       </nova:ports>
Oct 25 21:29:56 user nova-compute[74189]:     </nova:instance>
Oct 25 21:29:56 user nova-compute[74189]:   </metadata>
Oct 25 21:29:56 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:29:56 user nova-compute[74189]:     <system>
Oct 25 21:29:56 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:29:56 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:29:56 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:29:56 user nova-compute[74189]:       <entry name="serial">a57b1185-270e-40d0-a55e-986960826169</entry>
Oct 25 21:29:56 user nova-compute[74189]:       <entry name="uuid">a57b1185-270e-40d0-a55e-986960826169</entry>
Oct 25 21:29:56 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:29:56 user nova-compute[74189]:     </system>
Oct 25 21:29:56 user nova-compute[74189]:   </sysinfo>
Oct 25 21:29:56 user nova-compute[74189]:   <os>
Oct 25 21:29:56 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:29:56 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:29:56 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:29:56 user nova-compute[74189]:   </os>
Oct 25 21:29:56 user nova-compute[74189]:   <features>
Oct 25 21:29:56 user nova-compute[74189]:     <acpi/>
Oct 25 21:29:56 user nova-compute[74189]:     <apic/>
Oct 25 21:29:56 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:29:56 user nova-compute[74189]:   </features>
Oct 25 21:29:56 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:29:56 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:29:56 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:29:56 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:29:56 user nova-compute[74189]:   </clock>
Oct 25 21:29:56 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:29:56 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:29:56 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:29:56 user nova-compute[74189]:   </cpu>
Oct 25 21:29:56 user nova-compute[74189]:   <devices>
Oct 25 21:29:56 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:29:56 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:29:56 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk"/>
Oct 25 21:29:56 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:29:56 user nova-compute[74189]:     </disk>
Oct 25 21:29:56 user nova-compute[74189]:     <disk type="block" device="disk">
Oct 25 21:29:56 user nova-compute[74189]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:29:56 user nova-compute[74189]:       <source dev="/dev/sdh"/>
Oct 25 21:29:56 user nova-compute[74189]:       <target dev="vdc" bus="virtio"/>
Oct 25 21:29:56 user nova-compute[74189]:       <serial>2bcb1620-6d87-4ef3-9136-841c00fbe245</serial>
Oct 25 21:29:56 user nova-compute[74189]:     </disk>
Oct 25 21:29:56 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:29:56 user nova-compute[74189]:       <mac address="fa:16:3e:6b:ad:c5"/>
Oct 25 21:29:56 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:29:56 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:29:56 user nova-compute[74189]:       <target dev="tapecc4dd08-df"/>
Oct 25 21:29:56 user nova-compute[74189]:     </interface>
Oct 25 21:29:56 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:29:56 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/console.log" append="off"/>
Oct 25 21:29:56 user nova-compute[74189]:     </serial>
Oct 25 21:29:56 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:29:56 user nova-compute[74189]:     <video>
Oct 25 21:29:56 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:29:56 user nova-compute[74189]:     </video>
Oct 25 21:29:56 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:29:56 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:29:56 user nova-compute[74189]:     </rng>
Oct 25 21:29:56 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:29:56 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:29:56 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:29:56 user nova-compute[74189]:     </memballoon>
Oct 25 21:29:56 user nova-compute[74189]:   </devices>
Oct 25 21:29:56 user nova-compute[74189]: </domain>
Oct 25 21:29:56 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:29:56 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T21:25:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1746373749',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1746373749',id=24,image_ref='b646bcdf-ed18-4e0e-a4f7-3b15c220907d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-784432470',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:25:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e45f8868c6a04e31ad1617ee6e9438a2',ramdisk_id='',reservation_id='r-6cje6qbe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-846255404',owner_user_name='tempest-AttachVolumeShelveTestJSON-846255404-project-member',shelved_at='2023-10-25T21:27:38.241094',shelved_host='user',shelved_image_id='b646bcdf-ed18-4e0e-a4f7-3b15c220907d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:29:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6fb9b5c36f049c1af4ae44e11267264',uuid=a57b1185-270e-40d0-a55e-986960826169,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "address": "fa:16:3e:6b:ad:c5", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc4dd08-df", "ovs_interfaceid": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:29:56 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Converting VIF {"id": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "address": "fa:16:3e:6b:ad:c5", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc4dd08-df", "ovs_interfaceid": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:29:56 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ad:c5,bridge_name='br-int',has_traffic_filtering=True,id=ecc4dd08-df4f-445b-81eb-b3946804aef8,network=Network(09d8bdf6-f255-479c-aa38-55d468abf1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc4dd08-df') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:29:56 user nova-compute[74189]: DEBUG os_vif [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ad:c5,bridge_name='br-int',has_traffic_filtering=True,id=ecc4dd08-df4f-445b-81eb-b3946804aef8,network=Network(09d8bdf6-f255-479c-aa38-55d468abf1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc4dd08-df') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:29:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:29:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:29:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ccf8dcc-52ec-5308-b3c0-c1df06186a62', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:29:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapecc4dd08-df, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:29:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapecc4dd08-df, col_values=(('qos', UUID('3a22487e-ca64-4a31-87b2-39df249677fe')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:29:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapecc4dd08-df, col_values=(('external_ids', {'iface-id': 'ecc4dd08-df4f-445b-81eb-b3946804aef8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:ad:c5', 'vm-uuid': 'a57b1185-270e-40d0-a55e-986960826169'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:29:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:29:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:56 user nova-compute[74189]: INFO os_vif [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ad:c5,bridge_name='br-int',has_traffic_filtering=True,id=ecc4dd08-df4f-445b-81eb-b3946804aef8,network=Network(09d8bdf6-f255-479c-aa38-55d468abf1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc4dd08-df')
Oct 25 21:29:56 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:29:56 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:29:56 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] No VIF found with MAC fa:16:3e:6b:ad:c5, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:29:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:58 user nova-compute[74189]: DEBUG nova.compute.manager [req-7787d3c3-b71e-4673-b38a-d14abf683c77 req-0968d23d-264f-4cae-b15c-62459350f172 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received event network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:29:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7787d3c3-b71e-4673-b38a-d14abf683c77 req-0968d23d-264f-4cae-b15c-62459350f172 service nova] Acquiring lock "a57b1185-270e-40d0-a55e-986960826169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:29:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7787d3c3-b71e-4673-b38a-d14abf683c77 req-0968d23d-264f-4cae-b15c-62459350f172 service nova] Lock "a57b1185-270e-40d0-a55e-986960826169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:29:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7787d3c3-b71e-4673-b38a-d14abf683c77 req-0968d23d-264f-4cae-b15c-62459350f172 service nova] Lock "a57b1185-270e-40d0-a55e-986960826169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:29:58 user nova-compute[74189]: DEBUG nova.compute.manager [req-7787d3c3-b71e-4673-b38a-d14abf683c77 req-0968d23d-264f-4cae-b15c-62459350f172 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] No waiting events found dispatching network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:29:58 user nova-compute[74189]: WARNING nova.compute.manager [req-7787d3c3-b71e-4673-b38a-d14abf683c77 req-0968d23d-264f-4cae-b15c-62459350f172 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received unexpected event network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 25 21:29:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:29:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:00 user nova-compute[74189]: DEBUG nova.compute.manager [req-517ef713-f32f-4442-81b3-2419c6b2da4d req-f6817ebe-7cf0-4aa1-8c04-9cac40e9a849 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received event network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:30:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-517ef713-f32f-4442-81b3-2419c6b2da4d req-f6817ebe-7cf0-4aa1-8c04-9cac40e9a849 service nova] Acquiring lock "a57b1185-270e-40d0-a55e-986960826169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:30:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-517ef713-f32f-4442-81b3-2419c6b2da4d req-f6817ebe-7cf0-4aa1-8c04-9cac40e9a849 service nova] Lock "a57b1185-270e-40d0-a55e-986960826169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:30:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-517ef713-f32f-4442-81b3-2419c6b2da4d req-f6817ebe-7cf0-4aa1-8c04-9cac40e9a849 service nova] Lock "a57b1185-270e-40d0-a55e-986960826169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:30:00 user nova-compute[74189]: DEBUG nova.compute.manager [req-517ef713-f32f-4442-81b3-2419c6b2da4d req-f6817ebe-7cf0-4aa1-8c04-9cac40e9a849 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] No waiting events found dispatching network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:30:00 user nova-compute[74189]: WARNING nova.compute.manager [req-517ef713-f32f-4442-81b3-2419c6b2da4d req-f6817ebe-7cf0-4aa1-8c04-9cac40e9a849 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received unexpected event network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 25 21:30:00 user nova-compute[74189]: DEBUG nova.compute.manager [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:30:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:30:00 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: a57b1185-270e-40d0-a55e-986960826169] Instance spawned successfully.
Oct 25 21:30:01 user nova-compute[74189]: DEBUG nova.compute.manager [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:30:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c9d73f54-03e3-40fc-8b1a-41804657c507 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "a57b1185-270e-40d0-a55e-986960826169" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 35.569s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:30:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:05 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:30:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:07 user nova-compute[74189]: INFO nova.compute.manager [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Rescuing
Oct 25 21:30:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "refresh_cache-9733d5c8-4476-4903-bd1b-16d43a54fdbd" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:30:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquired lock "refresh_cache-9733d5c8-4476-4903-bd1b-16d43a54fdbd" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:30:07 user nova-compute[74189]: DEBUG nova.network.neutron [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:30:07 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:30:07 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:30:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-de6b6789-b328-4c3b-8d24-07774d5dbe6d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:30:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-de6b6789-b328-4c3b-8d24-07774d5dbe6d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:30:07 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:30:08 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Updating instance_info_cache with network_info: [{"id": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "address": "fa:16:3e:df:d0:7a", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bbbcbc-08", "ovs_interfaceid": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:30:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-de6b6789-b328-4c3b-8d24-07774d5dbe6d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:30:08 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:30:08 user nova-compute[74189]: DEBUG nova.network.neutron [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Updating instance_info_cache with network_info: [{"id": "005bac46-8900-46a0-bb7f-d8672c6d2fc1", "address": "fa:16:3e:1d:ce:94", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap005bac46-89", "ovs_interfaceid": "005bac46-8900-46a0-bb7f-d8672c6d2fc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:30:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Releasing lock "refresh_cache-9733d5c8-4476-4903-bd1b-16d43a54fdbd" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:30:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:09 user nova-compute[74189]: DEBUG nova.compute.manager [req-163c366b-e214-4698-a918-a74c44681cf7 req-f1ad6e8f-2b97-410f-b1b4-8ae6f1eaf351 service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Received event network-vif-unplugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:30:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-163c366b-e214-4698-a918-a74c44681cf7 req-f1ad6e8f-2b97-410f-b1b4-8ae6f1eaf351 service nova] Acquiring lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:30:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-163c366b-e214-4698-a918-a74c44681cf7 req-f1ad6e8f-2b97-410f-b1b4-8ae6f1eaf351 service nova] Lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:30:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-163c366b-e214-4698-a918-a74c44681cf7 req-f1ad6e8f-2b97-410f-b1b4-8ae6f1eaf351 service nova] Lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:30:09 user nova-compute[74189]: DEBUG nova.compute.manager [req-163c366b-e214-4698-a918-a74c44681cf7 req-f1ad6e8f-2b97-410f-b1b4-8ae6f1eaf351 service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] No waiting events found dispatching network-vif-unplugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:30:09 user nova-compute[74189]: WARNING nova.compute.manager [req-163c366b-e214-4698-a918-a74c44681cf7 req-f1ad6e8f-2b97-410f-b1b4-8ae6f1eaf351 service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Received unexpected event network-vif-unplugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 for instance with vm_state active and task_state rescuing.
Oct 25 21:30:09 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:09 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:09 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Instance destroyed successfully.
Oct 25 21:30:09 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Attempting a stable device rescue
Oct 25 21:30:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74189) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 25 21:30:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Instance directory exists: not creating {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 21:30:09 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Creating image(s)
Oct 25 21:30:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "/opt/stack/data/nova/instances/9733d5c8-4476-4903-bd1b-16d43a54fdbd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:30:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "/opt/stack/data/nova/instances/9733d5c8-4476-4903-bd1b-16d43a54fdbd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:30:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "/opt/stack/data/nova/instances/9733d5c8-4476-4903-bd1b-16d43a54fdbd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:30:09 user nova-compute[74189]: DEBUG nova.objects.instance [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9733d5c8-4476-4903-bd1b-16d43a54fdbd {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:30:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "63bdca806e0fba6c8e110201ec3ca6c133fdbd7f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:30:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "63bdca806e0fba6c8e110201ec3ca6c133fdbd7f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:30:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63bdca806e0fba6c8e110201ec3ca6c133fdbd7f.part --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:10 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:30:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:30:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:30:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:30:10 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:30:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63bdca806e0fba6c8e110201ec3ca6c133fdbd7f.part --force-share --output=json" returned: 0 in 0.260s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:10 user nova-compute[74189]: DEBUG nova.virt.images [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] 8d24ecb9-6b13-43f2-93d6-4e3298c0f8d3 was qcow2, converting to raw {{(pid=74189) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 21:30:10 user nova-compute[74189]: DEBUG nova.privsep.utils [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74189) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 21:30:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/63bdca806e0fba6c8e110201ec3ca6c133fdbd7f.part /opt/stack/data/nova/instances/_base/63bdca806e0fba6c8e110201ec3ca6c133fdbd7f.converted {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG nova.compute.manager [req-b35784a0-4ba6-41ac-abba-155b34d73eac req-9d1088ea-3a81-484e-9b61-24191188e05c service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Received event network-vif-plugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b35784a0-4ba6-41ac-abba-155b34d73eac req-9d1088ea-3a81-484e-9b61-24191188e05c service nova] Acquiring lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b35784a0-4ba6-41ac-abba-155b34d73eac req-9d1088ea-3a81-484e-9b61-24191188e05c service nova] Lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b35784a0-4ba6-41ac-abba-155b34d73eac req-9d1088ea-3a81-484e-9b61-24191188e05c service nova] Lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG nova.compute.manager [req-b35784a0-4ba6-41ac-abba-155b34d73eac req-9d1088ea-3a81-484e-9b61-24191188e05c service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] No waiting events found dispatching network-vif-plugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:30:11 user nova-compute[74189]: WARNING nova.compute.manager [req-b35784a0-4ba6-41ac-abba-155b34d73eac req-9d1088ea-3a81-484e-9b61-24191188e05c service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Received unexpected event network-vif-plugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 for instance with vm_state active and task_state rescuing.
Oct 25 21:30:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json" returned: 0 in 0.312s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/63bdca806e0fba6c8e110201ec3ca6c133fdbd7f.part /opt/stack/data/nova/instances/_base/63bdca806e0fba6c8e110201ec3ca6c133fdbd7f.converted" returned: 0 in 0.451s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63bdca806e0fba6c8e110201ec3ca6c133fdbd7f.converted --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63bdca806e0fba6c8e110201ec3ca6c133fdbd7f.converted --force-share --output=json" returned: 0 in 0.221s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "63bdca806e0fba6c8e110201ec3ca6c133fdbd7f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.021s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "63bdca806e0fba6c8e110201ec3ca6c133fdbd7f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "63bdca806e0fba6c8e110201ec3ca6c133fdbd7f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63bdca806e0fba6c8e110201ec3ca6c133fdbd7f --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63bdca806e0fba6c8e110201ec3ca6c133fdbd7f --force-share --output=json" returned: 0 in 0.175s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/63bdca806e0fba6c8e110201ec3ca6c133fdbd7f,backing_fmt=raw /opt/stack/data/nova/instances/9733d5c8-4476-4903-bd1b-16d43a54fdbd/disk.rescue {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/63bdca806e0fba6c8e110201ec3ca6c133fdbd7f,backing_fmt=raw /opt/stack/data/nova/instances/9733d5c8-4476-4903-bd1b-16d43a54fdbd/disk.rescue" returned: 0 in 0.052s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "63bdca806e0fba6c8e110201ec3ca6c133fdbd7f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG nova.objects.instance [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lazy-loading 'migration_context' on Instance uuid 9733d5c8-4476-4903-bd1b-16d43a54fdbd {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG nova.objects.base [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Object Instance<9733d5c8-4476-4903-bd1b-16d43a54fdbd> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Start _get_guest_xml network_info=[{"id": "005bac46-8900-46a0-bb7f-d8672c6d2fc1", "address": "fa:16:3e:1d:ce:94", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "vif_mac": "fa:16:3e:1d:ce:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap005bac46-89", "ovs_interfaceid": "005bac46-8900-46a0-bb7f-d8672c6d2fc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8d24ecb9-6b13-43f2-93d6-4e3298c0f8d3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vTqMWNCD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '9733d5c8-4476-4903-bd1b-16d43a54fdbd', 'attached_at': '', 'detached_at': '', 'volume_id': 'dfec83e7-d226-4e7e-958d-1d53f9ddcbce', 'serial': 'dfec83e7-d226-4e7e-958d-1d53f9ddcbce'}, 'attachment_id': 'f7ce213a-53f4-462e-b55d-5dfdc627c35f', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG nova.objects.instance [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lazy-loading 'resources' on Instance uuid 9733d5c8-4476-4903-bd1b-16d43a54fdbd {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG nova.objects.base [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Object Instance<9733d5c8-4476-4903-bd1b-16d43a54fdbd> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG nova.objects.instance [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lazy-loading 'numa_topology' on Instance uuid 9733d5c8-4476-4903-bd1b-16d43a54fdbd {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG nova.objects.base [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Object Instance<9733d5c8-4476-4903-bd1b-16d43a54fdbd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:30:11 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:30:11 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:30:11 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG nova.objects.instance [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9733d5c8-4476-4903-bd1b-16d43a54fdbd {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:30:11 user nova-compute[74189]: DEBUG nova.objects.base [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Object Instance<9733d5c8-4476-4903-bd1b-16d43a54fdbd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vTqMWNCD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:30:12 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:30:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:30:12 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:30:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:30:12 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:30:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbff2af-7b0d-4992-9e14-69eb5a7680da]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = vTqMWNCD\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 25 21:30:12 user nova-compute[74189]: node.name = iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce
Oct 25 21:30:12 user nova-compute[74189]: node.tpgt = -1
Oct 25 21:30:12 user nova-compute[74189]: node.startup = automatic
Oct 25 21:30:12 user nova-compute[74189]: node.leading_login = No
Oct 25 21:30:12 user nova-compute[74189]: iface.iscsi_ifacename = default
Oct 25 21:30:12 user nova-compute[74189]: iface.net_ifacename = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.ipaddress = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.prefix_len = 0
Oct 25 21:30:12 user nova-compute[74189]: iface.hwaddress = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.transport_name = tcp
Oct 25 21:30:12 user nova-compute[74189]: iface.initiatorname = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.state = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.vlan_id = 0
Oct 25 21:30:12 user nova-compute[74189]: iface.vlan_priority = 0
Oct 25 21:30:12 user nova-compute[74189]: iface.vlan_state = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.iface_num = 0
Oct 25 21:30:12 user nova-compute[74189]: iface.mtu = 0
Oct 25 21:30:12 user nova-compute[74189]: iface.port = 0
Oct 25 21:30:12 user nova-compute[74189]: iface.bootproto = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.subnet_mask = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.gateway = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.dhcp_alt_client_id_state = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.dhcp_alt_client_id = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.dhcp_dns = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.dhcp_learn_iqn = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.dhcp_req_vendor_id_state = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.dhcp_vendor_id_state = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.dhcp_vendor_id = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.dhcp_slp_da = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.fragmentation = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.gratuitous_arp = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.incoming_forwarding = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.tos_state = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.tos = 0
Oct 25 21:30:12 user nova-compute[74189]: iface.ttl = 0
Oct 25 21:30:12 user nova-compute[74189]: iface.delayed_ack = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.tcp_nagle = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.tcp_wsf_state = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.tcp_wsf = 0
Oct 25 21:30:12 user nova-compute[74189]: iface.tcp_timer_scale = 0
Oct 25 21:30:12 user nova-compute[74189]: iface.tcp_timestamp = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.redirect = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.def_task_mgmt_timeout = 0
Oct 25 21:30:12 user nova-compute[74189]: iface.header_digest = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.data_digest = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.immediate_data = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.initial_r2t = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.data_seq_inorder = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.data_pdu_inorder = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.erl = 0
Oct 25 21:30:12 user nova-compute[74189]: iface.max_receive_data_len = 0
Oct 25 21:30:12 user nova-compute[74189]: iface.first_burst_len = 0
Oct 25 21:30:12 user nova-compute[74189]: iface.max_outstanding_r2t = 0
Oct 25 21:30:12 user nova-compute[74189]: iface.max_burst_len = 0
Oct 25 21:30:12 user nova-compute[74189]: iface.chap_auth = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.bidi_chap = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.strict_login_compliance = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.discovery_auth = <empty>
Oct 25 21:30:12 user nova-compute[74189]: iface.discovery_logout = <empty>
Oct 25 21:30:12 user nova-compute[74189]: node.discovery_address = <empty>
Oct 25 21:30:12 user nova-compute[74189]: node.discovery_port = 0
Oct 25 21:30:12 user nova-compute[74189]: node.discovery_type = static
Oct 25 21:30:12 user nova-compute[74189]: node.session.initial_cmdsn = 0
Oct 25 21:30:12 user nova-compute[74189]: node.session.initial_login_retry_max = 8
Oct 25 21:30:12 user nova-compute[74189]: node.session.xmit_thread_priority = -20
Oct 25 21:30:12 user nova-compute[74189]: node.session.cmds_max = 128
Oct 25 21:30:12 user nova-compute[74189]: node.session.queue_depth = 32
Oct 25 21:30:12 user nova-compute[74189]: node.session.nr_sessions = 1
Oct 25 21:30:12 user nova-compute[74189]: node.session.auth.authmethod = CHAP
Oct 25 21:30:12 user nova-compute[74189]: node.session.auth.username = vTqMWNCD
Oct 25 21:30:12 user nova-compute[74189]: node.session.auth.password = ***
Oct 25 21:30:12 user nova-compute[74189]: node.session.auth.username_in = <empty>
Oct 25 21:30:12 user nova-compute[74189]: node.session.auth.password_in = <empty>
Oct 25 21:30:12 user nova-compute[74189]: node.session.auth.chap_algs = MD5
Oct 25 21:30:12 user nova-compute[74189]: node.session.timeo.replacement_timeout = 120
Oct 25 21:30:12 user nova-compute[74189]: node.session.err_timeo.abort_timeout = 15
Oct 25 21:30:12 user nova-compute[74189]: node.session.err_timeo.lu_reset_timeout = 30
Oct 25 21:30:12 user nova-compute[74189]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 25 21:30:12 user nova-compute[74189]: node.session.err_timeo.host_reset_timeout = 60
Oct 25 21:30:12 user nova-compute[74189]: node.session.iscsi.FastAbort = Yes
Oct 25 21:30:12 user nova-compute[74189]: node.session.iscsi.InitialR2T = No
Oct 25 21:30:12 user nova-compute[74189]: node.session.iscsi.ImmediateData = Yes
Oct 25 21:30:12 user nova-compute[74189]: node.session.iscsi.FirstBurstLength = 262144
Oct 25 21:30:12 user nova-compute[74189]: node.session.iscsi.MaxBurstLength = 16776192
Oct 25 21:30:12 user nova-compute[74189]: node.session.iscsi.DefaultTime2Retain = 0
Oct 25 21:30:12 user nova-compute[74189]: node.session.iscsi.DefaultTime2Wait = 2
Oct 25 21:30:12 user nova-compute[74189]: node.session.iscsi.MaxConnections = 1
Oct 25 21:30:12 user nova-compute[74189]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 25 21:30:12 user nova-compute[74189]: node.session.iscsi.ERL = 0
Oct 25 21:30:12 user nova-compute[74189]: node.session.scan = manual
Oct 25 21:30:12 user nova-compute[74189]: node.session.reopen_max = 0
Oct 25 21:30:12 user nova-compute[74189]: node.conn[0].address = 172.16.0.220
Oct 25 21:30:12 user nova-compute[74189]: node.conn[0].port = 3260
Oct 25 21:30:12 user nova-compute[74189]: node.conn[0].startup = manual
Oct 25 21:30:12 user nova-compute[74189]: node.conn[0].tcp.window_size = 524288
Oct 25 21:30:12 user nova-compute[74189]: node.conn[0].tcp.type_of_service = 0
Oct 25 21:30:12 user nova-compute[74189]: node.conn[0].timeo.logout_timeout = 15
Oct 25 21:30:12 user nova-compute[74189]: node.conn[0].timeo.login_timeout = 15
Oct 25 21:30:12 user nova-compute[74189]: node.conn[0].timeo.auth_timeout = 45
Oct 25 21:30:12 user nova-compute[74189]: node.conn[0].timeo.noop_out_interval = 5
Oct 25 21:30:12 user nova-compute[74189]: node.conn[0].timeo.noop_out_timeout = 5
Oct 25 21:30:12 user nova-compute[74189]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 25 21:30:12 user nova-compute[74189]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 25 21:30:12 user nova-compute[74189]: node.conn[0].iscsi.HeaderDigest = None
Oct 25 21:30:12 user nova-compute[74189]: node.conn[0].iscsi.DataDigest = None
Oct 25 21:30:12 user nova-compute[74189]: node.conn[0].iscsi.IFMarker = No
Oct 25 21:30:12 user nova-compute[74189]: node.conn[0].iscsi.OFMarker = No
Oct 25 21:30:12 user nova-compute[74189]: # END RECORD
Oct 25 21:30:12 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdacab96-d20b-4fb0-971f-20242bd59d34]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6baf7edc-4ecf-4162-be4c-4888a952066a]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vTqMWNCD {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vTqMWNCD" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[01478520-fd7f-4761-866f-76fc480a1c77]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vTqMWNCD'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fab02c-e2f0-4c15-a5c9-31782ce31ef5]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d2ee21-0049-417c-b6a7-d5561d124252]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:30:12 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:30:12 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:30:12 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:30:12 user nova-compute[74189]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 (non-flash)
Oct 25 21:30:12 user nova-compute[74189]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:30:12 user nova-compute[74189]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 (non-flash)
Oct 25 21:30:12 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:30:12 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:30:12 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:30:12 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:30:12 user nova-compute[74189]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 (non-flash)
Oct 25 21:30:12 user nova-compute[74189]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:30:12 user nova-compute[74189]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 (non-flash)
Oct 25 21:30:12 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.206s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] HCTL ('36', '0', '0', 0) found on session 33 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13c2ed8-b86d-4a03-8390-6a8ace98f8b7]: (4, ('0 0 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Searching for a device in session 33 and hctl ('36', '0', '0', 0) yield: sde {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vTqMWNCD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.242s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] <== connect_volume: return (243ms) {'type': 'block', 'scsi_wwn': '23933643762383134', 'path': '/dev/sde'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933643762383134', 'path': '/dev/sde'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:28:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1402889467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1402889467',id=30,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:29:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='acbb4f93936848a8949477ad124bf98e',ramdisk_id='',reservation_id='r-d1r52c8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-571481303',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:29:03Z,user_data=None,user_id='fc377c1beaab443683a6d776f2f734ff',uuid=9733d5c8-4476-4903-bd1b-16d43a54fdbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "005bac46-8900-46a0-bb7f-d8672c6d2fc1", "address": "fa:16:3e:1d:ce:94", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "vif_mac": "fa:16:3e:1d:ce:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap005bac46-89", "ovs_interfaceid": "005bac46-8900-46a0-bb7f-d8672c6d2fc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Converting VIF {"id": "005bac46-8900-46a0-bb7f-d8672c6d2fc1", "address": "fa:16:3e:1d:ce:94", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "vif_mac": "fa:16:3e:1d:ce:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap005bac46-89", "ovs_interfaceid": "005bac46-8900-46a0-bb7f-d8672c6d2fc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:ce:94,bridge_name='br-int',has_traffic_filtering=True,id=005bac46-8900-46a0-bb7f-d8672c6d2fc1,network=Network(f202171f-dfd8-4a19-9321-788318413ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap005bac46-89') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG nova.objects.instance [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lazy-loading 'pci_devices' on Instance uuid 9733d5c8-4476-4903-bd1b-16d43a54fdbd {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG nova.objects.base [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Object Instance<9733d5c8-4476-4903-bd1b-16d43a54fdbd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:30:12 user nova-compute[74189]:   <uuid>9733d5c8-4476-4903-bd1b-16d43a54fdbd</uuid>
Oct 25 21:30:12 user nova-compute[74189]:   <name>instance-0000001e</name>
Oct 25 21:30:12 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:30:12 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:30:12 user nova-compute[74189]:   <metadata>
Oct 25 21:30:12 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:30:12 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:30:12 user nova-compute[74189]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1402889467</nova:name>
Oct 25 21:30:12 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:30:11</nova:creationTime>
Oct 25 21:30:12 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:30:12 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:30:12 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:30:12 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:30:12 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:30:12 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:30:12 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:30:12 user nova-compute[74189]:       <nova:owner>
Oct 25 21:30:12 user nova-compute[74189]:         <nova:user uuid="fc377c1beaab443683a6d776f2f734ff">tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member</nova:user>
Oct 25 21:30:12 user nova-compute[74189]:         <nova:project uuid="acbb4f93936848a8949477ad124bf98e">tempest-ServerBootFromVolumeStableRescueTest-571481303</nova:project>
Oct 25 21:30:12 user nova-compute[74189]:       </nova:owner>
Oct 25 21:30:12 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:30:12 user nova-compute[74189]:       <nova:ports>
Oct 25 21:30:12 user nova-compute[74189]:         <nova:port uuid="005bac46-8900-46a0-bb7f-d8672c6d2fc1">
Oct 25 21:30:12 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 25 21:30:12 user nova-compute[74189]:         </nova:port>
Oct 25 21:30:12 user nova-compute[74189]:       </nova:ports>
Oct 25 21:30:12 user nova-compute[74189]:     </nova:instance>
Oct 25 21:30:12 user nova-compute[74189]:   </metadata>
Oct 25 21:30:12 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:30:12 user nova-compute[74189]:     <system>
Oct 25 21:30:12 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:30:12 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:30:12 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:30:12 user nova-compute[74189]:       <entry name="serial">9733d5c8-4476-4903-bd1b-16d43a54fdbd</entry>
Oct 25 21:30:12 user nova-compute[74189]:       <entry name="uuid">9733d5c8-4476-4903-bd1b-16d43a54fdbd</entry>
Oct 25 21:30:12 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:30:12 user nova-compute[74189]:     </system>
Oct 25 21:30:12 user nova-compute[74189]:   </sysinfo>
Oct 25 21:30:12 user nova-compute[74189]:   <os>
Oct 25 21:30:12 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:30:12 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:30:12 user nova-compute[74189]:   </os>
Oct 25 21:30:12 user nova-compute[74189]:   <features>
Oct 25 21:30:12 user nova-compute[74189]:     <acpi/>
Oct 25 21:30:12 user nova-compute[74189]:     <apic/>
Oct 25 21:30:12 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:30:12 user nova-compute[74189]:   </features>
Oct 25 21:30:12 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:30:12 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:30:12 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:30:12 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:30:12 user nova-compute[74189]:   </clock>
Oct 25 21:30:12 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:30:12 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:30:12 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:30:12 user nova-compute[74189]:   </cpu>
Oct 25 21:30:12 user nova-compute[74189]:   <devices>
Oct 25 21:30:12 user nova-compute[74189]:     <disk type="block" device="disk">
Oct 25 21:30:12 user nova-compute[74189]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:30:12 user nova-compute[74189]:       <source dev="/dev/sde"/>
Oct 25 21:30:12 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:30:12 user nova-compute[74189]:       <serial>dfec83e7-d226-4e7e-958d-1d53f9ddcbce</serial>
Oct 25 21:30:12 user nova-compute[74189]:     </disk>
Oct 25 21:30:12 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:30:12 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:30:12 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/9733d5c8-4476-4903-bd1b-16d43a54fdbd/disk.rescue"/>
Oct 25 21:30:12 user nova-compute[74189]:       <target dev="vdb" bus="virtio"/>
Oct 25 21:30:12 user nova-compute[74189]:       <boot order="1"/>
Oct 25 21:30:12 user nova-compute[74189]:     </disk>
Oct 25 21:30:12 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:30:12 user nova-compute[74189]:       <mac address="fa:16:3e:1d:ce:94"/>
Oct 25 21:30:12 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:30:12 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:30:12 user nova-compute[74189]:       <target dev="tap005bac46-89"/>
Oct 25 21:30:12 user nova-compute[74189]:     </interface>
Oct 25 21:30:12 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:30:12 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/9733d5c8-4476-4903-bd1b-16d43a54fdbd/console.log" append="off"/>
Oct 25 21:30:12 user nova-compute[74189]:     </serial>
Oct 25 21:30:12 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:30:12 user nova-compute[74189]:     <video>
Oct 25 21:30:12 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:30:12 user nova-compute[74189]:     </video>
Oct 25 21:30:12 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:30:12 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:30:12 user nova-compute[74189]:     </rng>
Oct 25 21:30:12 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:30:12 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:30:12 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:30:12 user nova-compute[74189]:     </memballoon>
Oct 25 21:30:12 user nova-compute[74189]:   </devices>
Oct 25 21:30:12 user nova-compute[74189]: </domain>
Oct 25 21:30:12 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:30:12 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Instance destroyed successfully.
Oct 25 21:30:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] No VIF found with MAC fa:16:3e:1d:ce:94, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ba374a-821b-424c-aeaa-528a0164160e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ba374a-821b-424c-aeaa-528a0164160e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ba374a-821b-424c-aeaa-528a0164160e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ba374a-821b-424c-aeaa-528a0164160e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:13 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:30:13 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:30:13 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:30:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:13 user nova-compute[74189]: DEBUG nova.compute.manager [req-1a9700d7-4b48-4449-af26-2858e897b2d6 req-074ed901-1a0b-4e08-9c03-0b2ae0238630 service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Received event network-vif-plugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:30:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1a9700d7-4b48-4449-af26-2858e897b2d6 req-074ed901-1a0b-4e08-9c03-0b2ae0238630 service nova] Acquiring lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:30:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1a9700d7-4b48-4449-af26-2858e897b2d6 req-074ed901-1a0b-4e08-9c03-0b2ae0238630 service nova] Lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:30:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1a9700d7-4b48-4449-af26-2858e897b2d6 req-074ed901-1a0b-4e08-9c03-0b2ae0238630 service nova] Lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:30:13 user nova-compute[74189]: DEBUG nova.compute.manager [req-1a9700d7-4b48-4449-af26-2858e897b2d6 req-074ed901-1a0b-4e08-9c03-0b2ae0238630 service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] No waiting events found dispatching network-vif-plugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:30:13 user nova-compute[74189]: WARNING nova.compute.manager [req-1a9700d7-4b48-4449-af26-2858e897b2d6 req-074ed901-1a0b-4e08-9c03-0b2ae0238630 service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Received unexpected event network-vif-plugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 for instance with vm_state active and task_state rescuing.
Oct 25 21:30:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:30:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:30:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9733d5c8-4476-4903-bd1b-16d43a54fdbd/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9733d5c8-4476-4903-bd1b-16d43a54fdbd/disk.rescue --force-share --output=json" returned: 0 in 0.229s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9733d5c8-4476-4903-bd1b-16d43a54fdbd/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9733d5c8-4476-4903-bd1b-16d43a54fdbd/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG nova.compute.manager [req-361d4127-8929-41cb-b3a2-15e4aa08111a req-f6751aa8-dd98-4733-a0c3-14b9b0cfcb94 service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Received event network-vif-plugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-361d4127-8929-41cb-b3a2-15e4aa08111a req-f6751aa8-dd98-4733-a0c3-14b9b0cfcb94 service nova] Acquiring lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-361d4127-8929-41cb-b3a2-15e4aa08111a req-f6751aa8-dd98-4733-a0c3-14b9b0cfcb94 service nova] Lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-361d4127-8929-41cb-b3a2-15e4aa08111a req-f6751aa8-dd98-4733-a0c3-14b9b0cfcb94 service nova] Lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG nova.compute.manager [req-361d4127-8929-41cb-b3a2-15e4aa08111a req-f6751aa8-dd98-4733-a0c3-14b9b0cfcb94 service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] No waiting events found dispatching network-vif-plugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:30:16 user nova-compute[74189]: WARNING nova.compute.manager [req-361d4127-8929-41cb-b3a2-15e4aa08111a req-f6751aa8-dd98-4733-a0c3-14b9b0cfcb94 service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Received unexpected event network-vif-plugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 for instance with vm_state active and task_state rescuing.
Oct 25 21:30:16 user nova-compute[74189]: DEBUG nova.compute.manager [None req-90d13436-28c7-4d23-91ea-f20f063bee9f tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQlJMiFb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:30:16 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:30:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:30:16 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:30:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:30:16 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224 -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:16 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:30:16 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:30:16 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=7373MB free_disk=24.892921447753906GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fead7fed-14ba-4d24-a864-965ab5bf6f03]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:30:16 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224 -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7748bb0-267f-45de-a089-fffbc9e9ec6e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224] added
Oct 25 21:30:16 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f723307-d303-4ad9-9812-e696cdbf48dc]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.175s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f17175d-68a4-48b8-b5e7-768a54ad9648]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cQlJMiFb {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cQlJMiFb" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f840898-d26d-4daf-b525-56a46fb92b5f]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cQlJMiFb'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance d7c3a99a-ab38-4e88-896d-94ae51a09a48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance af1d7b3c-9950-4b74-8f15-b31011ccfa24 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance de6b6789-b328-4c3b-8d24-07774d5dbe6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 932fe8ac-fdde-45c6-aa32-9bf866f19a4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 0b4f80c4-98cc-440a-aac7-cd423b71a231 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 7eff6940-9675-4c89-bd28-378a5db4369f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance cdb13b8f-c136-4f2b-95b9-e464babac28a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 9a15fb16-8623-4a20-ae26-5f0aab29ec07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance c5ba374a-821b-424c-aeaa-528a0164160e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 9733d5c8-4476-4903-bd1b-16d43a54fdbd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 7de30b3e-49a6-4493-8ff5-3740d9a796e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance a57b1185-270e-40d0-a55e-986960826169 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c12f696-29e1-4b36-9aed-4db78e430deb]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79cda88-3000-4ff0-9fe8-a54746c85fde]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:30:16 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:30:16 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:30:16 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:30:16 user nova-compute[74189]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 (non-flash)
Oct 25 21:30:16 user nova-compute[74189]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:30:16 user nova-compute[74189]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 (non-flash)
Oct 25 21:30:16 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:30:16 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:30:16 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:30:16 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:30:16 user nova-compute[74189]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 (non-flash)
Oct 25 21:30:16 user nova-compute[74189]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:30:16 user nova-compute[74189]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 (non-flash)
Oct 25 21:30:16 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224 -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1715903e-be3c-4ca8-9008-a1a14460bc95]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224, portal: 172.16.0.220,3260]
Oct 25 21:30:16 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224, portal: 172.16.0.220,3260] successful.
Oct 25 21:30:16 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0759517c-1843-4e6d-bb3f-1faa20db9078]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8582de2-b586-43e8-8cf9-57c11561b9cd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:30:16 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:30:16 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:30:16 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:30:16 user nova-compute[74189]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 (non-flash)
Oct 25 21:30:16 user nova-compute[74189]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:30:16 user nova-compute[74189]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 (non-flash)
Oct 25 21:30:16 user nova-compute[74189]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224 (non-flash)
Oct 25 21:30:16 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:30:16 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:30:16 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:30:16 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:30:16 user nova-compute[74189]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 (non-flash)
Oct 25 21:30:16 user nova-compute[74189]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:30:16 user nova-compute[74189]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 (non-flash)
Oct 25 21:30:16 user nova-compute[74189]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224 (non-flash)
Oct 25 21:30:16 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.499s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] HCTL ('40', '-', '-', 0) found on session 38 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[189aa3f6-ef52-4a09-bcb1-893b35ad0370]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Searching for a device in session 38 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQlJMiFb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:30:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.766s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:30:17 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:30:17 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:30:17 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:30:17 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:30:17 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:30:17 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:30:17 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:30:17 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.540s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:30:17 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] <== connect_volume: return (1541ms) {'type': 'block', 'scsi_wwn': '23963643532373764', 'path': '/dev/sdi'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:30:17 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963643532373764', 'path': '/dev/sdi'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:30:17 user nova-compute[74189]: DEBUG nova.objects.instance [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lazy-loading 'flavor' on Instance uuid c5ba374a-821b-424c-aeaa-528a0164160e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:30:17 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 21:30:17 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:30:17 user nova-compute[74189]:   <source dev="/dev/sdi"/>
Oct 25 21:30:17 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:30:17 user nova-compute[74189]:   <serial>61840ac6-1bb6-4c6a-8381-b8f0694ae224</serial>
Oct 25 21:30:17 user nova-compute[74189]: </disk>
Oct 25 21:30:17 user nova-compute[74189]:  {{(pid=74189) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 21:30:18 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:30:18 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:30:18 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] No VIF found with MAC fa:16:3e:7b:b8:af, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:30:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-52fc1052-da5f-45c1-8ddf-af4401f8ed51 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "c5ba374a-821b-424c-aeaa-528a0164160e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:30:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "c5ba374a-821b-424c-aeaa-528a0164160e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:30:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "c5ba374a-821b-424c-aeaa-528a0164160e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:30:19 user nova-compute[74189]: INFO nova.compute.manager [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Detaching volume 61840ac6-1bb6-4c6a-8381-b8f0694ae224
Oct 25 21:30:19 user nova-compute[74189]: INFO nova.virt.block_device [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Attempting to driver detach volume 61840ac6-1bb6-4c6a-8381-b8f0694ae224 from mountpoint /dev/vdb
Oct 25 21:30:19 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Attempting to detach device vdb from instance c5ba374a-821b-424c-aeaa-528a0164160e from the persistent domain config. {{(pid=74189) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 21:30:19 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:30:19 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:30:19 user nova-compute[74189]:   <source dev="/dev/sdi"/>
Oct 25 21:30:19 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:30:19 user nova-compute[74189]:   <serial>61840ac6-1bb6-4c6a-8381-b8f0694ae224</serial>
Oct 25 21:30:19 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:30:19 user nova-compute[74189]: </disk>
Oct 25 21:30:19 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:30:19 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Successfully detached device vdb from instance c5ba374a-821b-424c-aeaa-528a0164160e from the persistent domain config.
Oct 25 21:30:19 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c5ba374a-821b-424c-aeaa-528a0164160e from the live domain config. {{(pid=74189) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 21:30:19 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:30:19 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:30:19 user nova-compute[74189]:   <source dev="/dev/sdi"/>
Oct 25 21:30:19 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:30:19 user nova-compute[74189]:   <serial>61840ac6-1bb6-4c6a-8381-b8f0694ae224</serial>
Oct 25 21:30:19 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:30:19 user nova-compute[74189]: </disk>
Oct 25 21:30:19 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:30:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c5ba374a-821b-424c-aeaa-528a0164160e {{(pid=74189) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 21:30:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:40 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c5ba374a-821b-424c-aeaa-528a0164160e is timed out.
Oct 25 21:30:40 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Successfully detached device vdb from instance c5ba374a-821b-424c-aeaa-528a0164160e from the live domain config.
Oct 25 21:30:40 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQlJMiFb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:30:40 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:30:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e952a7-b128-4903-b2c2-aa69f3fed9ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:30:40 user nova-compute[74189]: No targets found.
Oct 25 21:30:40 user nova-compute[74189]: iSNS:
Oct 25 21:30:40 user nova-compute[74189]: No targets found.
Oct 25 21:30:40 user nova-compute[74189]: STATIC:
Oct 25 21:30:40 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce
Oct 25 21:30:40 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:30:40 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:30:40 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224
Oct 25 21:30:40 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:30:40 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:30:40 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d
Oct 25 21:30:40 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:30:40 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:30:40 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245
Oct 25 21:30:40 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:30:40 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:30:40 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740
Oct 25 21:30:40 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:30:40 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:30:40 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1
Oct 25 21:30:40 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:30:40 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:30:40 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e
Oct 25 21:30:40 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:30:40 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:30:40 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:30:40 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:30:40 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:30:40 user nova-compute[74189]: FIRMWARE:
Oct 25 21:30:40 user nova-compute[74189]: No targets found.
Oct 25 21:30:40 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:30:40 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:30:40 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6733b0-ec46-4365-90f5-222743c18411]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea5876d-68fb-4552-834e-ec7edbb5da96]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:30:40 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:30:40 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:30:40 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:30:40 user nova-compute[74189]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 (non-flash)
Oct 25 21:30:40 user nova-compute[74189]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:30:40 user nova-compute[74189]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 (non-flash)
Oct 25 21:30:40 user nova-compute[74189]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224 (non-flash)
Oct 25 21:30:40 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:30:40 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:30:40 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:30:40 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:30:40 user nova-compute[74189]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 (non-flash)
Oct 25 21:30:40 user nova-compute[74189]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:30:40 user nova-compute[74189]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 (non-flash)
Oct 25 21:30:40 user nova-compute[74189]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224 (non-flash)
Oct 25 21:30:40 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2e42bcdc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224'): ({'sdi'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Removing single pathed devices sdi {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.043s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[045f4c8d-d59e-4893-8181-d16ec43433a7]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9615c51-6aa0-49e9-8b57-b34a874e76c9]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Flushing IO for device /dev/sdi {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[833777e2-65a4-418d-aebb-d7e8b0187172]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.045s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6deee5c4-6daa-4c62-a8f3-9786f3b48713]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] SCSI volumes sdi have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[682f3e2d-c268-44dc-b25f-906712f8c3f4]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224 -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[083c68e1-4619-4a0c-b5c8-5bbf90b430b7]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224, portal: 172.16.0.220,3260]
Oct 25 21:30:40 user nova-compute[74189]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224, portal: 172.16.0.220,3260] successful.
Oct 25 21:30:40 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224 -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61840ac6-1bb6-4c6a-8381-b8f0694ae224 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9160da1f-3745-467f-b24d-1f04b9326444]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] <== disconnect_volume: return (374ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:30:40 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:30:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Acquiring lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:30:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:30:41 user nova-compute[74189]: INFO nova.compute.manager [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Unshelving
Oct 25 21:30:41 user nova-compute[74189]: DEBUG nova.objects.instance [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lazy-loading 'flavor' on Instance uuid c5ba374a-821b-424c-aeaa-528a0164160e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:30:41 user nova-compute[74189]: INFO nova.virt.block_device [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Booting with volume e76a8bc1-8695-4085-874e-c1575956d75e at /dev/vda
Oct 25 21:30:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e55e8519-94bf-4a64-bac1-93f5e5646d89 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "c5ba374a-821b-424c-aeaa-528a0164160e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.908s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:30:41 user nova-compute[74189]: DEBUG os_brick.utils [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:30:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:41 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[428b9fb9-edbd-4a73-910f-e3b06643e496]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:41 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[458b288c-c6d7-4c9f-88d7-a3328f8d5fa6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:41 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b290b06-289f-4553-80e3-cedad6edb360]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:41 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2bd98d-21d1-402a-a90a-131a73a49305]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:30:41 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:30:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:30:41 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:30:41 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[237a3cfe-d19b-44cc-a273-58e2dace6a23]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:41 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:30:41 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:30:41 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:30:41 user nova-compute[74189]: DEBUG os_brick.utils [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:30:41 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Updating existing volume attachment record: a47f7594-4ffc-4ee8-93f7-5234b9b63c9f {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:30:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:46 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "7eff6940-9675-4c89-bd28-378a5db4369f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:30:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "7eff6940-9675-4c89-bd28-378a5db4369f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:30:47 user nova-compute[74189]: INFO nova.compute.manager [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Detaching volume 148fadc7-8c60-4425-8451-634634e85cf1
Oct 25 21:30:47 user nova-compute[74189]: INFO nova.virt.block_device [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Attempting to driver detach volume 148fadc7-8c60-4425-8451-634634e85cf1 from mountpoint /dev/vdb
Oct 25 21:30:47 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Attempting to detach device vdb from instance 7eff6940-9675-4c89-bd28-378a5db4369f from the persistent domain config. {{(pid=74189) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 21:30:47 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:30:47 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:30:47 user nova-compute[74189]:   <source dev="/dev/sdc"/>
Oct 25 21:30:47 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:30:47 user nova-compute[74189]:   <serial>148fadc7-8c60-4425-8451-634634e85cf1</serial>
Oct 25 21:30:47 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 21:30:47 user nova-compute[74189]: </disk>
Oct 25 21:30:47 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:30:47 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Successfully detached device vdb from instance 7eff6940-9675-4c89-bd28-378a5db4369f from the persistent domain config.
Oct 25 21:30:47 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7eff6940-9675-4c89-bd28-378a5db4369f from the live domain config. {{(pid=74189) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 21:30:47 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:30:47 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:30:47 user nova-compute[74189]:   <source dev="/dev/sdc"/>
Oct 25 21:30:47 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:30:47 user nova-compute[74189]:   <serial>148fadc7-8c60-4425-8451-634634e85cf1</serial>
Oct 25 21:30:47 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 21:30:47 user nova-compute[74189]: </disk>
Oct 25 21:30:47 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:30:47 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7eff6940-9675-4c89-bd28-378a5db4369f {{(pid=74189) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 21:30:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:51 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:53 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:55 user nova-compute[74189]: DEBUG nova.compute.manager [req-0d73132b-2923-4731-94ec-6037320852a3 req-0035550b-8912-421c-b48e-7905bde44c40 service nova] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Received event network-changed-904c11d7-fd7b-46dc-b821-42186bfa849c {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:30:55 user nova-compute[74189]: DEBUG nova.compute.manager [req-0d73132b-2923-4731-94ec-6037320852a3 req-0035550b-8912-421c-b48e-7905bde44c40 service nova] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Refreshing instance network info cache due to event network-changed-904c11d7-fd7b-46dc-b821-42186bfa849c. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:30:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0d73132b-2923-4731-94ec-6037320852a3 req-0035550b-8912-421c-b48e-7905bde44c40 service nova] Acquiring lock "refresh_cache-7de30b3e-49a6-4493-8ff5-3740d9a796e8" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:30:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0d73132b-2923-4731-94ec-6037320852a3 req-0035550b-8912-421c-b48e-7905bde44c40 service nova] Acquired lock "refresh_cache-7de30b3e-49a6-4493-8ff5-3740d9a796e8" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:30:55 user nova-compute[74189]: DEBUG nova.network.neutron [req-0d73132b-2923-4731-94ec-6037320852a3 req-0035550b-8912-421c-b48e-7905bde44c40 service nova] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Refreshing network info cache for port 904c11d7-fd7b-46dc-b821-42186bfa849c {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:30:55 user nova-compute[74189]: DEBUG nova.network.neutron [req-0d73132b-2923-4731-94ec-6037320852a3 req-0035550b-8912-421c-b48e-7905bde44c40 service nova] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Updated VIF entry in instance network info cache for port 904c11d7-fd7b-46dc-b821-42186bfa849c. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:30:55 user nova-compute[74189]: DEBUG nova.network.neutron [req-0d73132b-2923-4731-94ec-6037320852a3 req-0035550b-8912-421c-b48e-7905bde44c40 service nova] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Updating instance_info_cache with network_info: [{"id": "904c11d7-fd7b-46dc-b821-42186bfa849c", "address": "fa:16:3e:21:11:86", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904c11d7-fd", "ovs_interfaceid": "904c11d7-fd7b-46dc-b821-42186bfa849c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:30:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0d73132b-2923-4731-94ec-6037320852a3 req-0035550b-8912-421c-b48e-7905bde44c40 service nova] Releasing lock "refresh_cache-7de30b3e-49a6-4493-8ff5-3740d9a796e8" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "7de30b3e-49a6-4493-8ff5-3740d9a796e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "7de30b3e-49a6-4493-8ff5-3740d9a796e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "7de30b3e-49a6-4493-8ff5-3740d9a796e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "7de30b3e-49a6-4493-8ff5-3740d9a796e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "7de30b3e-49a6-4493-8ff5-3740d9a796e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:30:56 user nova-compute[74189]: INFO nova.compute.manager [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Terminating instance
Oct 25 21:30:56 user nova-compute[74189]: DEBUG nova.compute.manager [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG nova.compute.manager [req-c7672719-2387-411b-b0c3-0c62fb8d03f8 req-423d9772-bd71-4968-a320-98ac48845864 service nova] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Received event network-vif-unplugged-904c11d7-fd7b-46dc-b821-42186bfa849c {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c7672719-2387-411b-b0c3-0c62fb8d03f8 req-423d9772-bd71-4968-a320-98ac48845864 service nova] Acquiring lock "7de30b3e-49a6-4493-8ff5-3740d9a796e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c7672719-2387-411b-b0c3-0c62fb8d03f8 req-423d9772-bd71-4968-a320-98ac48845864 service nova] Lock "7de30b3e-49a6-4493-8ff5-3740d9a796e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c7672719-2387-411b-b0c3-0c62fb8d03f8 req-423d9772-bd71-4968-a320-98ac48845864 service nova] Lock "7de30b3e-49a6-4493-8ff5-3740d9a796e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG nova.compute.manager [req-c7672719-2387-411b-b0c3-0c62fb8d03f8 req-423d9772-bd71-4968-a320-98ac48845864 service nova] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] No waiting events found dispatching network-vif-unplugged-904c11d7-fd7b-46dc-b821-42186bfa849c {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG nova.compute.manager [req-c7672719-2387-411b-b0c3-0c62fb8d03f8 req-423d9772-bd71-4968-a320-98ac48845864 service nova] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Received event network-vif-unplugged-904c11d7-fd7b-46dc-b821-42186bfa849c for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:56 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Instance destroyed successfully.
Oct 25 21:30:56 user nova-compute[74189]: DEBUG nova.objects.instance [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lazy-loading 'resources' on Instance uuid 7de30b3e-49a6-4493-8ff5-3740d9a796e8 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:29:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2012476369',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2012476369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2012476369',id=31,image_ref='b64caa99-d310-4900-ad4b-0ce6aa60ba58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGcd2NdOqvtPqi4vbwcnpBc7KZCWXmeDR0I7AfqwdAA3GAJGwlH20k6sw0kEe4q6786bynct8kulGnGLlJGM8vevZq4Q/LbhxoPX5lNGCxZWHfC9peKfRs8ik60rz5dAHA==',key_name='tempest-keypair-719428534',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:29:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e893e8f3f58e4e15920d313b6391682c',ramdisk_id='',reservation_id='r-qvavmn7c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1934687878',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1934687878-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1934687878',owner_user_name='tempest-TestVolumeBootPattern-1934687878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:29:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77a27a7ebb4a458097c901871c378bc8',uuid=7de30b3e-49a6-4493-8ff5-3740d9a796e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "904c11d7-fd7b-46dc-b821-42186bfa849c", "address": "fa:16:3e:21:11:86", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904c11d7-fd", "ovs_interfaceid": "904c11d7-fd7b-46dc-b821-42186bfa849c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converting VIF {"id": "904c11d7-fd7b-46dc-b821-42186bfa849c", "address": "fa:16:3e:21:11:86", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904c11d7-fd", "ovs_interfaceid": "904c11d7-fd7b-46dc-b821-42186bfa849c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:11:86,bridge_name='br-int',has_traffic_filtering=True,id=904c11d7-fd7b-46dc-b821-42186bfa849c,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904c11d7-fd') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG os_vif [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:11:86,bridge_name='br-int',has_traffic_filtering=True,id=904c11d7-fd7b-46dc-b821-42186bfa849c,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904c11d7-fd') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap904c11d7-fd, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bce6f4f8-d536-4e10-96c3-e1afd00eef30) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:56 user nova-compute[74189]: INFO os_vif [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:11:86,bridge_name='br-int',has_traffic_filtering=True,id=904c11d7-fd7b-46dc-b821-42186bfa849c,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904c11d7-fd')
Oct 25 21:30:56 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bDWejPzJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:30:56 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:30:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd33f7f7-60dc-4c08-9a2c-7b6cd798823e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:30:56 user nova-compute[74189]: No targets found.
Oct 25 21:30:56 user nova-compute[74189]: iSNS:
Oct 25 21:30:56 user nova-compute[74189]: No targets found.
Oct 25 21:30:56 user nova-compute[74189]: STATIC:
Oct 25 21:30:56 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce
Oct 25 21:30:56 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:30:56 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:30:56 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d
Oct 25 21:30:56 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:30:56 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:30:56 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245
Oct 25 21:30:56 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:30:56 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:30:56 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740
Oct 25 21:30:56 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:30:56 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:30:56 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1
Oct 25 21:30:56 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:30:56 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:30:56 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e
Oct 25 21:30:56 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:30:56 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:30:56 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:30:56 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:30:56 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:30:56 user nova-compute[74189]: FIRMWARE:
Oct 25 21:30:56 user nova-compute[74189]: No targets found.
Oct 25 21:30:56 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:30:56 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:30:56 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[585a57f5-b6ad-4bda-b67c-d96a0d0b67e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da01420-3b13-41c1-885f-3dfb1aeb8eea]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:30:56 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:30:56 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:30:56 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:30:56 user nova-compute[74189]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 (non-flash)
Oct 25 21:30:56 user nova-compute[74189]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:30:56 user nova-compute[74189]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 (non-flash)
Oct 25 21:30:56 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:30:56 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:30:56 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:30:56 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:30:56 user nova-compute[74189]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 (non-flash)
Oct 25 21:30:56 user nova-compute[74189]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:30:56 user nova-compute[74189]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 (non-flash)
Oct 25 21:30:56 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2e44640d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740'): ({'sdd'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Removing single pathed devices sdd {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:30:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[219431eb-abb4-4c1d-bf70-6ecfd692ca43]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5e75f9-5a46-4afe-9149-cd9238b4fdfa]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:57 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Flushing IO for device /dev/sdd {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:30:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf29bc05-c9dc-4cae-b906-df52fa22da46]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:57 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:30:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.081s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb29f4b-81ec-411e-9aee-bc01e7ee79f2]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:57 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:30:57 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] SCSI volumes sdd have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:30:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:30:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b5b6ad-580d-4145-b3a2-d0f98b08d4fc]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:30:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee9f00e-042a-410d-8e73-3b51bcb12d35]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740, portal: 172.16.0.220,3260]
Oct 25 21:30:57 user nova-compute[74189]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740, portal: 172.16.0.220,3260] successful.
Oct 25 21:30:57 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:30:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:30:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9b2db9-b83b-42a8-92a5-8d1e921ca740 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:30:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[892586a1-6c36-4fd8-a67c-1089a1430c83]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:30:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:30:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:30:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] <== disconnect_volume: return (386ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:30:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:30:57 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Deleting instance files /opt/stack/data/nova/instances/7de30b3e-49a6-4493-8ff5-3740d9a796e8_del
Oct 25 21:30:57 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Deletion of /opt/stack/data/nova/instances/7de30b3e-49a6-4493-8ff5-3740d9a796e8_del complete
Oct 25 21:30:57 user nova-compute[74189]: INFO nova.compute.manager [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Took 1.28 seconds to destroy the instance on the hypervisor.
Oct 25 21:30:57 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:30:57 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:30:57 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:30:58 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:30:58 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Took 0.81 seconds to deallocate network for instance.
Oct 25 21:30:58 user nova-compute[74189]: DEBUG nova.compute.manager [req-8d8eb0e9-e909-499a-a6c1-011dec35fc83 req-5b1e72ae-ed5a-4e8b-ab21-f3e83e6bc6a8 service nova] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Received event network-vif-deleted-904c11d7-fd7b-46dc-b821-42186bfa849c {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:30:58 user nova-compute[74189]: DEBUG nova.compute.manager [req-4d4d2931-a43e-4332-bab6-d89b9a2c8709 req-ff221984-bccc-4f7d-9463-be49210f3ce3 service nova] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Received event network-vif-plugged-904c11d7-fd7b-46dc-b821-42186bfa849c {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:30:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4d4d2931-a43e-4332-bab6-d89b9a2c8709 req-ff221984-bccc-4f7d-9463-be49210f3ce3 service nova] Acquiring lock "7de30b3e-49a6-4493-8ff5-3740d9a796e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:30:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4d4d2931-a43e-4332-bab6-d89b9a2c8709 req-ff221984-bccc-4f7d-9463-be49210f3ce3 service nova] Lock "7de30b3e-49a6-4493-8ff5-3740d9a796e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:30:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4d4d2931-a43e-4332-bab6-d89b9a2c8709 req-ff221984-bccc-4f7d-9463-be49210f3ce3 service nova] Lock "7de30b3e-49a6-4493-8ff5-3740d9a796e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:30:58 user nova-compute[74189]: DEBUG nova.compute.manager [req-4d4d2931-a43e-4332-bab6-d89b9a2c8709 req-ff221984-bccc-4f7d-9463-be49210f3ce3 service nova] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] No waiting events found dispatching network-vif-plugged-904c11d7-fd7b-46dc-b821-42186bfa849c {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:30:58 user nova-compute[74189]: WARNING nova.compute.manager [req-4d4d2931-a43e-4332-bab6-d89b9a2c8709 req-ff221984-bccc-4f7d-9463-be49210f3ce3 service nova] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Received unexpected event network-vif-plugged-904c11d7-fd7b-46dc-b821-42186bfa849c for instance with vm_state active and task_state deleting.
Oct 25 21:30:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:30:58 user nova-compute[74189]: INFO nova.compute.manager [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Took 0.80 seconds to detach 1 volumes for instance.
Oct 25 21:30:58 user nova-compute[74189]: DEBUG nova.compute.manager [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 7de30b3e-49a6-4493-8ff5-3740d9a796e8] Deleting volume: da9b2db9-b83b-42a8-92a5-8d1e921ca740 {{(pid=74189) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 25 21:30:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:30:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:30:59 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:30:59 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:30:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.462s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:30:59 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Deleted allocations for instance 7de30b3e-49a6-4493-8ff5-3740d9a796e8
Oct 25 21:30:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e19bc97e-df24-4182-91ed-0d1f9be91dcd tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "7de30b3e-49a6-4493-8ff5-3740d9a796e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.688s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:04 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:31:04 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74189) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 21:31:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:07 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:31:07 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:31:07 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7eff6940-9675-4c89-bd28-378a5db4369f is timed out.
Oct 25 21:31:07 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Successfully detached device vdb from instance 7eff6940-9675-4c89-bd28-378a5db4369f from the live domain config.
Oct 25 21:31:07 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:31:07 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HQGOgDXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:31:07 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:31:07 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:31:07 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:31:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:07 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29b9dce-218f-4cb8-92d0-fcfc4d18f02c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:07 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:31:07 user nova-compute[74189]: No targets found.
Oct 25 21:31:07 user nova-compute[74189]: iSNS:
Oct 25 21:31:07 user nova-compute[74189]: No targets found.
Oct 25 21:31:07 user nova-compute[74189]: STATIC:
Oct 25 21:31:07 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce
Oct 25 21:31:07 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:31:07 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:31:07 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d
Oct 25 21:31:07 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:31:07 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:31:07 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245
Oct 25 21:31:07 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:31:07 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:31:07 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1
Oct 25 21:31:07 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:31:07 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:31:07 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e
Oct 25 21:31:07 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:31:07 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:31:07 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:31:07 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:31:07 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:31:07 user nova-compute[74189]: FIRMWARE:
Oct 25 21:31:07 user nova-compute[74189]: No targets found.
Oct 25 21:31:07 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:31:07 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:31:07 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:31:07 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:31:07 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5c0396-0b21-432f-a2fc-a522e008467e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-932fe8ac-fdde-45c6-aa32-9bf866f19a4e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-932fe8ac-fdde-45c6-aa32-9bf866f19a4e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[872c6039-127a-43a5-a5b2-33b35b85a005]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:31:08 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:31:08 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:31:08 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:31:08 user nova-compute[74189]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:31:08 user nova-compute[74189]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 (non-flash)
Oct 25 21:31:08 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:31:08 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:31:08 user nova-compute[74189]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 (non-flash)
Oct 25 21:31:08 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:31:08 user nova-compute[74189]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:31:08 user nova-compute[74189]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 (non-flash)
Oct 25 21:31:08 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2e431fd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1'): ({'sdc'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Removing single pathed devices sdc {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[149a63e9-b1d1-49d2-aa34-113e8329d8a4]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed064b66-c533-418a-8cb9-96a566746e5b]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Flushing IO for device /dev/sdc {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f02da2-808c-4d11-8d1b-332397d0d229]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[86277005-594c-4387-9061-b5b3e3288a41]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] SCSI volumes sdc have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bec3d1a-a569-422e-b381-7f21a3822ce6]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9493ef46-1f0e-4d2a-9c56-75fc87760fab]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1, portal: 172.16.0.220,3260]
Oct 25 21:31:08 user nova-compute[74189]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1, portal: 172.16.0.220,3260] successful.
Oct 25 21:31:08 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:148fadc7-8c60-4425-8451-634634e85cf1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8eb9852-ff4f-4312-b350-64315640d653]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] <== disconnect_volume: return (368ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Updating instance_info_cache with network_info: [{"id": "8eb6e9e2-60c6-463d-8525-b768933a94df", "address": "fa:16:3e:e8:de:d0", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb6e9e2-60", "ovs_interfaceid": "8eb6e9e2-60c6-463d-8525-b768933a94df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-932fe8ac-fdde-45c6-aa32-9bf866f19a4e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:09 user nova-compute[74189]: DEBUG nova.objects.instance [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lazy-loading 'flavor' on Instance uuid 7eff6940-9675-4c89-bd28-378a5db4369f {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:31:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dc878370-99cb-4dfd-96c7-ecd705a25cae tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "7eff6940-9675-4c89-bd28-378a5db4369f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.170s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:09 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:31:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:09 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:31:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8d0c0bff-81ce-48f2-8299-f163fad99d13 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "c5ba374a-821b-424c-aeaa-528a0164160e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8d0c0bff-81ce-48f2-8299-f163fad99d13 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "c5ba374a-821b-424c-aeaa-528a0164160e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8d0c0bff-81ce-48f2-8299-f163fad99d13 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "c5ba374a-821b-424c-aeaa-528a0164160e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8d0c0bff-81ce-48f2-8299-f163fad99d13 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "c5ba374a-821b-424c-aeaa-528a0164160e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8d0c0bff-81ce-48f2-8299-f163fad99d13 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "c5ba374a-821b-424c-aeaa-528a0164160e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:10 user nova-compute[74189]: INFO nova.compute.manager [None req-8d0c0bff-81ce-48f2-8299-f163fad99d13 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Terminating instance
Oct 25 21:31:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:10 user nova-compute[74189]: DEBUG nova.compute.manager [None req-8d0c0bff-81ce-48f2-8299-f163fad99d13 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:31:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:10 user nova-compute[74189]: DEBUG nova.compute.manager [req-363bbc73-4754-4ad7-9e15-5026c151167b req-6f55ad38-c376-4eb9-afef-fa29beffb555 service nova] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Received event network-vif-unplugged-d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:31:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-363bbc73-4754-4ad7-9e15-5026c151167b req-6f55ad38-c376-4eb9-afef-fa29beffb555 service nova] Acquiring lock "c5ba374a-821b-424c-aeaa-528a0164160e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-363bbc73-4754-4ad7-9e15-5026c151167b req-6f55ad38-c376-4eb9-afef-fa29beffb555 service nova] Lock "c5ba374a-821b-424c-aeaa-528a0164160e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-363bbc73-4754-4ad7-9e15-5026c151167b req-6f55ad38-c376-4eb9-afef-fa29beffb555 service nova] Lock "c5ba374a-821b-424c-aeaa-528a0164160e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:10 user nova-compute[74189]: DEBUG nova.compute.manager [req-363bbc73-4754-4ad7-9e15-5026c151167b req-6f55ad38-c376-4eb9-afef-fa29beffb555 service nova] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] No waiting events found dispatching network-vif-unplugged-d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:31:10 user nova-compute[74189]: DEBUG nova.compute.manager [req-363bbc73-4754-4ad7-9e15-5026c151167b req-6f55ad38-c376-4eb9-afef-fa29beffb555 service nova] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Received event network-vif-unplugged-d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:31:10 user nova-compute[74189]: DEBUG nova.compute.manager [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:31:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:10 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:31:10 user nova-compute[74189]: INFO nova.compute.claims [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Claim successful on node user
Oct 25 21:31:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:11 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Instance destroyed successfully.
Oct 25 21:31:11 user nova-compute[74189]: DEBUG nova.objects.instance [None req-8d0c0bff-81ce-48f2-8299-f163fad99d13 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lazy-loading 'resources' on Instance uuid c5ba374a-821b-424c-aeaa-528a0164160e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-8d0c0bff-81ce-48f2-8299-f163fad99d13 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:27:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-886177363',display_name='tempest-AttachVolumeNegativeTest-server-886177363',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-886177363',id=29,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPk0i4o/BUWjnY3jC/r4Q6xkYzs6FPZulOXDRz3PBrGup+1NRe9oc3qb5IaV0izUzG31ibaUMwYAftiC096v1uvX2COlvgwMfPIcPCEGA6mUpBK+9VN4koM4C0EGgQ04iw==',key_name='tempest-keypair-545815208',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:28:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a555d708aa644d586d5edad7db837b4',ramdisk_id='',reservation_id='r-q8a3cqch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-979681322',owner_user_name='tempest-AttachVolumeNegativeTest-979681322-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:28:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2f19a398fd9486fbef04eebad62a0cb',uuid=c5ba374a-821b-424c-aeaa-528a0164160e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b", "address": "fa:16:3e:7b:b8:af", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dcfc4c-1d", "ovs_interfaceid": "d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-8d0c0bff-81ce-48f2-8299-f163fad99d13 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Converting VIF {"id": "d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b", "address": "fa:16:3e:7b:b8:af", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dcfc4c-1d", "ovs_interfaceid": "d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-8d0c0bff-81ce-48f2-8299-f163fad99d13 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:b8:af,bridge_name='br-int',has_traffic_filtering=True,id=d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b,network=Network(5029031b-e67b-4f60-bc17-781cbdc88b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dcfc4c-1d') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG os_vif [None req-8d0c0bff-81ce-48f2-8299-f163fad99d13 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:b8:af,bridge_name='br-int',has_traffic_filtering=True,id=d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b,network=Network(5029031b-e67b-4f60-bc17-781cbdc88b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dcfc4c-1d') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0dcfc4c-1d, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9bae8659-b9bf-4921-aeca-4802d45258df) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:11 user nova-compute[74189]: INFO os_vif [None req-8d0c0bff-81ce-48f2-8299-f163fad99d13 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:b8:af,bridge_name='br-int',has_traffic_filtering=True,id=d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b,network=Network(5029031b-e67b-4f60-bc17-781cbdc88b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dcfc4c-1d')
Oct 25 21:31:11 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-8d0c0bff-81ce-48f2-8299-f163fad99d13 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Deleting instance files /opt/stack/data/nova/instances/c5ba374a-821b-424c-aeaa-528a0164160e_del
Oct 25 21:31:11 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-8d0c0bff-81ce-48f2-8299-f163fad99d13 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Deletion of /opt/stack/data/nova/instances/c5ba374a-821b-424c-aeaa-528a0164160e_del complete
Oct 25 21:31:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:11 user nova-compute[74189]: INFO nova.compute.manager [None req-8d0c0bff-81ce-48f2-8299-f163fad99d13 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Took 0.99 seconds to destroy the instance on the hypervisor.
Oct 25 21:31:11 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-8d0c0bff-81ce-48f2-8299-f163fad99d13 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "3da14c0a-31a8-4fe3-bd5a-49378680af50" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "3da14c0a-31a8-4fe3-bd5a-49378680af50" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG nova.compute.manager [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.906s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG nova.compute.manager [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.064s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG nova.compute.manager [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG nova.network.neutron [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:31:11 user nova-compute[74189]: INFO nova.compute.claims [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Claim successful on node user
Oct 25 21:31:11 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:31:11 user nova-compute[74189]: DEBUG nova.compute.manager [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG nova.policy [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '155c948b95c64c9083da984cdf6af494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df03fc18fc3467db76e336c6de78c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:11 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:31:11 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Error from libvirt while getting description of instance-0000001d: [Error Code 42] Domain not found: no domain with matching uuid 'c5ba374a-821b-424c-aeaa-528a0164160e' (instance-0000001d): libvirt.libvirtError: Domain not found: no domain with matching uuid 'c5ba374a-821b-424c-aeaa-528a0164160e' (instance-0000001d)
Oct 25 21:31:11 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG nova.compute.manager [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:31:12 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Creating image(s)
Oct 25 21:31:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "/opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "/opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "/opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.230s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:12 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Took 1.00 seconds to deallocate network for instance.
Oct 25 21:31:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8d0c0bff-81ce-48f2-8299-f163fad99d13 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG nova.network.neutron [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Successfully created port: 67d0e911-b6fd-44a7-ad9c-8b204562a0bf {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.220s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk 1073741824" returned: 0 in 0.049s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.179s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.028s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG nova.compute.manager [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG nova.compute.manager [req-d9c6c38a-6d7b-46d6-8d55-0c02a8853276 req-43b6df2d-830f-486e-b877-7bc30de9403d service nova] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Received event network-vif-plugged-d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d9c6c38a-6d7b-46d6-8d55-0c02a8853276 req-43b6df2d-830f-486e-b877-7bc30de9403d service nova] Acquiring lock "c5ba374a-821b-424c-aeaa-528a0164160e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d9c6c38a-6d7b-46d6-8d55-0c02a8853276 req-43b6df2d-830f-486e-b877-7bc30de9403d service nova] Lock "c5ba374a-821b-424c-aeaa-528a0164160e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d9c6c38a-6d7b-46d6-8d55-0c02a8853276 req-43b6df2d-830f-486e-b877-7bc30de9403d service nova] Lock "c5ba374a-821b-424c-aeaa-528a0164160e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG nova.compute.manager [req-d9c6c38a-6d7b-46d6-8d55-0c02a8853276 req-43b6df2d-830f-486e-b877-7bc30de9403d service nova] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] No waiting events found dispatching network-vif-plugged-d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:31:12 user nova-compute[74189]: WARNING nova.compute.manager [req-d9c6c38a-6d7b-46d6-8d55-0c02a8853276 req-43b6df2d-830f-486e-b877-7bc30de9403d service nova] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Received unexpected event network-vif-plugged-d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b for instance with vm_state deleted and task_state None.
Oct 25 21:31:12 user nova-compute[74189]: DEBUG nova.compute.manager [req-d9c6c38a-6d7b-46d6-8d55-0c02a8853276 req-43b6df2d-830f-486e-b877-7bc30de9403d service nova] [instance: c5ba374a-821b-424c-aeaa-528a0164160e] Received event network-vif-deleted-d0dcfc4c-1d4e-4aa5-b430-4117e7bc058b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.003s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG nova.objects.instance [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lazy-loading 'pci_requests' on Instance uuid d6e14e1a-6ef7-4a47-afc7-096326de8f5e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG nova.objects.instance [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lazy-loading 'numa_topology' on Instance uuid d6e14e1a-6ef7-4a47-afc7-096326de8f5e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:31:12 user nova-compute[74189]: INFO nova.compute.claims [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Claim successful on node user
Oct 25 21:31:12 user nova-compute[74189]: DEBUG nova.compute.manager [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG nova.network.neutron [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:31:12 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:31:12 user nova-compute[74189]: DEBUG nova.compute.manager [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Cannot resize image /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Ensure instance console log exists: /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG nova.policy [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '155c948b95c64c9083da984cdf6af494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df03fc18fc3467db76e336c6de78c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG nova.network.neutron [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Successfully updated port: 67d0e911-b6fd-44a7-ad9c-8b204562a0bf {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG nova.compute.manager [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:31:13 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Creating image(s)
Oct 25 21:31:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "/opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "/opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "/opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "refresh_cache-3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquired lock "refresh_cache-3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG nova.network.neutron [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG nova.compute.manager [req-7bc4e095-d72e-402f-8050-922f38228d10 req-f539e831-98ca-4335-b7b4-623a1b61c13c service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Received event network-changed-67d0e911-b6fd-44a7-ad9c-8b204562a0bf {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG nova.compute.manager [req-7bc4e095-d72e-402f-8050-922f38228d10 req-f539e831-98ca-4335-b7b4-623a1b61c13c service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Refreshing instance network info cache due to event network-changed-67d0e911-b6fd-44a7-ad9c-8b204562a0bf. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7bc4e095-d72e-402f-8050-922f38228d10 req-f539e831-98ca-4335-b7b4-623a1b61c13c service nova] Acquiring lock "refresh_cache-3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9733d5c8-4476-4903-bd1b-16d43a54fdbd/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG nova.network.neutron [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.180s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9733d5c8-4476-4903-bd1b-16d43a54fdbd/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9733d5c8-4476-4903-bd1b-16d43a54fdbd/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.184s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk 1073741824" returned: 0 in 0.079s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG nova.network.neutron [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Updating instance_info_cache with network_info: [{"id": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "address": "fa:16:3e:5d:2c:57", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d0e911-b6", "ovs_interfaceid": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9733d5c8-4476-4903-bd1b-16d43a54fdbd/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG nova.network.neutron [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Successfully created port: a5e7898d-caba-49d7-8310-630beb75bf21 {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Releasing lock "refresh_cache-3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG nova.compute.manager [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Instance network_info: |[{"id": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "address": "fa:16:3e:5d:2c:57", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d0e911-b6", "ovs_interfaceid": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7bc4e095-d72e-402f-8050-922f38228d10 req-f539e831-98ca-4335-b7b4-623a1b61c13c service nova] Acquired lock "refresh_cache-3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG nova.network.neutron [req-7bc4e095-d72e-402f-8050-922f38228d10 req-f539e831-98ca-4335-b7b4-623a1b61c13c service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Refreshing network info cache for port 67d0e911-b6fd-44a7-ad9c-8b204562a0bf {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:31:13 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Start _get_guest_xml network_info=[{"id": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "address": "fa:16:3e:5d:2c:57", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d0e911-b6", "ovs_interfaceid": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:31:13 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:31:13 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:31:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.541s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:31:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1844515886',display_name='tempest-ServerRescueNegativeTestJSON-server-1844515886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1844515886',id=32,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3df03fc18fc3467db76e336c6de78c92',ramdisk_id='',reservation_id='r-7eqktzfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-383982506',owner_user_name='tempest-ServerRescueNegativeTestJSON-383982506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:31:12Z,user_data=None,user_id='155c948b95c64c9083da984cdf6af494',uuid=3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "address": "fa:16:3e:5d:2c:57", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d0e911-b6", "ovs_interfaceid": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Converting VIF {"id": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "address": "fa:16:3e:5d:2c:57", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d0e911-b6", "ovs_interfaceid": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:2c:57,bridge_name='br-int',has_traffic_filtering=True,id=67d0e911-b6fd-44a7-ad9c-8b204562a0bf,network=Network(b496a106-2367-44dc-a788-bcd22ec98feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d0e911-b6') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.objects.instance [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lazy-loading 'pci_devices' on Instance uuid 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:31:14 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:31:14 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=7356MB free_disk=24.883502960205078GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:31:14 user nova-compute[74189]:   <uuid>3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef</uuid>
Oct 25 21:31:14 user nova-compute[74189]:   <name>instance-00000020</name>
Oct 25 21:31:14 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:31:14 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:31:14 user nova-compute[74189]:   <metadata>
Oct 25 21:31:14 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:31:14 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:31:14 user nova-compute[74189]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1844515886</nova:name>
Oct 25 21:31:14 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:31:13</nova:creationTime>
Oct 25 21:31:14 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:31:14 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:31:14 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:31:14 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:31:14 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:31:14 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:31:14 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:31:14 user nova-compute[74189]:       <nova:owner>
Oct 25 21:31:14 user nova-compute[74189]:         <nova:user uuid="155c948b95c64c9083da984cdf6af494">tempest-ServerRescueNegativeTestJSON-383982506-project-member</nova:user>
Oct 25 21:31:14 user nova-compute[74189]:         <nova:project uuid="3df03fc18fc3467db76e336c6de78c92">tempest-ServerRescueNegativeTestJSON-383982506</nova:project>
Oct 25 21:31:14 user nova-compute[74189]:       </nova:owner>
Oct 25 21:31:14 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:31:14 user nova-compute[74189]:       <nova:ports>
Oct 25 21:31:14 user nova-compute[74189]:         <nova:port uuid="67d0e911-b6fd-44a7-ad9c-8b204562a0bf">
Oct 25 21:31:14 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 25 21:31:14 user nova-compute[74189]:         </nova:port>
Oct 25 21:31:14 user nova-compute[74189]:       </nova:ports>
Oct 25 21:31:14 user nova-compute[74189]:     </nova:instance>
Oct 25 21:31:14 user nova-compute[74189]:   </metadata>
Oct 25 21:31:14 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:31:14 user nova-compute[74189]:     <system>
Oct 25 21:31:14 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:31:14 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:31:14 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:31:14 user nova-compute[74189]:       <entry name="serial">3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef</entry>
Oct 25 21:31:14 user nova-compute[74189]:       <entry name="uuid">3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef</entry>
Oct 25 21:31:14 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:31:14 user nova-compute[74189]:     </system>
Oct 25 21:31:14 user nova-compute[74189]:   </sysinfo>
Oct 25 21:31:14 user nova-compute[74189]:   <os>
Oct 25 21:31:14 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:31:14 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:31:14 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:31:14 user nova-compute[74189]:   </os>
Oct 25 21:31:14 user nova-compute[74189]:   <features>
Oct 25 21:31:14 user nova-compute[74189]:     <acpi/>
Oct 25 21:31:14 user nova-compute[74189]:     <apic/>
Oct 25 21:31:14 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:31:14 user nova-compute[74189]:   </features>
Oct 25 21:31:14 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:31:14 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:31:14 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:31:14 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:31:14 user nova-compute[74189]:   </clock>
Oct 25 21:31:14 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:31:14 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:31:14 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:31:14 user nova-compute[74189]:   </cpu>
Oct 25 21:31:14 user nova-compute[74189]:   <devices>
Oct 25 21:31:14 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:31:14 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:31:14 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk"/>
Oct 25 21:31:14 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:31:14 user nova-compute[74189]:     </disk>
Oct 25 21:31:14 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:31:14 user nova-compute[74189]:       <mac address="fa:16:3e:5d:2c:57"/>
Oct 25 21:31:14 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:31:14 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:31:14 user nova-compute[74189]:       <target dev="tap67d0e911-b6"/>
Oct 25 21:31:14 user nova-compute[74189]:     </interface>
Oct 25 21:31:14 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:31:14 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/console.log" append="off"/>
Oct 25 21:31:14 user nova-compute[74189]:     </serial>
Oct 25 21:31:14 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:31:14 user nova-compute[74189]:     <video>
Oct 25 21:31:14 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:31:14 user nova-compute[74189]:     </video>
Oct 25 21:31:14 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:31:14 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:31:14 user nova-compute[74189]:     </rng>
Oct 25 21:31:14 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:31:14 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:31:14 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:31:14 user nova-compute[74189]:     </memballoon>
Oct 25 21:31:14 user nova-compute[74189]:   </devices>
Oct 25 21:31:14 user nova-compute[74189]: </domain>
Oct 25 21:31:14 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:31:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1844515886',display_name='tempest-ServerRescueNegativeTestJSON-server-1844515886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1844515886',id=32,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3df03fc18fc3467db76e336c6de78c92',ramdisk_id='',reservation_id='r-7eqktzfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-383982506',owner_user_name='tempest-ServerRescueNegativeTestJSON-383982506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:31:12Z,user_data=None,user_id='155c948b95c64c9083da984cdf6af494',uuid=3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "address": "fa:16:3e:5d:2c:57", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d0e911-b6", "ovs_interfaceid": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Converting VIF {"id": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "address": "fa:16:3e:5d:2c:57", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d0e911-b6", "ovs_interfaceid": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:2c:57,bridge_name='br-int',has_traffic_filtering=True,id=67d0e911-b6fd-44a7-ad9c-8b204562a0bf,network=Network(b496a106-2367-44dc-a788-bcd22ec98feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d0e911-b6') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG os_vif [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:2c:57,bridge_name='br-int',has_traffic_filtering=True,id=67d0e911-b6fd-44a7-ad9c-8b204562a0bf,network=Network(b496a106-2367-44dc-a788-bcd22ec98feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d0e911-b6') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '330c84e8-7f44-5d6f-bfb4-959e41d0c3f9', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67d0e911-b6, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap67d0e911-b6, col_values=(('qos', UUID('d94cd34e-4617-40f9-8063-dd8ddf2d7d33')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap67d0e911-b6, col_values=(('external_ids', {'iface-id': '67d0e911-b6fd-44a7-ad9c-8b204562a0bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:2c:57', 'vm-uuid': '3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.487s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.network.neutron [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Successfully updated port: a5e7898d-caba-49d7-8310-630beb75bf21 {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8d0c0bff-81ce-48f2-8299-f163fad99d13 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.831s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:14 user nova-compute[74189]: INFO os_vif [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:2c:57,bridge_name='br-int',has_traffic_filtering=True,id=67d0e911-b6fd-44a7-ad9c-8b204562a0bf,network=Network(b496a106-2367-44dc-a788-bcd22ec98feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d0e911-b6')
Oct 25 21:31:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Cannot resize image /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Ensure instance console log exists: /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "refresh_cache-3da14c0a-31a8-4fe3-bd5a-49378680af50" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquired lock "refresh_cache-3da14c0a-31a8-4fe3-bd5a-49378680af50" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.network.neutron [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:31:14 user nova-compute[74189]: INFO nova.network.neutron [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Updating port 1d25f7eb-3650-4049-a6b9-4fe9ff701593 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.network.neutron [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] No VIF found with MAC fa:16:3e:5d:2c:57, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.network.neutron [req-7bc4e095-d72e-402f-8050-922f38228d10 req-f539e831-98ca-4335-b7b4-623a1b61c13c service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Updated VIF entry in instance network info cache for port 67d0e911-b6fd-44a7-ad9c-8b204562a0bf. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.network.neutron [req-7bc4e095-d72e-402f-8050-922f38228d10 req-f539e831-98ca-4335-b7b4-623a1b61c13c service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Updating instance_info_cache with network_info: [{"id": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "address": "fa:16:3e:5d:2c:57", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d0e911-b6", "ovs_interfaceid": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7bc4e095-d72e-402f-8050-922f38228d10 req-f539e831-98ca-4335-b7b4-623a1b61c13c service nova] Releasing lock "refresh_cache-3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.network.neutron [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Updating instance_info_cache with network_info: [{"id": "a5e7898d-caba-49d7-8310-630beb75bf21", "address": "fa:16:3e:9d:7f:d0", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5e7898d-ca", "ovs_interfaceid": "a5e7898d-caba-49d7-8310-630beb75bf21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Releasing lock "refresh_cache-3da14c0a-31a8-4fe3-bd5a-49378680af50" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.compute.manager [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Instance network_info: |[{"id": "a5e7898d-caba-49d7-8310-630beb75bf21", "address": "fa:16:3e:9d:7f:d0", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5e7898d-ca", "ovs_interfaceid": "a5e7898d-caba-49d7-8310-630beb75bf21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Start _get_guest_xml network_info=[{"id": "a5e7898d-caba-49d7-8310-630beb75bf21", "address": "fa:16:3e:9d:7f:d0", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5e7898d-ca", "ovs_interfaceid": "a5e7898d-caba-49d7-8310-630beb75bf21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:31:14 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:31:14 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:31:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1418568783',display_name='tempest-ServerRescueNegativeTestJSON-server-1418568783',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1418568783',id=33,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3df03fc18fc3467db76e336c6de78c92',ramdisk_id='',reservation_id='r-6kitp7g7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-383982506',owner_user_name='tempest-ServerRescueNegativeTestJSON-383982506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:31:13Z,user_data=None,user_id='155c948b95c64c9083da984cdf6af494',uuid=3da14c0a-31a8-4fe3-bd5a-49378680af50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5e7898d-caba-49d7-8310-630beb75bf21", "address": "fa:16:3e:9d:7f:d0", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5e7898d-ca", "ovs_interfaceid": "a5e7898d-caba-49d7-8310-630beb75bf21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Converting VIF {"id": "a5e7898d-caba-49d7-8310-630beb75bf21", "address": "fa:16:3e:9d:7f:d0", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5e7898d-ca", "ovs_interfaceid": "a5e7898d-caba-49d7-8310-630beb75bf21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:7f:d0,bridge_name='br-int',has_traffic_filtering=True,id=a5e7898d-caba-49d7-8310-630beb75bf21,network=Network(b496a106-2367-44dc-a788-bcd22ec98feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5e7898d-ca') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.objects.instance [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lazy-loading 'pci_devices' on Instance uuid 3da14c0a-31a8-4fe3-bd5a-49378680af50 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:31:14 user nova-compute[74189]:   <uuid>3da14c0a-31a8-4fe3-bd5a-49378680af50</uuid>
Oct 25 21:31:14 user nova-compute[74189]:   <name>instance-00000021</name>
Oct 25 21:31:14 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:31:14 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:31:14 user nova-compute[74189]:   <metadata>
Oct 25 21:31:14 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:31:14 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:31:14 user nova-compute[74189]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1418568783</nova:name>
Oct 25 21:31:14 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:31:14</nova:creationTime>
Oct 25 21:31:14 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:31:14 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:31:14 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:31:14 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:31:14 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:31:14 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:31:14 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:31:14 user nova-compute[74189]:       <nova:owner>
Oct 25 21:31:14 user nova-compute[74189]:         <nova:user uuid="155c948b95c64c9083da984cdf6af494">tempest-ServerRescueNegativeTestJSON-383982506-project-member</nova:user>
Oct 25 21:31:14 user nova-compute[74189]:         <nova:project uuid="3df03fc18fc3467db76e336c6de78c92">tempest-ServerRescueNegativeTestJSON-383982506</nova:project>
Oct 25 21:31:14 user nova-compute[74189]:       </nova:owner>
Oct 25 21:31:14 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:31:14 user nova-compute[74189]:       <nova:ports>
Oct 25 21:31:14 user nova-compute[74189]:         <nova:port uuid="a5e7898d-caba-49d7-8310-630beb75bf21">
Oct 25 21:31:14 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 25 21:31:14 user nova-compute[74189]:         </nova:port>
Oct 25 21:31:14 user nova-compute[74189]:       </nova:ports>
Oct 25 21:31:14 user nova-compute[74189]:     </nova:instance>
Oct 25 21:31:14 user nova-compute[74189]:   </metadata>
Oct 25 21:31:14 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:31:14 user nova-compute[74189]:     <system>
Oct 25 21:31:14 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:31:14 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:31:14 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:31:14 user nova-compute[74189]:       <entry name="serial">3da14c0a-31a8-4fe3-bd5a-49378680af50</entry>
Oct 25 21:31:14 user nova-compute[74189]:       <entry name="uuid">3da14c0a-31a8-4fe3-bd5a-49378680af50</entry>
Oct 25 21:31:14 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:31:14 user nova-compute[74189]:     </system>
Oct 25 21:31:14 user nova-compute[74189]:   </sysinfo>
Oct 25 21:31:14 user nova-compute[74189]:   <os>
Oct 25 21:31:14 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:31:14 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:31:14 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:31:14 user nova-compute[74189]:   </os>
Oct 25 21:31:14 user nova-compute[74189]:   <features>
Oct 25 21:31:14 user nova-compute[74189]:     <acpi/>
Oct 25 21:31:14 user nova-compute[74189]:     <apic/>
Oct 25 21:31:14 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:31:14 user nova-compute[74189]:   </features>
Oct 25 21:31:14 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:31:14 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:31:14 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:31:14 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:31:14 user nova-compute[74189]:   </clock>
Oct 25 21:31:14 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:31:14 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:31:14 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:31:14 user nova-compute[74189]:   </cpu>
Oct 25 21:31:14 user nova-compute[74189]:   <devices>
Oct 25 21:31:14 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:31:14 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:31:14 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk"/>
Oct 25 21:31:14 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:31:14 user nova-compute[74189]:     </disk>
Oct 25 21:31:14 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:31:14 user nova-compute[74189]:       <mac address="fa:16:3e:9d:7f:d0"/>
Oct 25 21:31:14 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:31:14 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:31:14 user nova-compute[74189]:       <target dev="tapa5e7898d-ca"/>
Oct 25 21:31:14 user nova-compute[74189]:     </interface>
Oct 25 21:31:14 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:31:14 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/console.log" append="off"/>
Oct 25 21:31:14 user nova-compute[74189]:     </serial>
Oct 25 21:31:14 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:31:14 user nova-compute[74189]:     <video>
Oct 25 21:31:14 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:31:14 user nova-compute[74189]:     </video>
Oct 25 21:31:14 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:31:14 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:31:14 user nova-compute[74189]:     </rng>
Oct 25 21:31:14 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:31:14 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:31:14 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:31:14 user nova-compute[74189]:     </memballoon>
Oct 25 21:31:14 user nova-compute[74189]:   </devices>
Oct 25 21:31:14 user nova-compute[74189]: </domain>
Oct 25 21:31:14 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:31:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1418568783',display_name='tempest-ServerRescueNegativeTestJSON-server-1418568783',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1418568783',id=33,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3df03fc18fc3467db76e336c6de78c92',ramdisk_id='',reservation_id='r-6kitp7g7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-383982506',owner_user_name='tempest-ServerRescueNegativeTestJSON-383982506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:31:13Z,user_data=None,user_id='155c948b95c64c9083da984cdf6af494',uuid=3da14c0a-31a8-4fe3-bd5a-49378680af50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5e7898d-caba-49d7-8310-630beb75bf21", "address": "fa:16:3e:9d:7f:d0", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5e7898d-ca", "ovs_interfaceid": "a5e7898d-caba-49d7-8310-630beb75bf21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Converting VIF {"id": "a5e7898d-caba-49d7-8310-630beb75bf21", "address": "fa:16:3e:9d:7f:d0", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5e7898d-ca", "ovs_interfaceid": "a5e7898d-caba-49d7-8310-630beb75bf21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:7f:d0,bridge_name='br-int',has_traffic_filtering=True,id=a5e7898d-caba-49d7-8310-630beb75bf21,network=Network(b496a106-2367-44dc-a788-bcd22ec98feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5e7898d-ca') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG os_vif [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:7f:d0,bridge_name='br-int',has_traffic_filtering=True,id=a5e7898d-caba-49d7-8310-630beb75bf21,network=Network(b496a106-2367-44dc-a788-bcd22ec98feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5e7898d-ca') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1a32ecbf-64c3-57ec-b4d5-9f6542a706b9', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-8d0c0bff-81ce-48f2-8299-f163fad99d13 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-8d0c0bff-81ce-48f2-8299-f163fad99d13 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5e7898d-ca, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa5e7898d-ca, col_values=(('qos', UUID('6280af72-9d23-4dbb-9e47-038df932cf2c')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa5e7898d-ca, col_values=(('external_ids', {'iface-id': 'a5e7898d-caba-49d7-8310-630beb75bf21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:7f:d0', 'vm-uuid': '3da14c0a-31a8-4fe3-bd5a-49378680af50'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.compute.manager [req-1b9fc491-0bd9-40dd-8489-c455379beef4 req-5ac7d0f5-9f52-4981-b90e-a55f74653475 service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Received event network-changed-a5e7898d-caba-49d7-8310-630beb75bf21 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.compute.manager [req-1b9fc491-0bd9-40dd-8489-c455379beef4 req-5ac7d0f5-9f52-4981-b90e-a55f74653475 service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Refreshing instance network info cache due to event network-changed-a5e7898d-caba-49d7-8310-630beb75bf21. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1b9fc491-0bd9-40dd-8489-c455379beef4 req-5ac7d0f5-9f52-4981-b90e-a55f74653475 service nova] Acquiring lock "refresh_cache-3da14c0a-31a8-4fe3-bd5a-49378680af50" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1b9fc491-0bd9-40dd-8489-c455379beef4 req-5ac7d0f5-9f52-4981-b90e-a55f74653475 service nova] Acquired lock "refresh_cache-3da14c0a-31a8-4fe3-bd5a-49378680af50" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.network.neutron [req-1b9fc491-0bd9-40dd-8489-c455379beef4 req-5ac7d0f5-9f52-4981-b90e-a55f74653475 service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Refreshing network info cache for port a5e7898d-caba-49d7-8310-630beb75bf21 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8d0c0bff-81ce-48f2-8299-f163fad99d13 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.525s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.608s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:14 user nova-compute[74189]: INFO os_vif [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:7f:d0,bridge_name='br-int',has_traffic_filtering=True,id=a5e7898d-caba-49d7-8310-630beb75bf21,network=Network(b496a106-2367-44dc-a788-bcd22ec98feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5e7898d-ca')
Oct 25 21:31:14 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-8d0c0bff-81ce-48f2-8299-f163fad99d13 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Deleted allocations for instance c5ba374a-821b-424c-aeaa-528a0164160e
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:31:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] No VIF found with MAC fa:16:3e:9d:7f:d0, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8d0c0bff-81ce-48f2-8299-f163fad99d13 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "c5ba374a-821b-424c-aeaa-528a0164160e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.667s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance d7c3a99a-ab38-4e88-896d-94ae51a09a48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance af1d7b3c-9950-4b74-8f15-b31011ccfa24 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance de6b6789-b328-4c3b-8d24-07774d5dbe6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 932fe8ac-fdde-45c6-aa32-9bf866f19a4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 0b4f80c4-98cc-440a-aac7-cd423b71a231 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 7eff6940-9675-4c89-bd28-378a5db4369f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance cdb13b8f-c136-4f2b-95b9-e464babac28a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 9a15fb16-8623-4a20-ae26-5f0aab29ec07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 9733d5c8-4476-4903-bd1b-16d43a54fdbd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance a57b1185-270e-40d0-a55e-986960826169 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (4eea19d7-3bab-440b-873e-a6e9c99ba7fc): {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3da14c0a-31a8-4fe3-bd5a-49378680af50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Acquiring lock "refresh_cache-d6e14e1a-6ef7-4a47-afc7-096326de8f5e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Acquired lock "refresh_cache-d6e14e1a-6ef7-4a47-afc7-096326de8f5e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.network.neutron [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.compute.manager [req-5ccb7d71-d07c-4879-be16-2f1358c48ed0 req-5827ae14-e2ba-448b-b45d-5c8bf28a524f service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Received event network-changed-1d25f7eb-3650-4049-a6b9-4fe9ff701593 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.compute.manager [req-5ccb7d71-d07c-4879-be16-2f1358c48ed0 req-5827ae14-e2ba-448b-b45d-5c8bf28a524f service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Refreshing instance network info cache due to event network-changed-1d25f7eb-3650-4049-a6b9-4fe9ff701593. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-5ccb7d71-d07c-4879-be16-2f1358c48ed0 req-5827ae14-e2ba-448b-b45d-5c8bf28a524f service nova] Acquiring lock "refresh_cache-d6e14e1a-6ef7-4a47-afc7-096326de8f5e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.network.neutron [req-1b9fc491-0bd9-40dd-8489-c455379beef4 req-5ac7d0f5-9f52-4981-b90e-a55f74653475 service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Updated VIF entry in instance network info cache for port a5e7898d-caba-49d7-8310-630beb75bf21. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.network.neutron [req-1b9fc491-0bd9-40dd-8489-c455379beef4 req-5ac7d0f5-9f52-4981-b90e-a55f74653475 service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Updating instance_info_cache with network_info: [{"id": "a5e7898d-caba-49d7-8310-630beb75bf21", "address": "fa:16:3e:9d:7f:d0", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5e7898d-ca", "ovs_interfaceid": "a5e7898d-caba-49d7-8310-630beb75bf21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1b9fc491-0bd9-40dd-8489-c455379beef4 req-5ac7d0f5-9f52-4981-b90e-a55f74653475 service nova] Releasing lock "refresh_cache-3da14c0a-31a8-4fe3-bd5a-49378680af50" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.650s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "a57b1185-270e-40d0-a55e-986960826169" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "a57b1185-270e-40d0-a55e-986960826169" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:15 user nova-compute[74189]: INFO nova.compute.manager [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Detaching volume 2bcb1620-6d87-4ef3-9136-841c00fbe245
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.network.neutron [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Updating instance_info_cache with network_info: [{"id": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "address": "fa:16:3e:58:36:23", "network": {"id": "1fce8fb6-f20e-4de3-80ec-3d74154c0e23", "bridge": "br-int", "label": "tempest-TestShelveInstance-1146708282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef48aafc7b54ce5aeda52b0b52f2714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d25f7eb-36", "ovs_interfaceid": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:31:15 user nova-compute[74189]: INFO nova.virt.block_device [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Attempting to driver detach volume 2bcb1620-6d87-4ef3-9136-841c00fbe245 from mountpoint /dev/vdc
Oct 25 21:31:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Releasing lock "refresh_cache-d6e14e1a-6ef7-4a47-afc7-096326de8f5e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:31:15 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Creating image(s)
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Did not create local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Ensure instance console log exists: /opt/stack/data/nova/instances/d6e14e1a-6ef7-4a47-afc7-096326de8f5e/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Start _get_guest_xml network_info=[{"id": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "address": "fa:16:3e:58:36:23", "network": {"id": "1fce8fb6-f20e-4de3-80ec-3d74154c0e23", "bridge": "br-int", "label": "tempest-TestShelveInstance-1146708282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef48aafc7b54ce5aeda52b0b52f2714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d25f7eb-36", "ovs_interfaceid": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bBkaEFvy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd6e14e1a-6ef7-4a47-afc7-096326de8f5e', 'attached_at': '', 'detached_at': '', 'volume_id': 'e76a8bc1-8695-4085-874e-c1575956d75e', 'serial': 'e76a8bc1-8695-4085-874e-c1575956d75e'}, 'attachment_id': 'a47f7594-4ffc-4ee8-93f7-5234b9b63c9f', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-5ccb7d71-d07c-4879-be16-2f1358c48ed0 req-5827ae14-e2ba-448b-b45d-5c8bf28a524f service nova] Acquired lock "refresh_cache-d6e14e1a-6ef7-4a47-afc7-096326de8f5e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.network.neutron [req-5ccb7d71-d07c-4879-be16-2f1358c48ed0 req-5827ae14-e2ba-448b-b45d-5c8bf28a524f service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Refreshing network info cache for port 1d25f7eb-3650-4049-a6b9-4fe9ff701593 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:31:15 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:31:15 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Attempting to detach device vdc from instance a57b1185-270e-40d0-a55e-986960826169 from the persistent domain config. {{(pid=74189) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:31:15 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:31:15 user nova-compute[74189]:   <source dev="/dev/sdh"/>
Oct 25 21:31:15 user nova-compute[74189]:   <target dev="vdc" bus="virtio"/>
Oct 25 21:31:15 user nova-compute[74189]:   <serial>2bcb1620-6d87-4ef3-9136-841c00fbe245</serial>
Oct 25 21:31:15 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 21:31:15 user nova-compute[74189]: </disk>
Oct 25 21:31:15 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.objects.instance [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lazy-loading 'vcpu_model' on Instance uuid d6e14e1a-6ef7-4a47-afc7-096326de8f5e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:31:15 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Successfully detached device vdc from instance a57b1185-270e-40d0-a55e-986960826169 from the persistent domain config.
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a57b1185-270e-40d0-a55e-986960826169 from the live domain config. {{(pid=74189) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:31:15 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:31:15 user nova-compute[74189]:   <source dev="/dev/sdh"/>
Oct 25 21:31:15 user nova-compute[74189]:   <target dev="vdc" bus="virtio"/>
Oct 25 21:31:15 user nova-compute[74189]:   <serial>2bcb1620-6d87-4ef3-9136-841c00fbe245</serial>
Oct 25 21:31:15 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 21:31:15 user nova-compute[74189]: </disk>
Oct 25 21:31:15 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.objects.base [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Object Instance<d6e14e1a-6ef7-4a47-afc7-096326de8f5e> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bBkaEFvy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:31:15 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:31:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:31:15 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:31:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:31:15 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:31:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[086c4f7b-b5f0-497d-b9e9-6dac4d45710b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:31:15 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9534d4f8-7a3e-4fcf-92e4-197b6b871b5a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e] added
Oct 25 21:31:15 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9750f2-cb08-4b21-89a1-dad6c306cf05]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6545d5c6-9e15-430e-b071-118353d93c28]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bBkaEFvy {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bBkaEFvy" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a46e584-f04f-4e29-b38f-ee77d10831c4]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bBkaEFvy'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:31:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f40189-6069-44fc-83f0-cf60be2a6747]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2415994-94c6-493a-945e-00502b5ccf6c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:31:16 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:31:16 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:31:16 user nova-compute[74189]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:31:16 user nova-compute[74189]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 (non-flash)
Oct 25 21:31:16 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:31:16 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:31:16 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:31:16 user nova-compute[74189]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:31:16 user nova-compute[74189]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 (non-flash)
Oct 25 21:31:16 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f1bb5d-d87f-4840-89d7-50bcadbae87a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e, portal: 172.16.0.220,3260]
Oct 25 21:31:16 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e, portal: 172.16.0.220,3260] successful.
Oct 25 21:31:16 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.053s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9d1ad6-1925-4d24-a335-db336140fc90]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[81250466-1e1f-495a-87de-5c16ad051342]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:31:16 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:31:16 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:31:16 user nova-compute[74189]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:31:16 user nova-compute[74189]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 (non-flash)
Oct 25 21:31:16 user nova-compute[74189]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:31:16 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:31:16 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:31:16 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:31:16 user nova-compute[74189]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:31:16 user nova-compute[74189]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 (non-flash)
Oct 25 21:31:16 user nova-compute[74189]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:31:16 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fbf166-c44b-4557-9c4b-e0a6beb82b32]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bBkaEFvy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG nova.network.neutron [req-5ccb7d71-d07c-4879-be16-2f1358c48ed0 req-5827ae14-e2ba-448b-b45d-5c8bf28a524f service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Updated VIF entry in instance network info cache for port 1d25f7eb-3650-4049-a6b9-4fe9ff701593. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG nova.network.neutron [req-5ccb7d71-d07c-4879-be16-2f1358c48ed0 req-5827ae14-e2ba-448b-b45d-5c8bf28a524f service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Updating instance_info_cache with network_info: [{"id": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "address": "fa:16:3e:58:36:23", "network": {"id": "1fce8fb6-f20e-4de3-80ec-3d74154c0e23", "bridge": "br-int", "label": "tempest-TestShelveInstance-1146708282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef48aafc7b54ce5aeda52b0b52f2714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d25f7eb-36", "ovs_interfaceid": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-5ccb7d71-d07c-4879-be16-2f1358c48ed0 req-5827ae14-e2ba-448b-b45d-5c8bf28a524f service nova] Releasing lock "refresh_cache-d6e14e1a-6ef7-4a47-afc7-096326de8f5e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a57b1185-270e-40d0-a55e-986960826169 {{(pid=74189) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23839613763323633', 'path': '/dev/sdc'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839613763323633', 'path': '/dev/sdc'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T21:26:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1213251010',display_name='tempest-TestShelveInstance-server-1213251010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1213251010',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-290074196',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:27:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9ef48aafc7b54ce5aeda52b0b52f2714',ramdisk_id='',reservation_id='r-fduvh40c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-715930903',owner_user_name='tempest-TestShelveInstance-715930903-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:30:42Z,user_data=None,user_id='0a958107c53f4eeb832f6040969c8a24',uuid=d6e14e1a-6ef7-4a47-afc7-096326de8f5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "address": "fa:16:3e:58:36:23", "network": {"id": "1fce8fb6-f20e-4de3-80ec-3d74154c0e23", "bridge": "br-int", "label": "tempest-TestShelveInstance-1146708282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef48aafc7b54ce5aeda52b0b52f2714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d25f7eb-36", "ovs_interfaceid": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Converting VIF {"id": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "address": "fa:16:3e:58:36:23", "network": {"id": "1fce8fb6-f20e-4de3-80ec-3d74154c0e23", "bridge": "br-int", "label": "tempest-TestShelveInstance-1146708282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef48aafc7b54ce5aeda52b0b52f2714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d25f7eb-36", "ovs_interfaceid": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:36:23,bridge_name='br-int',has_traffic_filtering=True,id=1d25f7eb-3650-4049-a6b9-4fe9ff701593,network=Network(1fce8fb6-f20e-4de3-80ec-3d74154c0e23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d25f7eb-36') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG nova.objects.instance [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lazy-loading 'pci_devices' on Instance uuid d6e14e1a-6ef7-4a47-afc7-096326de8f5e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG nova.objects.base [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Object Instance<d6e14e1a-6ef7-4a47-afc7-096326de8f5e> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:31:17 user nova-compute[74189]:   <uuid>d6e14e1a-6ef7-4a47-afc7-096326de8f5e</uuid>
Oct 25 21:31:17 user nova-compute[74189]:   <name>instance-0000001b</name>
Oct 25 21:31:17 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:31:17 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:31:17 user nova-compute[74189]:   <metadata>
Oct 25 21:31:17 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:31:17 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:31:17 user nova-compute[74189]:       <nova:name>tempest-TestShelveInstance-server-1213251010</nova:name>
Oct 25 21:31:17 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:31:15</nova:creationTime>
Oct 25 21:31:17 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:31:17 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:31:17 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:31:17 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:31:17 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:31:17 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:31:17 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:31:17 user nova-compute[74189]:       <nova:owner>
Oct 25 21:31:17 user nova-compute[74189]:         <nova:user uuid="0a958107c53f4eeb832f6040969c8a24">tempest-TestShelveInstance-715930903-project-member</nova:user>
Oct 25 21:31:17 user nova-compute[74189]:         <nova:project uuid="9ef48aafc7b54ce5aeda52b0b52f2714">tempest-TestShelveInstance-715930903</nova:project>
Oct 25 21:31:17 user nova-compute[74189]:       </nova:owner>
Oct 25 21:31:17 user nova-compute[74189]:       <nova:ports>
Oct 25 21:31:17 user nova-compute[74189]:         <nova:port uuid="1d25f7eb-3650-4049-a6b9-4fe9ff701593">
Oct 25 21:31:17 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 25 21:31:17 user nova-compute[74189]:         </nova:port>
Oct 25 21:31:17 user nova-compute[74189]:       </nova:ports>
Oct 25 21:31:17 user nova-compute[74189]:     </nova:instance>
Oct 25 21:31:17 user nova-compute[74189]:   </metadata>
Oct 25 21:31:17 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:31:17 user nova-compute[74189]:     <system>
Oct 25 21:31:17 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:31:17 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:31:17 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:31:17 user nova-compute[74189]:       <entry name="serial">d6e14e1a-6ef7-4a47-afc7-096326de8f5e</entry>
Oct 25 21:31:17 user nova-compute[74189]:       <entry name="uuid">d6e14e1a-6ef7-4a47-afc7-096326de8f5e</entry>
Oct 25 21:31:17 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:31:17 user nova-compute[74189]:     </system>
Oct 25 21:31:17 user nova-compute[74189]:   </sysinfo>
Oct 25 21:31:17 user nova-compute[74189]:   <os>
Oct 25 21:31:17 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:31:17 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:31:17 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:31:17 user nova-compute[74189]:   </os>
Oct 25 21:31:17 user nova-compute[74189]:   <features>
Oct 25 21:31:17 user nova-compute[74189]:     <acpi/>
Oct 25 21:31:17 user nova-compute[74189]:     <apic/>
Oct 25 21:31:17 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:31:17 user nova-compute[74189]:   </features>
Oct 25 21:31:17 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:31:17 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:31:17 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:31:17 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:31:17 user nova-compute[74189]:   </clock>
Oct 25 21:31:17 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:31:17 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:31:17 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:31:17 user nova-compute[74189]:   </cpu>
Oct 25 21:31:17 user nova-compute[74189]:   <devices>
Oct 25 21:31:17 user nova-compute[74189]:     <disk type="block" device="disk">
Oct 25 21:31:17 user nova-compute[74189]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:31:17 user nova-compute[74189]:       <source dev="/dev/sdc"/>
Oct 25 21:31:17 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:31:17 user nova-compute[74189]:       <serial>e76a8bc1-8695-4085-874e-c1575956d75e</serial>
Oct 25 21:31:17 user nova-compute[74189]:     </disk>
Oct 25 21:31:17 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:31:17 user nova-compute[74189]:       <mac address="fa:16:3e:58:36:23"/>
Oct 25 21:31:17 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:31:17 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:31:17 user nova-compute[74189]:       <target dev="tap1d25f7eb-36"/>
Oct 25 21:31:17 user nova-compute[74189]:     </interface>
Oct 25 21:31:17 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:31:17 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/d6e14e1a-6ef7-4a47-afc7-096326de8f5e/console.log" append="off"/>
Oct 25 21:31:17 user nova-compute[74189]:     </serial>
Oct 25 21:31:17 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:31:17 user nova-compute[74189]:     <video>
Oct 25 21:31:17 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:31:17 user nova-compute[74189]:     </video>
Oct 25 21:31:17 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:31:17 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:31:17 user nova-compute[74189]:     </rng>
Oct 25 21:31:17 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:31:17 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:31:17 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:31:17 user nova-compute[74189]:     </memballoon>
Oct 25 21:31:17 user nova-compute[74189]:   </devices>
Oct 25 21:31:17 user nova-compute[74189]: </domain>
Oct 25 21:31:17 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T21:26:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1213251010',display_name='tempest-TestShelveInstance-server-1213251010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1213251010',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-290074196',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:27:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9ef48aafc7b54ce5aeda52b0b52f2714',ramdisk_id='',reservation_id='r-fduvh40c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-715930903',owner_user_name='tempest-TestShelveInstance-715930903-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:30:42Z,user_data=None,user_id='0a958107c53f4eeb832f6040969c8a24',uuid=d6e14e1a-6ef7-4a47-afc7-096326de8f5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "address": "fa:16:3e:58:36:23", "network": {"id": "1fce8fb6-f20e-4de3-80ec-3d74154c0e23", "bridge": "br-int", "label": "tempest-TestShelveInstance-1146708282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef48aafc7b54ce5aeda52b0b52f2714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d25f7eb-36", "ovs_interfaceid": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Converting VIF {"id": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "address": "fa:16:3e:58:36:23", "network": {"id": "1fce8fb6-f20e-4de3-80ec-3d74154c0e23", "bridge": "br-int", "label": "tempest-TestShelveInstance-1146708282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef48aafc7b54ce5aeda52b0b52f2714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d25f7eb-36", "ovs_interfaceid": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:36:23,bridge_name='br-int',has_traffic_filtering=True,id=1d25f7eb-3650-4049-a6b9-4fe9ff701593,network=Network(1fce8fb6-f20e-4de3-80ec-3d74154c0e23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d25f7eb-36') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG os_vif [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:36:23,bridge_name='br-int',has_traffic_filtering=True,id=1d25f7eb-3650-4049-a6b9-4fe9ff701593,network=Network(1fce8fb6-f20e-4de3-80ec-3d74154c0e23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d25f7eb-36') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15cdcb3c-3c7b-5d08-9b36-ca58a448e49f', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d25f7eb-36, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d25f7eb-36, col_values=(('qos', UUID('776798df-139f-4225-9147-8f0045eb4800')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d25f7eb-36, col_values=(('external_ids', {'iface-id': '1d25f7eb-3650-4049-a6b9-4fe9ff701593', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:36:23', 'vm-uuid': 'd6e14e1a-6ef7-4a47-afc7-096326de8f5e'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:17 user nova-compute[74189]: INFO os_vif [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:36:23,bridge_name='br-int',has_traffic_filtering=True,id=1d25f7eb-3650-4049-a6b9-4fe9ff701593,network=Network(1fce8fb6-f20e-4de3-80ec-3d74154c0e23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d25f7eb-36')
Oct 25 21:31:17 user nova-compute[74189]: DEBUG nova.compute.manager [req-2e31b56e-fc08-4bc9-8be4-1a321d20891d req-1dd45cbe-a20f-4086-8d24-f538c29d531d service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Received event network-vif-plugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2e31b56e-fc08-4bc9-8be4-1a321d20891d req-1dd45cbe-a20f-4086-8d24-f538c29d531d service nova] Acquiring lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2e31b56e-fc08-4bc9-8be4-1a321d20891d req-1dd45cbe-a20f-4086-8d24-f538c29d531d service nova] Lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2e31b56e-fc08-4bc9-8be4-1a321d20891d req-1dd45cbe-a20f-4086-8d24-f538c29d531d service nova] Lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG nova.compute.manager [req-2e31b56e-fc08-4bc9-8be4-1a321d20891d req-1dd45cbe-a20f-4086-8d24-f538c29d531d service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] No waiting events found dispatching network-vif-plugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:31:17 user nova-compute[74189]: WARNING nova.compute.manager [req-2e31b56e-fc08-4bc9-8be4-1a321d20891d req-1dd45cbe-a20f-4086-8d24-f538c29d531d service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Received unexpected event network-vif-plugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf for instance with vm_state building and task_state spawning.
Oct 25 21:31:17 user nova-compute[74189]: DEBUG nova.compute.manager [req-2e31b56e-fc08-4bc9-8be4-1a321d20891d req-1dd45cbe-a20f-4086-8d24-f538c29d531d service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Received event network-vif-plugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2e31b56e-fc08-4bc9-8be4-1a321d20891d req-1dd45cbe-a20f-4086-8d24-f538c29d531d service nova] Acquiring lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2e31b56e-fc08-4bc9-8be4-1a321d20891d req-1dd45cbe-a20f-4086-8d24-f538c29d531d service nova] Lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2e31b56e-fc08-4bc9-8be4-1a321d20891d req-1dd45cbe-a20f-4086-8d24-f538c29d531d service nova] Lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG nova.compute.manager [req-2e31b56e-fc08-4bc9-8be4-1a321d20891d req-1dd45cbe-a20f-4086-8d24-f538c29d531d service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] No waiting events found dispatching network-vif-plugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:31:17 user nova-compute[74189]: WARNING nova.compute.manager [req-2e31b56e-fc08-4bc9-8be4-1a321d20891d req-1dd45cbe-a20f-4086-8d24-f538c29d531d service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Received unexpected event network-vif-plugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf for instance with vm_state building and task_state spawning.
Oct 25 21:31:17 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:31:17 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] No VIF found with MAC fa:16:3e:58:36:23, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:31:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:18 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:31:18 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:31:18 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Cleaning up deleted instances {{(pid=74189) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 21:31:18 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] There are 0 instances to clean {{(pid=74189) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 21:31:18 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:31:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:19 user nova-compute[74189]: DEBUG nova.compute.manager [req-ed49ceb3-5907-4d4b-a37d-57e56c651cbc req-b26d5b5b-f9b8-46ac-9964-2444726a5ff5 service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Received event network-vif-plugged-1d25f7eb-3650-4049-a6b9-4fe9ff701593 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:31:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ed49ceb3-5907-4d4b-a37d-57e56c651cbc req-b26d5b5b-f9b8-46ac-9964-2444726a5ff5 service nova] Acquiring lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ed49ceb3-5907-4d4b-a37d-57e56c651cbc req-b26d5b5b-f9b8-46ac-9964-2444726a5ff5 service nova] Lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ed49ceb3-5907-4d4b-a37d-57e56c651cbc req-b26d5b5b-f9b8-46ac-9964-2444726a5ff5 service nova] Lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:19 user nova-compute[74189]: DEBUG nova.compute.manager [req-ed49ceb3-5907-4d4b-a37d-57e56c651cbc req-b26d5b5b-f9b8-46ac-9964-2444726a5ff5 service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] No waiting events found dispatching network-vif-plugged-1d25f7eb-3650-4049-a6b9-4fe9ff701593 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:31:19 user nova-compute[74189]: WARNING nova.compute.manager [req-ed49ceb3-5907-4d4b-a37d-57e56c651cbc req-b26d5b5b-f9b8-46ac-9964-2444726a5ff5 service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Received unexpected event network-vif-plugged-1d25f7eb-3650-4049-a6b9-4fe9ff701593 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 25 21:31:19 user nova-compute[74189]: DEBUG nova.compute.manager [req-4fa08551-22a8-4c9d-b222-ae35ddec0347 req-72d644ba-61a5-4a0f-8c35-867aeb52d1f0 service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Received event network-vif-plugged-a5e7898d-caba-49d7-8310-630beb75bf21 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:31:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4fa08551-22a8-4c9d-b222-ae35ddec0347 req-72d644ba-61a5-4a0f-8c35-867aeb52d1f0 service nova] Acquiring lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4fa08551-22a8-4c9d-b222-ae35ddec0347 req-72d644ba-61a5-4a0f-8c35-867aeb52d1f0 service nova] Lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4fa08551-22a8-4c9d-b222-ae35ddec0347 req-72d644ba-61a5-4a0f-8c35-867aeb52d1f0 service nova] Lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:19 user nova-compute[74189]: DEBUG nova.compute.manager [req-4fa08551-22a8-4c9d-b222-ae35ddec0347 req-72d644ba-61a5-4a0f-8c35-867aeb52d1f0 service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] No waiting events found dispatching network-vif-plugged-a5e7898d-caba-49d7-8310-630beb75bf21 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:31:19 user nova-compute[74189]: WARNING nova.compute.manager [req-4fa08551-22a8-4c9d-b222-ae35ddec0347 req-72d644ba-61a5-4a0f-8c35-867aeb52d1f0 service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Received unexpected event network-vif-plugged-a5e7898d-caba-49d7-8310-630beb75bf21 for instance with vm_state building and task_state spawning.
Oct 25 21:31:19 user nova-compute[74189]: DEBUG nova.compute.manager [req-4fa08551-22a8-4c9d-b222-ae35ddec0347 req-72d644ba-61a5-4a0f-8c35-867aeb52d1f0 service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Received event network-vif-plugged-a5e7898d-caba-49d7-8310-630beb75bf21 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:31:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4fa08551-22a8-4c9d-b222-ae35ddec0347 req-72d644ba-61a5-4a0f-8c35-867aeb52d1f0 service nova] Acquiring lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4fa08551-22a8-4c9d-b222-ae35ddec0347 req-72d644ba-61a5-4a0f-8c35-867aeb52d1f0 service nova] Lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4fa08551-22a8-4c9d-b222-ae35ddec0347 req-72d644ba-61a5-4a0f-8c35-867aeb52d1f0 service nova] Lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:19 user nova-compute[74189]: DEBUG nova.compute.manager [req-4fa08551-22a8-4c9d-b222-ae35ddec0347 req-72d644ba-61a5-4a0f-8c35-867aeb52d1f0 service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] No waiting events found dispatching network-vif-plugged-a5e7898d-caba-49d7-8310-630beb75bf21 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:31:19 user nova-compute[74189]: WARNING nova.compute.manager [req-4fa08551-22a8-4c9d-b222-ae35ddec0347 req-72d644ba-61a5-4a0f-8c35-867aeb52d1f0 service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Received unexpected event network-vif-plugged-a5e7898d-caba-49d7-8310-630beb75bf21 for instance with vm_state building and task_state spawning.
Oct 25 21:31:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:21 user nova-compute[74189]: DEBUG nova.compute.manager [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:31:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:31:21 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Instance spawned successfully.
Oct 25 21:31:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:31:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:31:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:31:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:31:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:31:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:31:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:31:21 user nova-compute[74189]: INFO nova.compute.manager [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Took 9.10 seconds to spawn the instance on the hypervisor.
Oct 25 21:31:21 user nova-compute[74189]: DEBUG nova.compute.manager [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:31:21 user nova-compute[74189]: INFO nova.compute.manager [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Took 10.43 seconds to build instance.
Oct 25 21:31:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ea78dc8f-75c2-4491-b496-a5359ab7104b tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.544s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:21 user nova-compute[74189]: DEBUG nova.compute.manager [req-253c3bc4-8585-49cf-9543-4bf018fa9ea8 req-8c2a1738-893e-4cfa-96be-124cb9316699 service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Received event network-vif-plugged-1d25f7eb-3650-4049-a6b9-4fe9ff701593 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:31:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-253c3bc4-8585-49cf-9543-4bf018fa9ea8 req-8c2a1738-893e-4cfa-96be-124cb9316699 service nova] Acquiring lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-253c3bc4-8585-49cf-9543-4bf018fa9ea8 req-8c2a1738-893e-4cfa-96be-124cb9316699 service nova] Lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-253c3bc4-8585-49cf-9543-4bf018fa9ea8 req-8c2a1738-893e-4cfa-96be-124cb9316699 service nova] Lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:21 user nova-compute[74189]: DEBUG nova.compute.manager [req-253c3bc4-8585-49cf-9543-4bf018fa9ea8 req-8c2a1738-893e-4cfa-96be-124cb9316699 service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] No waiting events found dispatching network-vif-plugged-1d25f7eb-3650-4049-a6b9-4fe9ff701593 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:31:21 user nova-compute[74189]: WARNING nova.compute.manager [req-253c3bc4-8585-49cf-9543-4bf018fa9ea8 req-8c2a1738-893e-4cfa-96be-124cb9316699 service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Received unexpected event network-vif-plugged-1d25f7eb-3650-4049-a6b9-4fe9ff701593 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 25 21:31:21 user nova-compute[74189]: DEBUG nova.compute.manager [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:31:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:31:21 user nova-compute[74189]: DEBUG nova.compute.manager [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:31:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:31:21 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Instance spawned successfully.
Oct 25 21:31:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:31:21 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Instance spawned successfully.
Oct 25 21:31:21 user nova-compute[74189]: DEBUG nova.compute.manager [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:31:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:31:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:31:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:31:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:31:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:31:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:31:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-86b04ae3-0561-4cdf-a505-7df483da1854 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 40.241s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:21 user nova-compute[74189]: INFO nova.compute.manager [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Took 8.59 seconds to spawn the instance on the hypervisor.
Oct 25 21:31:21 user nova-compute[74189]: DEBUG nova.compute.manager [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:31:21 user nova-compute[74189]: INFO nova.compute.manager [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Took 10.11 seconds to build instance.
Oct 25 21:31:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3f961e66-fc2f-4bcd-9db8-30745bfe7c3a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "3da14c0a-31a8-4fe3-bd5a-49378680af50" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.269s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:34 user nova-compute[74189]: DEBUG nova.compute.manager [req-96a52885-7eb8-4942-b32d-cb9d69c58b4b req-cf4467ae-e0c4-43fd-aa9d-38d916232014 service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Received event network-changed-6a146bba-178b-4b17-be10-0410392d8b06 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:31:34 user nova-compute[74189]: DEBUG nova.compute.manager [req-96a52885-7eb8-4942-b32d-cb9d69c58b4b req-cf4467ae-e0c4-43fd-aa9d-38d916232014 service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Refreshing instance network info cache due to event network-changed-6a146bba-178b-4b17-be10-0410392d8b06. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:31:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-96a52885-7eb8-4942-b32d-cb9d69c58b4b req-cf4467ae-e0c4-43fd-aa9d-38d916232014 service nova] Acquiring lock "refresh_cache-cdb13b8f-c136-4f2b-95b9-e464babac28a" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:31:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-96a52885-7eb8-4942-b32d-cb9d69c58b4b req-cf4467ae-e0c4-43fd-aa9d-38d916232014 service nova] Acquired lock "refresh_cache-cdb13b8f-c136-4f2b-95b9-e464babac28a" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:31:34 user nova-compute[74189]: DEBUG nova.network.neutron [req-96a52885-7eb8-4942-b32d-cb9d69c58b4b req-cf4467ae-e0c4-43fd-aa9d-38d916232014 service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Refreshing network info cache for port 6a146bba-178b-4b17-be10-0410392d8b06 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:31:35 user nova-compute[74189]: DEBUG nova.network.neutron [req-96a52885-7eb8-4942-b32d-cb9d69c58b4b req-cf4467ae-e0c4-43fd-aa9d-38d916232014 service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Updated VIF entry in instance network info cache for port 6a146bba-178b-4b17-be10-0410392d8b06. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:31:35 user nova-compute[74189]: DEBUG nova.network.neutron [req-96a52885-7eb8-4942-b32d-cb9d69c58b4b req-cf4467ae-e0c4-43fd-aa9d-38d916232014 service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Updating instance_info_cache with network_info: [{"id": "6a146bba-178b-4b17-be10-0410392d8b06", "address": "fa:16:3e:7f:d7:49", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a146bba-17", "ovs_interfaceid": "6a146bba-178b-4b17-be10-0410392d8b06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:31:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-96a52885-7eb8-4942-b32d-cb9d69c58b4b req-cf4467ae-e0c4-43fd-aa9d-38d916232014 service nova] Releasing lock "refresh_cache-cdb13b8f-c136-4f2b-95b9-e464babac28a" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:31:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-0b1eaa25-bd1e-43a9-806a-c932c20faca4 req-e8c13893-87cd-43fe-935e-01279251ce1d service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Received event network-changed-6a146bba-178b-4b17-be10-0410392d8b06 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:31:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-0b1eaa25-bd1e-43a9-806a-c932c20faca4 req-e8c13893-87cd-43fe-935e-01279251ce1d service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Refreshing instance network info cache due to event network-changed-6a146bba-178b-4b17-be10-0410392d8b06. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:31:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0b1eaa25-bd1e-43a9-806a-c932c20faca4 req-e8c13893-87cd-43fe-935e-01279251ce1d service nova] Acquiring lock "refresh_cache-cdb13b8f-c136-4f2b-95b9-e464babac28a" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:31:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0b1eaa25-bd1e-43a9-806a-c932c20faca4 req-e8c13893-87cd-43fe-935e-01279251ce1d service nova] Acquired lock "refresh_cache-cdb13b8f-c136-4f2b-95b9-e464babac28a" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:31:35 user nova-compute[74189]: DEBUG nova.network.neutron [req-0b1eaa25-bd1e-43a9-806a-c932c20faca4 req-e8c13893-87cd-43fe-935e-01279251ce1d service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Refreshing network info cache for port 6a146bba-178b-4b17-be10-0410392d8b06 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:31:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "cdb13b8f-c136-4f2b-95b9-e464babac28a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "cdb13b8f-c136-4f2b-95b9-e464babac28a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:35 user nova-compute[74189]: INFO nova.compute.manager [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Detaching volume 0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e
Oct 25 21:31:35 user nova-compute[74189]: INFO nova.virt.block_device [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Attempting to driver detach volume 0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e from mountpoint /dev/vdb
Oct 25 21:31:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Attempting to detach device vdb from instance cdb13b8f-c136-4f2b-95b9-e464babac28a from the persistent domain config. {{(pid=74189) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 21:31:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:31:35 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:31:35 user nova-compute[74189]:   <source dev="/dev/sdf"/>
Oct 25 21:31:35 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:31:35 user nova-compute[74189]:   <serial>0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e</serial>
Oct 25 21:31:35 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 21:31:35 user nova-compute[74189]: </disk>
Oct 25 21:31:35 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:31:35 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Successfully detached device vdb from instance cdb13b8f-c136-4f2b-95b9-e464babac28a from the persistent domain config.
Oct 25 21:31:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cdb13b8f-c136-4f2b-95b9-e464babac28a from the live domain config. {{(pid=74189) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 21:31:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:31:35 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:31:35 user nova-compute[74189]:   <source dev="/dev/sdf"/>
Oct 25 21:31:35 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:31:35 user nova-compute[74189]:   <serial>0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e</serial>
Oct 25 21:31:35 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 21:31:35 user nova-compute[74189]: </disk>
Oct 25 21:31:35 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:31:35 user nova-compute[74189]: DEBUG nova.network.neutron [req-0b1eaa25-bd1e-43a9-806a-c932c20faca4 req-e8c13893-87cd-43fe-935e-01279251ce1d service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Updated VIF entry in instance network info cache for port 6a146bba-178b-4b17-be10-0410392d8b06. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG nova.network.neutron [req-0b1eaa25-bd1e-43a9-806a-c932c20faca4 req-e8c13893-87cd-43fe-935e-01279251ce1d service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Updating instance_info_cache with network_info: [{"id": "6a146bba-178b-4b17-be10-0410392d8b06", "address": "fa:16:3e:7f:d7:49", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a146bba-17", "ovs_interfaceid": "6a146bba-178b-4b17-be10-0410392d8b06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0b1eaa25-bd1e-43a9-806a-c932c20faca4 req-e8c13893-87cd-43fe-935e-01279251ce1d service nova] Releasing lock "refresh_cache-cdb13b8f-c136-4f2b-95b9-e464babac28a" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cdb13b8f-c136-4f2b-95b9-e464babac28a {{(pid=74189) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 21:31:36 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance a57b1185-270e-40d0-a55e-986960826169 is timed out.
Oct 25 21:31:36 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Successfully detached device vdc from instance a57b1185-270e-40d0-a55e-986960826169 from the live domain config.
Oct 25 21:31:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GkbwPTQd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:31:36 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:31:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dad349-1711-445a-a3cb-4905dddbad87]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:31:36 user nova-compute[74189]: No targets found.
Oct 25 21:31:36 user nova-compute[74189]: iSNS:
Oct 25 21:31:36 user nova-compute[74189]: No targets found.
Oct 25 21:31:36 user nova-compute[74189]: STATIC:
Oct 25 21:31:36 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce
Oct 25 21:31:36 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:31:36 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:31:36 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d
Oct 25 21:31:36 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:31:36 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:31:36 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245
Oct 25 21:31:36 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:31:36 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:31:36 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e
Oct 25 21:31:36 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:31:36 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:31:36 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e
Oct 25 21:31:36 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:31:36 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:31:36 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:31:36 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:31:36 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:31:36 user nova-compute[74189]: FIRMWARE:
Oct 25 21:31:36 user nova-compute[74189]: No targets found.
Oct 25 21:31:36 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:31:36 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:31:36 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3105bb86-a769-497c-ab4c-ba224437dd85]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[06dae6bf-c9cc-4ad2-8431-c02651feee3a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:31:36 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:31:36 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:31:36 user nova-compute[74189]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:31:36 user nova-compute[74189]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 (non-flash)
Oct 25 21:31:36 user nova-compute[74189]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:31:36 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:31:36 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:31:36 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:31:36 user nova-compute[74189]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:31:36 user nova-compute[74189]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 (non-flash)
Oct 25 21:31:36 user nova-compute[74189]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:31:36 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2e42be440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245'): ({'sdh'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Removing single pathed devices sdh {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5265676a-5709-4b0f-9992-324dcf721d04]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[335acfd0-dcb8-4dbf-8d02-aac042e9c396]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Flushing IO for device /dev/sdh {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8f471f-5231-457c-8bbf-ac78b7ab0840]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.041s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fce74a5-6908-4809-9fd7-11116a55f492]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] SCSI volumes sdh have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9364734-a947-4763-a175-e99546d425fd]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ada950-5b44-4a4a-a89d-fd3f8e41e48b]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245, portal: 172.16.0.220,3260]
Oct 25 21:31:36 user nova-compute[74189]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245, portal: 172.16.0.220,3260] successful.
Oct 25 21:31:36 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bcb1620-6d87-4ef3-9136-841c00fbe245 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb429803-e3f8-4880-83a4-befe723bc325]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] <== disconnect_volume: return (315ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:31:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:31:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-306422e8-5077-4a00-b81e-c0c030bacfa1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "7eff6940-9675-4c89-bd28-378a5db4369f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-306422e8-5077-4a00-b81e-c0c030bacfa1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "7eff6940-9675-4c89-bd28-378a5db4369f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-306422e8-5077-4a00-b81e-c0c030bacfa1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "7eff6940-9675-4c89-bd28-378a5db4369f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-306422e8-5077-4a00-b81e-c0c030bacfa1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "7eff6940-9675-4c89-bd28-378a5db4369f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-306422e8-5077-4a00-b81e-c0c030bacfa1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "7eff6940-9675-4c89-bd28-378a5db4369f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:37 user nova-compute[74189]: INFO nova.compute.manager [None req-306422e8-5077-4a00-b81e-c0c030bacfa1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Terminating instance
Oct 25 21:31:37 user nova-compute[74189]: DEBUG nova.compute.manager [None req-306422e8-5077-4a00-b81e-c0c030bacfa1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:31:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:37 user nova-compute[74189]: DEBUG nova.objects.instance [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lazy-loading 'flavor' on Instance uuid a57b1185-270e-40d0-a55e-986960826169 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:31:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3d4ba63f-7d50-4c60-918a-284606cf9231 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "a57b1185-270e-40d0-a55e-986960826169" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.116s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:37 user nova-compute[74189]: DEBUG nova.compute.manager [req-56eb44af-0c52-47f0-a6e8-a3d063c74724 req-25227f41-7764-4499-8f08-78b688e985e4 service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Received event network-vif-unplugged-b05a2001-02cd-45af-9242-3d6246edcd0b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:31:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-56eb44af-0c52-47f0-a6e8-a3d063c74724 req-25227f41-7764-4499-8f08-78b688e985e4 service nova] Acquiring lock "7eff6940-9675-4c89-bd28-378a5db4369f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-56eb44af-0c52-47f0-a6e8-a3d063c74724 req-25227f41-7764-4499-8f08-78b688e985e4 service nova] Lock "7eff6940-9675-4c89-bd28-378a5db4369f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-56eb44af-0c52-47f0-a6e8-a3d063c74724 req-25227f41-7764-4499-8f08-78b688e985e4 service nova] Lock "7eff6940-9675-4c89-bd28-378a5db4369f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:37 user nova-compute[74189]: DEBUG nova.compute.manager [req-56eb44af-0c52-47f0-a6e8-a3d063c74724 req-25227f41-7764-4499-8f08-78b688e985e4 service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] No waiting events found dispatching network-vif-unplugged-b05a2001-02cd-45af-9242-3d6246edcd0b {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:31:37 user nova-compute[74189]: DEBUG nova.compute.manager [req-56eb44af-0c52-47f0-a6e8-a3d063c74724 req-25227f41-7764-4499-8f08-78b688e985e4 service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Received event network-vif-unplugged-b05a2001-02cd-45af-9242-3d6246edcd0b for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:31:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:38 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Instance destroyed successfully.
Oct 25 21:31:38 user nova-compute[74189]: DEBUG nova.objects.instance [None req-306422e8-5077-4a00-b81e-c0c030bacfa1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lazy-loading 'resources' on Instance uuid 7eff6940-9675-4c89-bd28-378a5db4369f {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:31:38 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-306422e8-5077-4a00-b81e-c0c030bacfa1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T21:25:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1322492588',display_name='tempest-ServerActionsTestOtherA-server-808956216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1322492588',id=25,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5j6CMFPtaQ+NzS5oVZzUHGOr//XCKKpYtJKLFlY6kOEcPffJeLFPf99va1dycVwlGqutcJsn1c271d+g8r5i8+XkpVYF0aKK7TyDm32HptGHWvYJyfbjsyYyV3AGqK6Q==',key_name='tempest-keypair-1752245754',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:28:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4815aedea48841188ed8797a0eb51925',ramdisk_id='',reservation_id='r-o280pvx3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1355855048',owner_user_name='tempest-ServerActionsTestOtherA-1355855048-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:28:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b34817b1868f40a38a32a51d0e970d51',uuid=7eff6940-9675-4c89-bd28-378a5db4369f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b05a2001-02cd-45af-9242-3d6246edcd0b", "address": "fa:16:3e:a4:7d:bb", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb05a2001-02", "ovs_interfaceid": "b05a2001-02cd-45af-9242-3d6246edcd0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:31:38 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-306422e8-5077-4a00-b81e-c0c030bacfa1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Converting VIF {"id": "b05a2001-02cd-45af-9242-3d6246edcd0b", "address": "fa:16:3e:a4:7d:bb", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb05a2001-02", "ovs_interfaceid": "b05a2001-02cd-45af-9242-3d6246edcd0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:31:38 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-306422e8-5077-4a00-b81e-c0c030bacfa1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:7d:bb,bridge_name='br-int',has_traffic_filtering=True,id=b05a2001-02cd-45af-9242-3d6246edcd0b,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb05a2001-02') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:31:38 user nova-compute[74189]: DEBUG os_vif [None req-306422e8-5077-4a00-b81e-c0c030bacfa1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:7d:bb,bridge_name='br-int',has_traffic_filtering=True,id=b05a2001-02cd-45af-9242-3d6246edcd0b,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb05a2001-02') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:31:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb05a2001-02, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:31:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=45677459-69e1-46e8-972f-dcb80a416a17) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:31:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:38 user nova-compute[74189]: INFO os_vif [None req-306422e8-5077-4a00-b81e-c0c030bacfa1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:7d:bb,bridge_name='br-int',has_traffic_filtering=True,id=b05a2001-02cd-45af-9242-3d6246edcd0b,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb05a2001-02')
Oct 25 21:31:38 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-306422e8-5077-4a00-b81e-c0c030bacfa1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Deleting instance files /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f_del
Oct 25 21:31:38 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-306422e8-5077-4a00-b81e-c0c030bacfa1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Deletion of /opt/stack/data/nova/instances/7eff6940-9675-4c89-bd28-378a5db4369f_del complete
Oct 25 21:31:38 user nova-compute[74189]: INFO nova.compute.manager [None req-306422e8-5077-4a00-b81e-c0c030bacfa1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 25 21:31:38 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-306422e8-5077-4a00-b81e-c0c030bacfa1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:31:38 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:31:38 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:31:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-aefdc635-d04f-424d-8c03-eed00f699e4c tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-aefdc635-d04f-424d-8c03-eed00f699e4c tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-aefdc635-d04f-424d-8c03-eed00f699e4c tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-aefdc635-d04f-424d-8c03-eed00f699e4c tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-aefdc635-d04f-424d-8c03-eed00f699e4c tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:39 user nova-compute[74189]: INFO nova.compute.manager [None req-aefdc635-d04f-424d-8c03-eed00f699e4c tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Terminating instance
Oct 25 21:31:39 user nova-compute[74189]: DEBUG nova.compute.manager [None req-aefdc635-d04f-424d-8c03-eed00f699e4c tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG nova.compute.manager [req-4bd34e40-f561-469e-a01c-59a7e19d73c0 req-fdafb686-4ce9-4ff2-ba71-eed73c5ba4ee service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Received event network-vif-deleted-b05a2001-02cd-45af-9242-3d6246edcd0b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:31:39 user nova-compute[74189]: INFO nova.compute.manager [req-4bd34e40-f561-469e-a01c-59a7e19d73c0 req-fdafb686-4ce9-4ff2-ba71-eed73c5ba4ee service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Neutron deleted interface b05a2001-02cd-45af-9242-3d6246edcd0b; detaching it from the instance and deleting it from the info cache
Oct 25 21:31:39 user nova-compute[74189]: DEBUG nova.network.neutron [req-4bd34e40-f561-469e-a01c-59a7e19d73c0 req-fdafb686-4ce9-4ff2-ba71-eed73c5ba4ee service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:31:39 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Took 0.71 seconds to deallocate network for instance.
Oct 25 21:31:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG nova.compute.manager [req-4bd34e40-f561-469e-a01c-59a7e19d73c0 req-fdafb686-4ce9-4ff2-ba71-eed73c5ba4ee service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Detach interface failed, port_id=b05a2001-02cd-45af-9242-3d6246edcd0b, reason: Instance 7eff6940-9675-4c89-bd28-378a5db4369f could not be found. {{(pid=74189) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-306422e8-5077-4a00-b81e-c0c030bacfa1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-306422e8-5077-4a00-b81e-c0c030bacfa1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG nova.compute.manager [req-21ca4745-5c27-4dbc-b6e2-eefe5d9a557c req-6274e35d-eafa-47b9-9883-815885388636 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Received event network-vif-unplugged-b0bbbcbc-085e-476f-b600-f1d684f23beb {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-21ca4745-5c27-4dbc-b6e2-eefe5d9a557c req-6274e35d-eafa-47b9-9883-815885388636 service nova] Acquiring lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-21ca4745-5c27-4dbc-b6e2-eefe5d9a557c req-6274e35d-eafa-47b9-9883-815885388636 service nova] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-21ca4745-5c27-4dbc-b6e2-eefe5d9a557c req-6274e35d-eafa-47b9-9883-815885388636 service nova] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG nova.compute.manager [req-21ca4745-5c27-4dbc-b6e2-eefe5d9a557c req-6274e35d-eafa-47b9-9883-815885388636 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] No waiting events found dispatching network-vif-unplugged-b0bbbcbc-085e-476f-b600-f1d684f23beb {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG nova.compute.manager [req-21ca4745-5c27-4dbc-b6e2-eefe5d9a557c req-6274e35d-eafa-47b9-9883-815885388636 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Received event network-vif-unplugged-b0bbbcbc-085e-476f-b600-f1d684f23beb for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-306422e8-5077-4a00-b81e-c0c030bacfa1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-306422e8-5077-4a00-b81e-c0c030bacfa1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-306422e8-5077-4a00-b81e-c0c030bacfa1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.457s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:39 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-306422e8-5077-4a00-b81e-c0c030bacfa1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Deleted allocations for instance 7eff6940-9675-4c89-bd28-378a5db4369f
Oct 25 21:31:39 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Instance destroyed successfully.
Oct 25 21:31:39 user nova-compute[74189]: DEBUG nova.objects.instance [None req-aefdc635-d04f-424d-8c03-eed00f699e4c tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lazy-loading 'resources' on Instance uuid de6b6789-b328-4c3b-8d24-07774d5dbe6d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-aefdc635-d04f-424d-8c03-eed00f699e4c tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:21:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1758392823',display_name='tempest-AttachVolumeTestJSON-server-1758392823',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1758392823',id=17,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPiYEbKeppJsHkf9Hx5OHRO2CLzGAPd2wBVnTnbTrf7OneA+NCoBGPS8Iup7Bh8CoPm7/VcfZ0KMuu8zfSepXMiLSwU39yVEsYz6SpCmvS4oU93LKx611A6fXbw0yJUBA==',key_name='tempest-keypair-2000039022',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:21:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1d0f1deb7f04244920dae579032b287',ramdisk_id='',reservation_id='r-90yevjj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1213560671',owner_user_name='tempest-AttachVolumeTestJSON-1213560671-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:29:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e55da2b7458469e844fad1fe95cb695',uuid=de6b6789-b328-4c3b-8d24-07774d5dbe6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "address": "fa:16:3e:df:d0:7a", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bbbcbc-08", "ovs_interfaceid": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-aefdc635-d04f-424d-8c03-eed00f699e4c tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Converting VIF {"id": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "address": "fa:16:3e:df:d0:7a", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bbbcbc-08", "ovs_interfaceid": "b0bbbcbc-085e-476f-b600-f1d684f23beb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-aefdc635-d04f-424d-8c03-eed00f699e4c tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:d0:7a,bridge_name='br-int',has_traffic_filtering=True,id=b0bbbcbc-085e-476f-b600-f1d684f23beb,network=Network(1d219ea7-a949-4c77-9cd1-79cc99d6ac42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bbbcbc-08') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG os_vif [None req-aefdc635-d04f-424d-8c03-eed00f699e4c tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:d0:7a,bridge_name='br-int',has_traffic_filtering=True,id=b0bbbcbc-085e-476f-b600-f1d684f23beb,network=Network(1d219ea7-a949-4c77-9cd1-79cc99d6ac42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bbbcbc-08') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-306422e8-5077-4a00-b81e-c0c030bacfa1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "7eff6940-9675-4c89-bd28-378a5db4369f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.241s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0bbbcbc-08, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=21f58b24-809a-471e-a2d6-12fb80d34ef3) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:31:39 user nova-compute[74189]: INFO os_vif [None req-aefdc635-d04f-424d-8c03-eed00f699e4c tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:d0:7a,bridge_name='br-int',has_traffic_filtering=True,id=b0bbbcbc-085e-476f-b600-f1d684f23beb,network=Network(1d219ea7-a949-4c77-9cd1-79cc99d6ac42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bbbcbc-08')
Oct 25 21:31:39 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-aefdc635-d04f-424d-8c03-eed00f699e4c tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Deleting instance files /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d_del
Oct 25 21:31:39 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-aefdc635-d04f-424d-8c03-eed00f699e4c tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Deletion of /opt/stack/data/nova/instances/de6b6789-b328-4c3b-8d24-07774d5dbe6d_del complete
Oct 25 21:31:39 user nova-compute[74189]: INFO nova.compute.manager [None req-aefdc635-d04f-424d-8c03-eed00f699e4c tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 25 21:31:39 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-aefdc635-d04f-424d-8c03-eed00f699e4c tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG nova.compute.manager [req-878af794-00c3-46d6-a9f1-cc0b1d56fb90 req-385611ad-0258-429e-b6a3-92a109280d15 service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Received event network-vif-plugged-b05a2001-02cd-45af-9242-3d6246edcd0b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-878af794-00c3-46d6-a9f1-cc0b1d56fb90 req-385611ad-0258-429e-b6a3-92a109280d15 service nova] Acquiring lock "7eff6940-9675-4c89-bd28-378a5db4369f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-878af794-00c3-46d6-a9f1-cc0b1d56fb90 req-385611ad-0258-429e-b6a3-92a109280d15 service nova] Lock "7eff6940-9675-4c89-bd28-378a5db4369f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-878af794-00c3-46d6-a9f1-cc0b1d56fb90 req-385611ad-0258-429e-b6a3-92a109280d15 service nova] Lock "7eff6940-9675-4c89-bd28-378a5db4369f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:39 user nova-compute[74189]: DEBUG nova.compute.manager [req-878af794-00c3-46d6-a9f1-cc0b1d56fb90 req-385611ad-0258-429e-b6a3-92a109280d15 service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] No waiting events found dispatching network-vif-plugged-b05a2001-02cd-45af-9242-3d6246edcd0b {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:31:39 user nova-compute[74189]: WARNING nova.compute.manager [req-878af794-00c3-46d6-a9f1-cc0b1d56fb90 req-385611ad-0258-429e-b6a3-92a109280d15 service nova] [instance: 7eff6940-9675-4c89-bd28-378a5db4369f] Received unexpected event network-vif-plugged-b05a2001-02cd-45af-9242-3d6246edcd0b for instance with vm_state deleted and task_state None.
Oct 25 21:31:40 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:31:40 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Took 0.69 seconds to deallocate network for instance.
Oct 25 21:31:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-aefdc635-d04f-424d-8c03-eed00f699e4c tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-aefdc635-d04f-424d-8c03-eed00f699e4c tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:40 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-aefdc635-d04f-424d-8c03-eed00f699e4c tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:31:40 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-aefdc635-d04f-424d-8c03-eed00f699e4c tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:31:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-aefdc635-d04f-424d-8c03-eed00f699e4c tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:41 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-aefdc635-d04f-424d-8c03-eed00f699e4c tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Deleted allocations for instance de6b6789-b328-4c3b-8d24-07774d5dbe6d
Oct 25 21:31:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-aefdc635-d04f-424d-8c03-eed00f699e4c tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.116s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:41 user nova-compute[74189]: DEBUG nova.compute.manager [req-2955f490-ab5a-4909-91fb-a8f1f90c2f1d req-2452879f-8439-4398-b0e1-f3af0dfaa6d2 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Received event network-vif-deleted-b0bbbcbc-085e-476f-b600-f1d684f23beb {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:31:41 user nova-compute[74189]: DEBUG nova.compute.manager [req-7b4c3888-1743-4e6d-92aa-1f2d94eb7091 req-1c04246a-6a45-4ecb-b116-ff68fc3dcfa7 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Received event network-vif-plugged-b0bbbcbc-085e-476f-b600-f1d684f23beb {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:31:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7b4c3888-1743-4e6d-92aa-1f2d94eb7091 req-1c04246a-6a45-4ecb-b116-ff68fc3dcfa7 service nova] Acquiring lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7b4c3888-1743-4e6d-92aa-1f2d94eb7091 req-1c04246a-6a45-4ecb-b116-ff68fc3dcfa7 service nova] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7b4c3888-1743-4e6d-92aa-1f2d94eb7091 req-1c04246a-6a45-4ecb-b116-ff68fc3dcfa7 service nova] Lock "de6b6789-b328-4c3b-8d24-07774d5dbe6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:41 user nova-compute[74189]: DEBUG nova.compute.manager [req-7b4c3888-1743-4e6d-92aa-1f2d94eb7091 req-1c04246a-6a45-4ecb-b116-ff68fc3dcfa7 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] No waiting events found dispatching network-vif-plugged-b0bbbcbc-085e-476f-b600-f1d684f23beb {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:31:41 user nova-compute[74189]: WARNING nova.compute.manager [req-7b4c3888-1743-4e6d-92aa-1f2d94eb7091 req-1c04246a-6a45-4ecb-b116-ff68fc3dcfa7 service nova] [instance: de6b6789-b328-4c3b-8d24-07774d5dbe6d] Received unexpected event network-vif-plugged-b0bbbcbc-085e-476f-b600-f1d684f23beb for instance with vm_state deleted and task_state None.
Oct 25 21:31:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Triggering sync for uuid d7c3a99a-ab38-4e88-896d-94ae51a09a48 {{(pid=74189) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Triggering sync for uuid af1d7b3c-9950-4b74-8f15-b31011ccfa24 {{(pid=74189) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Triggering sync for uuid 932fe8ac-fdde-45c6-aa32-9bf866f19a4e {{(pid=74189) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Triggering sync for uuid 0b4f80c4-98cc-440a-aac7-cd423b71a231 {{(pid=74189) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Triggering sync for uuid cdb13b8f-c136-4f2b-95b9-e464babac28a {{(pid=74189) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Triggering sync for uuid 9a15fb16-8623-4a20-ae26-5f0aab29ec07 {{(pid=74189) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Triggering sync for uuid 9733d5c8-4476-4903-bd1b-16d43a54fdbd {{(pid=74189) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Triggering sync for uuid 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef {{(pid=74189) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Triggering sync for uuid 3da14c0a-31a8-4fe3-bd5a-49378680af50 {{(pid=74189) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Triggering sync for uuid a57b1185-270e-40d0-a55e-986960826169 {{(pid=74189) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Triggering sync for uuid d6e14e1a-6ef7-4a47-afc7-096326de8f5e {{(pid=74189) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "d7c3a99a-ab38-4e88-896d-94ae51a09a48" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "d7c3a99a-ab38-4e88-896d-94ae51a09a48" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "932fe8ac-fdde-45c6-aa32-9bf866f19a4e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "932fe8ac-fdde-45c6-aa32-9bf866f19a4e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "0b4f80c4-98cc-440a-aac7-cd423b71a231" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "0b4f80c4-98cc-440a-aac7-cd423b71a231" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "cdb13b8f-c136-4f2b-95b9-e464babac28a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "9a15fb16-8623-4a20-ae26-5f0aab29ec07" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "9a15fb16-8623-4a20-ae26-5f0aab29ec07" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "3da14c0a-31a8-4fe3-bd5a-49378680af50" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "3da14c0a-31a8-4fe3-bd5a-49378680af50" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "a57b1185-270e-40d0-a55e-986960826169" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "a57b1185-270e-40d0-a55e-986960826169" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "d7c3a99a-ab38-4e88-896d-94ae51a09a48" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "932fe8ac-fdde-45c6-aa32-9bf866f19a4e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "0b4f80c4-98cc-440a-aac7-cd423b71a231" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "9a15fb16-8623-4a20-ae26-5f0aab29ec07" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "3da14c0a-31a8-4fe3-bd5a-49378680af50" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "a57b1185-270e-40d0-a55e-986960826169" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:53 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:56 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cdb13b8f-c136-4f2b-95b9-e464babac28a is timed out.
Oct 25 21:31:56 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Successfully detached device vdb from instance cdb13b8f-c136-4f2b-95b9-e464babac28a from the live domain config.
Oct 25 21:31:56 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cromsGNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:31:56 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:31:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c4ffa5-3bf0-4b0c-b336-2fc2f5e284ef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:31:56 user nova-compute[74189]: No targets found.
Oct 25 21:31:56 user nova-compute[74189]: iSNS:
Oct 25 21:31:56 user nova-compute[74189]: No targets found.
Oct 25 21:31:56 user nova-compute[74189]: STATIC:
Oct 25 21:31:56 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce
Oct 25 21:31:56 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:31:56 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:31:56 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d
Oct 25 21:31:56 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:31:56 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:31:56 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e
Oct 25 21:31:56 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:31:56 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:31:56 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e
Oct 25 21:31:56 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:31:56 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:31:56 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:31:56 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:31:56 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:31:56 user nova-compute[74189]: FIRMWARE:
Oct 25 21:31:56 user nova-compute[74189]: No targets found.
Oct 25 21:31:56 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:31:56 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:31:56 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15fb13a-d6ff-42b5-a882-ec9122f5a65e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0453c30d-2806-41f1-a8ef-6416f311b525]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:31:56 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:31:56 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:31:56 user nova-compute[74189]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:31:56 user nova-compute[74189]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:31:56 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:31:56 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:31:56 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:31:56 user nova-compute[74189]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e (non-flash)
Oct 25 21:31:56 user nova-compute[74189]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:31:56 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2e421a200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e'): ({'sdf'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Removing single pathed devices sdf {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[febbb8b9-d4b5-4677-8582-6551036b6ae6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[83da36ba-aaeb-4caa-bf13-dfb835f91444]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Flushing IO for device /dev/sdf {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d338487f-aea7-4cd0-876f-a014a4b52f12]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57b0378-ad16-40c7-aed4-a8f3291e79bb]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] SCSI volumes sdf have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff14d5d-30b9-406c-852b-377d98e6e0a4]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1045ae-da04-4697-b3a3-1ca61c95726c]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e, portal: 172.16.0.220,3260]
Oct 25 21:31:56 user nova-compute[74189]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e, portal: 172.16.0.220,3260] successful.
Oct 25 21:31:56 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f7847e8-8ab4-4b65-bfc5-525c6d4dad8e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1157e24-d72f-4c28-a763-b083b7430f82]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] <== disconnect_volume: return (314ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:31:56 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "9a15fb16-8623-4a20-ae26-5f0aab29ec07" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "9a15fb16-8623-4a20-ae26-5f0aab29ec07" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "9a15fb16-8623-4a20-ae26-5f0aab29ec07-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "9a15fb16-8623-4a20-ae26-5f0aab29ec07-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "9a15fb16-8623-4a20-ae26-5f0aab29ec07-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:57 user nova-compute[74189]: INFO nova.compute.manager [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Terminating instance
Oct 25 21:31:57 user nova-compute[74189]: DEBUG nova.compute.manager [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-aa98c053-9506-4ef7-80ce-86470ecd78c5 req-39cebefb-96d2-4109-8b79-2047f9f393da service nova] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Received event network-vif-unplugged-99d99cc1-710e-41b6-8239-79f4dbc9183a {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-aa98c053-9506-4ef7-80ce-86470ecd78c5 req-39cebefb-96d2-4109-8b79-2047f9f393da service nova] Acquiring lock "9a15fb16-8623-4a20-ae26-5f0aab29ec07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-aa98c053-9506-4ef7-80ce-86470ecd78c5 req-39cebefb-96d2-4109-8b79-2047f9f393da service nova] Lock "9a15fb16-8623-4a20-ae26-5f0aab29ec07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-aa98c053-9506-4ef7-80ce-86470ecd78c5 req-39cebefb-96d2-4109-8b79-2047f9f393da service nova] Lock "9a15fb16-8623-4a20-ae26-5f0aab29ec07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-aa98c053-9506-4ef7-80ce-86470ecd78c5 req-39cebefb-96d2-4109-8b79-2047f9f393da service nova] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] No waiting events found dispatching network-vif-unplugged-99d99cc1-710e-41b6-8239-79f4dbc9183a {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-aa98c053-9506-4ef7-80ce-86470ecd78c5 req-39cebefb-96d2-4109-8b79-2047f9f393da service nova] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Received event network-vif-unplugged-99d99cc1-710e-41b6-8239-79f4dbc9183a for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG nova.objects.instance [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lazy-loading 'flavor' on Instance uuid cdb13b8f-c136-4f2b-95b9-e464babac28a {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-10da46a0-2cc0-436b-b598-ba864558bba6 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "cdb13b8f-c136-4f2b-95b9-e464babac28a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.875s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "cdb13b8f-c136-4f2b-95b9-e464babac28a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.722s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "cdb13b8f-c136-4f2b-95b9-e464babac28a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:57 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Instance destroyed successfully.
Oct 25 21:31:57 user nova-compute[74189]: DEBUG nova.objects.instance [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lazy-loading 'resources' on Instance uuid 9a15fb16-8623-4a20-ae26-5f0aab29ec07 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-373776185',display_name='tempest-TestVolumeBootPattern-volume-backed-server-373776185',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-373776185',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTqyu9zscRHG+4PWq2KUYWUDaF14I7dW5TvNxWSSGwOpQH6P2k9O5z/UfIY2G1oHw7ySR9zIJa9lEWatc6t/ZPIYW/ejRmVUjVyHxlMIB9C8LoZZ2dikky07mAnqdwDVA==',key_name='tempest-keypair-245422482',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:27:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e893e8f3f58e4e15920d313b6391682c',ramdisk_id='',reservation_id='r-pqtkyg7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1934687878',owner_user_name='tempest-TestVolumeBootPattern-1934687878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:27:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77a27a7ebb4a458097c901871c378bc8',uuid=9a15fb16-8623-4a20-ae26-5f0aab29ec07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99d99cc1-710e-41b6-8239-79f4dbc9183a", "address": "fa:16:3e:09:c7:d1", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d99cc1-71", "ovs_interfaceid": "99d99cc1-710e-41b6-8239-79f4dbc9183a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converting VIF {"id": "99d99cc1-710e-41b6-8239-79f4dbc9183a", "address": "fa:16:3e:09:c7:d1", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d99cc1-71", "ovs_interfaceid": "99d99cc1-710e-41b6-8239-79f4dbc9183a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:c7:d1,bridge_name='br-int',has_traffic_filtering=True,id=99d99cc1-710e-41b6-8239-79f4dbc9183a,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d99cc1-71') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG os_vif [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:c7:d1,bridge_name='br-int',has_traffic_filtering=True,id=99d99cc1-710e-41b6-8239-79f4dbc9183a,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d99cc1-71') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99d99cc1-71, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e06c10cd-53e0-44f3-b7d7-8c00a7836323) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:31:57 user nova-compute[74189]: INFO os_vif [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:c7:d1,bridge_name='br-int',has_traffic_filtering=True,id=99d99cc1-710e-41b6-8239-79f4dbc9183a,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d99cc1-71')
Oct 25 21:31:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KcyRfFoi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:31:57 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:31:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df1d909-6db9-4412-bc21-38bae60b65ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:31:57 user nova-compute[74189]: No targets found.
Oct 25 21:31:57 user nova-compute[74189]: iSNS:
Oct 25 21:31:57 user nova-compute[74189]: No targets found.
Oct 25 21:31:57 user nova-compute[74189]: STATIC:
Oct 25 21:31:57 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce
Oct 25 21:31:57 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:31:57 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:31:57 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d
Oct 25 21:31:57 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:31:57 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:31:57 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e
Oct 25 21:31:57 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:31:57 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:31:57 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:31:57 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:31:57 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:31:57 user nova-compute[74189]: FIRMWARE:
Oct 25 21:31:57 user nova-compute[74189]: No targets found.
Oct 25 21:31:57 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:31:57 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:31:57 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da26b04-9edb-4dde-950c-6e08b0419bcd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f780a9-60ce-4afa-a3f6-9ac7f02c1ed0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:31:57 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:31:57 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:31:57 user nova-compute[74189]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:31:57 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:31:57 user nova-compute[74189]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d (non-flash)
Oct 25 21:31:57 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:31:57 user nova-compute[74189]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:31:57 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3042c00d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d'): ({'sdg'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Removing single pathed devices sdg {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:31:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd840db-12fd-4692-b63b-1a9155df6e64]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9facd794-5f58-4787-98c0-d42f196200ce]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Flushing IO for device /dev/sdg {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3aeeee-3f58-4b55-8ada-5a3758c5a6c9]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.050s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b29b102-39ed-4457-91d4-d582f6049bf1]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] SCSI volumes sdg have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[37be61f0-c6e6-4654-b584-5b637e734644]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a76135f-972f-41ac-8035-a51d11ceb736]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d, portal: 172.16.0.220,3260]
Oct 25 21:31:58 user nova-compute[74189]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d, portal: 172.16.0.220,3260] successful.
Oct 25 21:31:58 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8235a5-e37a-42d9-bdee-77e9e31343b3]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] <== disconnect_volume: return (314ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:31:58 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Deleting instance files /opt/stack/data/nova/instances/9a15fb16-8623-4a20-ae26-5f0aab29ec07_del
Oct 25 21:31:58 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Deletion of /opt/stack/data/nova/instances/9a15fb16-8623-4a20-ae26-5f0aab29ec07_del complete
Oct 25 21:31:58 user nova-compute[74189]: INFO nova.compute.manager [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Took 1.16 seconds to destroy the instance on the hypervisor.
Oct 25 21:31:58 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:31:58 user nova-compute[74189]: INFO nova.compute.manager [None req-3d2dc410-b49a-46e0-b9bb-070d94711d08 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Unrescuing
Oct 25 21:31:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3d2dc410-b49a-46e0-b9bb-070d94711d08 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "refresh_cache-9733d5c8-4476-4903-bd1b-16d43a54fdbd" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3d2dc410-b49a-46e0-b9bb-070d94711d08 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquired lock "refresh_cache-9733d5c8-4476-4903-bd1b-16d43a54fdbd" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:31:58 user nova-compute[74189]: DEBUG nova.network.neutron [None req-3d2dc410-b49a-46e0-b9bb-070d94711d08 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:31:59 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:31:59 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Took 0.73 seconds to deallocate network for instance.
Oct 25 21:31:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-4bc124aa-7ebc-457e-93f7-fea116a3470c req-fcf05061-e490-413d-ae6a-8866a05d1c75 service nova] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Received event network-vif-deleted-99d99cc1-710e-41b6-8239-79f4dbc9183a {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:31:59 user nova-compute[74189]: INFO nova.compute.manager [req-4bc124aa-7ebc-457e-93f7-fea116a3470c req-fcf05061-e490-413d-ae6a-8866a05d1c75 service nova] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Neutron deleted interface 99d99cc1-710e-41b6-8239-79f4dbc9183a; detaching it from the instance and deleting it from the info cache
Oct 25 21:31:59 user nova-compute[74189]: DEBUG nova.network.neutron [req-4bc124aa-7ebc-457e-93f7-fea116a3470c req-fcf05061-e490-413d-ae6a-8866a05d1c75 service nova] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:31:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-4bc124aa-7ebc-457e-93f7-fea116a3470c req-fcf05061-e490-413d-ae6a-8866a05d1c75 service nova] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Detach interface failed, port_id=99d99cc1-710e-41b6-8239-79f4dbc9183a, reason: Instance 9a15fb16-8623-4a20-ae26-5f0aab29ec07 could not be found. {{(pid=74189) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 21:31:59 user nova-compute[74189]: DEBUG nova.network.neutron [None req-3d2dc410-b49a-46e0-b9bb-070d94711d08 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Updating instance_info_cache with network_info: [{"id": "005bac46-8900-46a0-bb7f-d8672c6d2fc1", "address": "fa:16:3e:1d:ce:94", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap005bac46-89", "ovs_interfaceid": "005bac46-8900-46a0-bb7f-d8672c6d2fc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:31:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3d2dc410-b49a-46e0-b9bb-070d94711d08 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Releasing lock "refresh_cache-9733d5c8-4476-4903-bd1b-16d43a54fdbd" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:31:59 user nova-compute[74189]: DEBUG nova.objects.instance [None req-3d2dc410-b49a-46e0-b9bb-070d94711d08 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lazy-loading 'flavor' on Instance uuid 9733d5c8-4476-4903-bd1b-16d43a54fdbd {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:31:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-39c69235-eaf7-45d0-9cfc-0fab39f0d49e req-70d7b422-9f6b-4a48-adc1-b60e46c2c55c service nova] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Received event network-vif-plugged-99d99cc1-710e-41b6-8239-79f4dbc9183a {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:31:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-39c69235-eaf7-45d0-9cfc-0fab39f0d49e req-70d7b422-9f6b-4a48-adc1-b60e46c2c55c service nova] Acquiring lock "9a15fb16-8623-4a20-ae26-5f0aab29ec07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-39c69235-eaf7-45d0-9cfc-0fab39f0d49e req-70d7b422-9f6b-4a48-adc1-b60e46c2c55c service nova] Lock "9a15fb16-8623-4a20-ae26-5f0aab29ec07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:31:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-39c69235-eaf7-45d0-9cfc-0fab39f0d49e req-70d7b422-9f6b-4a48-adc1-b60e46c2c55c service nova] Lock "9a15fb16-8623-4a20-ae26-5f0aab29ec07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:31:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-39c69235-eaf7-45d0-9cfc-0fab39f0d49e req-70d7b422-9f6b-4a48-adc1-b60e46c2c55c service nova] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] No waiting events found dispatching network-vif-plugged-99d99cc1-710e-41b6-8239-79f4dbc9183a {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:31:59 user nova-compute[74189]: WARNING nova.compute.manager [req-39c69235-eaf7-45d0-9cfc-0fab39f0d49e req-70d7b422-9f6b-4a48-adc1-b60e46c2c55c service nova] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Received unexpected event network-vif-plugged-99d99cc1-710e-41b6-8239-79f4dbc9183a for instance with vm_state active and task_state deleting.
Oct 25 21:31:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:31:59 user nova-compute[74189]: INFO nova.compute.manager [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Took 0.83 seconds to detach 1 volumes for instance.
Oct 25 21:31:59 user nova-compute[74189]: DEBUG nova.compute.manager [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 9a15fb16-8623-4a20-ae26-5f0aab29ec07] Deleting volume: 03d0fc70-a74d-4a13-a7f4-08d0a1db8e2d {{(pid=74189) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 25 21:31:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:31:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:00 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Refreshing inventories for resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 21:32:00 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Instance destroyed successfully.
Oct 25 21:32:00 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Updating ProviderTree inventory for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 21:32:00 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Updating inventory in ProviderTree for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 21:32:00 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Refreshing aggregate associations for resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc, aggregates: None {{(pid=74189) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 21:32:00 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Refreshing trait associations for resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING {{(pid=74189) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 21:32:00 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:32:00 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:32:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.737s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:00 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Deleted allocations for instance 9a15fb16-8623-4a20-ae26-5f0aab29ec07
Oct 25 21:32:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f56b89ff-8c76-4853-b959-cc72a6dd9666 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "9a15fb16-8623-4a20-ae26-5f0aab29ec07" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.714s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:01 user nova-compute[74189]: DEBUG nova.compute.manager [req-ed09bbc4-bbf0-4f40-8e11-eb1e63ba3d9e req-192db355-a404-46a2-8a77-f8d59434d553 service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Received event network-vif-unplugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:32:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ed09bbc4-bbf0-4f40-8e11-eb1e63ba3d9e req-192db355-a404-46a2-8a77-f8d59434d553 service nova] Acquiring lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ed09bbc4-bbf0-4f40-8e11-eb1e63ba3d9e req-192db355-a404-46a2-8a77-f8d59434d553 service nova] Lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ed09bbc4-bbf0-4f40-8e11-eb1e63ba3d9e req-192db355-a404-46a2-8a77-f8d59434d553 service nova] Lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:01 user nova-compute[74189]: DEBUG nova.compute.manager [req-ed09bbc4-bbf0-4f40-8e11-eb1e63ba3d9e req-192db355-a404-46a2-8a77-f8d59434d553 service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] No waiting events found dispatching network-vif-unplugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:32:01 user nova-compute[74189]: WARNING nova.compute.manager [req-ed09bbc4-bbf0-4f40-8e11-eb1e63ba3d9e req-192db355-a404-46a2-8a77-f8d59434d553 service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Received unexpected event network-vif-unplugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 for instance with vm_state rescued and task_state unrescuing.
Oct 25 21:32:01 user nova-compute[74189]: DEBUG nova.compute.manager [req-ed09bbc4-bbf0-4f40-8e11-eb1e63ba3d9e req-192db355-a404-46a2-8a77-f8d59434d553 service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Received event network-vif-plugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:32:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ed09bbc4-bbf0-4f40-8e11-eb1e63ba3d9e req-192db355-a404-46a2-8a77-f8d59434d553 service nova] Acquiring lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ed09bbc4-bbf0-4f40-8e11-eb1e63ba3d9e req-192db355-a404-46a2-8a77-f8d59434d553 service nova] Lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ed09bbc4-bbf0-4f40-8e11-eb1e63ba3d9e req-192db355-a404-46a2-8a77-f8d59434d553 service nova] Lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:01 user nova-compute[74189]: DEBUG nova.compute.manager [req-ed09bbc4-bbf0-4f40-8e11-eb1e63ba3d9e req-192db355-a404-46a2-8a77-f8d59434d553 service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] No waiting events found dispatching network-vif-plugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:32:01 user nova-compute[74189]: WARNING nova.compute.manager [req-ed09bbc4-bbf0-4f40-8e11-eb1e63ba3d9e req-192db355-a404-46a2-8a77-f8d59434d553 service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Received unexpected event network-vif-plugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 for instance with vm_state rescued and task_state unrescuing.
Oct 25 21:32:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-5dd94c6c-4428-41e9-906c-46db726e31cc req-6c116861-879e-43b7-af24-177d9447e6b5 service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Received event network-vif-plugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:32:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-5dd94c6c-4428-41e9-906c-46db726e31cc req-6c116861-879e-43b7-af24-177d9447e6b5 service nova] Acquiring lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-5dd94c6c-4428-41e9-906c-46db726e31cc req-6c116861-879e-43b7-af24-177d9447e6b5 service nova] Lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-5dd94c6c-4428-41e9-906c-46db726e31cc req-6c116861-879e-43b7-af24-177d9447e6b5 service nova] Lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-5dd94c6c-4428-41e9-906c-46db726e31cc req-6c116861-879e-43b7-af24-177d9447e6b5 service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] No waiting events found dispatching network-vif-plugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:32:03 user nova-compute[74189]: WARNING nova.compute.manager [req-5dd94c6c-4428-41e9-906c-46db726e31cc req-6c116861-879e-43b7-af24-177d9447e6b5 service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Received unexpected event network-vif-plugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 for instance with vm_state rescued and task_state unrescuing.
Oct 25 21:32:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-5dd94c6c-4428-41e9-906c-46db726e31cc req-6c116861-879e-43b7-af24-177d9447e6b5 service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Received event network-vif-plugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:32:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-5dd94c6c-4428-41e9-906c-46db726e31cc req-6c116861-879e-43b7-af24-177d9447e6b5 service nova] Acquiring lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-5dd94c6c-4428-41e9-906c-46db726e31cc req-6c116861-879e-43b7-af24-177d9447e6b5 service nova] Lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-5dd94c6c-4428-41e9-906c-46db726e31cc req-6c116861-879e-43b7-af24-177d9447e6b5 service nova] Lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-5dd94c6c-4428-41e9-906c-46db726e31cc req-6c116861-879e-43b7-af24-177d9447e6b5 service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] No waiting events found dispatching network-vif-plugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:32:03 user nova-compute[74189]: WARNING nova.compute.manager [req-5dd94c6c-4428-41e9-906c-46db726e31cc req-6c116861-879e-43b7-af24-177d9447e6b5 service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Received unexpected event network-vif-plugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 for instance with vm_state rescued and task_state unrescuing.
Oct 25 21:32:03 user nova-compute[74189]: DEBUG nova.compute.manager [None req-3d2dc410-b49a-46e0-b9bb-070d94711d08 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:32:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "a393d263-97a8-4103-a9b4-866b5d6fc435" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "a393d263-97a8-4103-a9b4-866b5d6fc435" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:04 user nova-compute[74189]: DEBUG nova.compute.manager [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:32:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:04 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:32:04 user nova-compute[74189]: INFO nova.compute.claims [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Claim successful on node user
Oct 25 21:32:05 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:32:05 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:32:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:05 user nova-compute[74189]: DEBUG nova.compute.manager [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:32:05 user nova-compute[74189]: DEBUG nova.compute.manager [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:32:05 user nova-compute[74189]: DEBUG nova.network.neutron [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:32:05 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:32:05 user nova-compute[74189]: DEBUG nova.compute.manager [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:32:05 user nova-compute[74189]: DEBUG nova.compute.manager [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:32:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:32:05 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Creating image(s)
Oct 25 21:32:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "/opt/stack/data/nova/instances/a393d263-97a8-4103-a9b4-866b5d6fc435/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "/opt/stack/data/nova/instances/a393d263-97a8-4103-a9b4-866b5d6fc435/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "/opt/stack/data/nova/instances/a393d263-97a8-4103-a9b4-866b5d6fc435/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:32:05 user nova-compute[74189]: DEBUG nova.policy [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2f19a398fd9486fbef04eebad62a0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a555d708aa644d586d5edad7db837b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:32:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.196s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:32:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:32:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.193s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:32:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/a393d263-97a8-4103-a9b4-866b5d6fc435/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:32:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/a393d263-97a8-4103-a9b4-866b5d6fc435/disk 1073741824" returned: 0 in 0.099s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:32:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.300s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:32:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-28304a7f-641b-470a-a4a3-b69f26a8d8d5 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "a57b1185-270e-40d0-a55e-986960826169" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-28304a7f-641b-470a-a4a3-b69f26a8d8d5 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "a57b1185-270e-40d0-a55e-986960826169" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-28304a7f-641b-470a-a4a3-b69f26a8d8d5 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "a57b1185-270e-40d0-a55e-986960826169-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-28304a7f-641b-470a-a4a3-b69f26a8d8d5 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "a57b1185-270e-40d0-a55e-986960826169-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-28304a7f-641b-470a-a4a3-b69f26a8d8d5 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "a57b1185-270e-40d0-a55e-986960826169-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:06 user nova-compute[74189]: INFO nova.compute.manager [None req-28304a7f-641b-470a-a4a3-b69f26a8d8d5 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Terminating instance
Oct 25 21:32:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.209s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:32:06 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a393d263-97a8-4103-a9b4-866b5d6fc435/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:32:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a393d263-97a8-4103-a9b4-866b5d6fc435/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:32:06 user nova-compute[74189]: DEBUG nova.compute.manager [None req-28304a7f-641b-470a-a4a3-b69f26a8d8d5 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:32:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a393d263-97a8-4103-a9b4-866b5d6fc435/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:32:06 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Cannot resize image /opt/stack/data/nova/instances/a393d263-97a8-4103-a9b4-866b5d6fc435/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:32:06 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:32:06 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Ensure instance console log exists: /opt/stack/data/nova/instances/a393d263-97a8-4103-a9b4-866b5d6fc435/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:32:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:06 user nova-compute[74189]: DEBUG nova.network.neutron [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Successfully created port: 22b40255-2ff7-4639-8c10-0959ac5f5917 {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:32:06 user nova-compute[74189]: DEBUG nova.compute.manager [req-2b581b17-e3dc-438d-881a-67f0d21493eb req-6f036a7f-47aa-42f7-8ea2-d1284c4e1c2a service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received event network-vif-unplugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:32:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2b581b17-e3dc-438d-881a-67f0d21493eb req-6f036a7f-47aa-42f7-8ea2-d1284c4e1c2a service nova] Acquiring lock "a57b1185-270e-40d0-a55e-986960826169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2b581b17-e3dc-438d-881a-67f0d21493eb req-6f036a7f-47aa-42f7-8ea2-d1284c4e1c2a service nova] Lock "a57b1185-270e-40d0-a55e-986960826169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2b581b17-e3dc-438d-881a-67f0d21493eb req-6f036a7f-47aa-42f7-8ea2-d1284c4e1c2a service nova] Lock "a57b1185-270e-40d0-a55e-986960826169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:06 user nova-compute[74189]: DEBUG nova.compute.manager [req-2b581b17-e3dc-438d-881a-67f0d21493eb req-6f036a7f-47aa-42f7-8ea2-d1284c4e1c2a service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] No waiting events found dispatching network-vif-unplugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:32:06 user nova-compute[74189]: DEBUG nova.compute.manager [req-2b581b17-e3dc-438d-881a-67f0d21493eb req-6f036a7f-47aa-42f7-8ea2-d1284c4e1c2a service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received event network-vif-unplugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:32:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:07 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: a57b1185-270e-40d0-a55e-986960826169] Instance destroyed successfully.
Oct 25 21:32:07 user nova-compute[74189]: DEBUG nova.objects.instance [None req-28304a7f-641b-470a-a4a3-b69f26a8d8d5 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lazy-loading 'resources' on Instance uuid a57b1185-270e-40d0-a55e-986960826169 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:32:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:07 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-28304a7f-641b-470a-a4a3-b69f26a8d8d5 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T21:25:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1746373749',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1746373749',id=24,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeVfbHlnrfHPlWJf0qQWN3RmoyGnlwESQMNATRyDnsaQDNhoQQ5AFt+AOrCNT1My52XNyl/wmtAhCjs522VgUQ0PcCWFwer2/z8cWlMfT4+vBhmGaYJddvSyq52kAg4Cg==',key_name='tempest-keypair-784432470',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:30:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e45f8868c6a04e31ad1617ee6e9438a2',ramdisk_id='',reservation_id='r-6cje6qbe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-846255404',owner_user_name='tempest-AttachVolumeShelveTestJSON-846255404-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6fb9b5c36f049c1af4ae44e11267264',uuid=a57b1185-270e-40d0-a55e-986960826169,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "address": "fa:16:3e:6b:ad:c5", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc4dd08-df", "ovs_interfaceid": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:32:07 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-28304a7f-641b-470a-a4a3-b69f26a8d8d5 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Converting VIF {"id": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "address": "fa:16:3e:6b:ad:c5", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc4dd08-df", "ovs_interfaceid": "ecc4dd08-df4f-445b-81eb-b3946804aef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:32:07 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-28304a7f-641b-470a-a4a3-b69f26a8d8d5 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ad:c5,bridge_name='br-int',has_traffic_filtering=True,id=ecc4dd08-df4f-445b-81eb-b3946804aef8,network=Network(09d8bdf6-f255-479c-aa38-55d468abf1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc4dd08-df') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:32:07 user nova-compute[74189]: DEBUG os_vif [None req-28304a7f-641b-470a-a4a3-b69f26a8d8d5 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ad:c5,bridge_name='br-int',has_traffic_filtering=True,id=ecc4dd08-df4f-445b-81eb-b3946804aef8,network=Network(09d8bdf6-f255-479c-aa38-55d468abf1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc4dd08-df') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:32:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapecc4dd08-df, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:32:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:32:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a22487e-ca64-4a31-87b2-39df249677fe) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:32:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:07 user nova-compute[74189]: INFO os_vif [None req-28304a7f-641b-470a-a4a3-b69f26a8d8d5 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ad:c5,bridge_name='br-int',has_traffic_filtering=True,id=ecc4dd08-df4f-445b-81eb-b3946804aef8,network=Network(09d8bdf6-f255-479c-aa38-55d468abf1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc4dd08-df')
Oct 25 21:32:07 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-28304a7f-641b-470a-a4a3-b69f26a8d8d5 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Deleting instance files /opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169_del
Oct 25 21:32:07 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-28304a7f-641b-470a-a4a3-b69f26a8d8d5 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Deletion of /opt/stack/data/nova/instances/a57b1185-270e-40d0-a55e-986960826169_del complete
Oct 25 21:32:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:07 user nova-compute[74189]: INFO nova.compute.manager [None req-28304a7f-641b-470a-a4a3-b69f26a8d8d5 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: a57b1185-270e-40d0-a55e-986960826169] Took 1.00 seconds to destroy the instance on the hypervisor.
Oct 25 21:32:07 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-28304a7f-641b-470a-a4a3-b69f26a8d8d5 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:32:07 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: a57b1185-270e-40d0-a55e-986960826169] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:32:07 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: a57b1185-270e-40d0-a55e-986960826169] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:32:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:07 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:32:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.network.neutron [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Successfully updated port: 22b40255-2ff7-4639-8c10-0959ac5f5917 {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "refresh_cache-a393d263-97a8-4103-a9b4-866b5d6fc435" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquired lock "refresh_cache-a393d263-97a8-4103-a9b4-866b5d6fc435" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.network.neutron [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.network.neutron [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.network.neutron [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Updating instance_info_cache with network_info: [{"id": "22b40255-2ff7-4639-8c10-0959ac5f5917", "address": "fa:16:3e:26:05:ef", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b40255-2f", "ovs_interfaceid": "22b40255-2ff7-4639-8c10-0959ac5f5917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Releasing lock "refresh_cache-a393d263-97a8-4103-a9b4-866b5d6fc435" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.compute.manager [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Instance network_info: |[{"id": "22b40255-2ff7-4639-8c10-0959ac5f5917", "address": "fa:16:3e:26:05:ef", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b40255-2f", "ovs_interfaceid": "22b40255-2ff7-4639-8c10-0959ac5f5917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Start _get_guest_xml network_info=[{"id": "22b40255-2ff7-4639-8c10-0959ac5f5917", "address": "fa:16:3e:26:05:ef", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b40255-2f", "ovs_interfaceid": "22b40255-2ff7-4639-8c10-0959ac5f5917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:32:08 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:32:08 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:32:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-717191026',display_name='tempest-AttachVolumeNegativeTest-server-717191026',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-717191026',id=34,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaZBQVPTVIl2ipvGJpaWqLEGx1boENHN7YXzPrs+0udCCKTslQOy+jjZ9V6SajU2MGVKy4Ms5DnWxfgfANdB91ltMLp8UPK14+gEAcO1McCRa23cMb0uQqtf99fPNLzhg==',key_name='tempest-keypair-680322332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a555d708aa644d586d5edad7db837b4',ramdisk_id='',reservation_id='r-bgsv698b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-979681322',owner_user_name='tempest-AttachVolumeNegativeTest-979681322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:32:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2f19a398fd9486fbef04eebad62a0cb',uuid=a393d263-97a8-4103-a9b4-866b5d6fc435,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22b40255-2ff7-4639-8c10-0959ac5f5917", "address": "fa:16:3e:26:05:ef", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b40255-2f", "ovs_interfaceid": "22b40255-2ff7-4639-8c10-0959ac5f5917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Converting VIF {"id": "22b40255-2ff7-4639-8c10-0959ac5f5917", "address": "fa:16:3e:26:05:ef", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b40255-2f", "ovs_interfaceid": "22b40255-2ff7-4639-8c10-0959ac5f5917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:05:ef,bridge_name='br-int',has_traffic_filtering=True,id=22b40255-2ff7-4639-8c10-0959ac5f5917,network=Network(5029031b-e67b-4f60-bc17-781cbdc88b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b40255-2f') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.objects.instance [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lazy-loading 'pci_devices' on Instance uuid a393d263-97a8-4103-a9b4-866b5d6fc435 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:32:08 user nova-compute[74189]:   <uuid>a393d263-97a8-4103-a9b4-866b5d6fc435</uuid>
Oct 25 21:32:08 user nova-compute[74189]:   <name>instance-00000022</name>
Oct 25 21:32:08 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:32:08 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:32:08 user nova-compute[74189]:   <metadata>
Oct 25 21:32:08 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:32:08 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:32:08 user nova-compute[74189]:       <nova:name>tempest-AttachVolumeNegativeTest-server-717191026</nova:name>
Oct 25 21:32:08 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:32:08</nova:creationTime>
Oct 25 21:32:08 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:32:08 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:32:08 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:32:08 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:32:08 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:32:08 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:32:08 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:32:08 user nova-compute[74189]:       <nova:owner>
Oct 25 21:32:08 user nova-compute[74189]:         <nova:user uuid="a2f19a398fd9486fbef04eebad62a0cb">tempest-AttachVolumeNegativeTest-979681322-project-member</nova:user>
Oct 25 21:32:08 user nova-compute[74189]:         <nova:project uuid="4a555d708aa644d586d5edad7db837b4">tempest-AttachVolumeNegativeTest-979681322</nova:project>
Oct 25 21:32:08 user nova-compute[74189]:       </nova:owner>
Oct 25 21:32:08 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:32:08 user nova-compute[74189]:       <nova:ports>
Oct 25 21:32:08 user nova-compute[74189]:         <nova:port uuid="22b40255-2ff7-4639-8c10-0959ac5f5917">
Oct 25 21:32:08 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 25 21:32:08 user nova-compute[74189]:         </nova:port>
Oct 25 21:32:08 user nova-compute[74189]:       </nova:ports>
Oct 25 21:32:08 user nova-compute[74189]:     </nova:instance>
Oct 25 21:32:08 user nova-compute[74189]:   </metadata>
Oct 25 21:32:08 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:32:08 user nova-compute[74189]:     <system>
Oct 25 21:32:08 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:32:08 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:32:08 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:32:08 user nova-compute[74189]:       <entry name="serial">a393d263-97a8-4103-a9b4-866b5d6fc435</entry>
Oct 25 21:32:08 user nova-compute[74189]:       <entry name="uuid">a393d263-97a8-4103-a9b4-866b5d6fc435</entry>
Oct 25 21:32:08 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:32:08 user nova-compute[74189]:     </system>
Oct 25 21:32:08 user nova-compute[74189]:   </sysinfo>
Oct 25 21:32:08 user nova-compute[74189]:   <os>
Oct 25 21:32:08 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:32:08 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:32:08 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:32:08 user nova-compute[74189]:   </os>
Oct 25 21:32:08 user nova-compute[74189]:   <features>
Oct 25 21:32:08 user nova-compute[74189]:     <acpi/>
Oct 25 21:32:08 user nova-compute[74189]:     <apic/>
Oct 25 21:32:08 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:32:08 user nova-compute[74189]:   </features>
Oct 25 21:32:08 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:32:08 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:32:08 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:32:08 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:32:08 user nova-compute[74189]:   </clock>
Oct 25 21:32:08 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:32:08 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:32:08 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:32:08 user nova-compute[74189]:   </cpu>
Oct 25 21:32:08 user nova-compute[74189]:   <devices>
Oct 25 21:32:08 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:32:08 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:32:08 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/a393d263-97a8-4103-a9b4-866b5d6fc435/disk"/>
Oct 25 21:32:08 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:32:08 user nova-compute[74189]:     </disk>
Oct 25 21:32:08 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:32:08 user nova-compute[74189]:       <mac address="fa:16:3e:26:05:ef"/>
Oct 25 21:32:08 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:32:08 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:32:08 user nova-compute[74189]:       <target dev="tap22b40255-2f"/>
Oct 25 21:32:08 user nova-compute[74189]:     </interface>
Oct 25 21:32:08 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:32:08 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/a393d263-97a8-4103-a9b4-866b5d6fc435/console.log" append="off"/>
Oct 25 21:32:08 user nova-compute[74189]:     </serial>
Oct 25 21:32:08 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:32:08 user nova-compute[74189]:     <video>
Oct 25 21:32:08 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:32:08 user nova-compute[74189]:     </video>
Oct 25 21:32:08 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:32:08 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:32:08 user nova-compute[74189]:     </rng>
Oct 25 21:32:08 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:32:08 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:32:08 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:32:08 user nova-compute[74189]:     </memballoon>
Oct 25 21:32:08 user nova-compute[74189]:   </devices>
Oct 25 21:32:08 user nova-compute[74189]: </domain>
Oct 25 21:32:08 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:32:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-717191026',display_name='tempest-AttachVolumeNegativeTest-server-717191026',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-717191026',id=34,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaZBQVPTVIl2ipvGJpaWqLEGx1boENHN7YXzPrs+0udCCKTslQOy+jjZ9V6SajU2MGVKy4Ms5DnWxfgfANdB91ltMLp8UPK14+gEAcO1McCRa23cMb0uQqtf99fPNLzhg==',key_name='tempest-keypair-680322332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a555d708aa644d586d5edad7db837b4',ramdisk_id='',reservation_id='r-bgsv698b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-979681322',owner_user_name='tempest-AttachVolumeNegativeTest-979681322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:32:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2f19a398fd9486fbef04eebad62a0cb',uuid=a393d263-97a8-4103-a9b4-866b5d6fc435,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22b40255-2ff7-4639-8c10-0959ac5f5917", "address": "fa:16:3e:26:05:ef", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b40255-2f", "ovs_interfaceid": "22b40255-2ff7-4639-8c10-0959ac5f5917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Converting VIF {"id": "22b40255-2ff7-4639-8c10-0959ac5f5917", "address": "fa:16:3e:26:05:ef", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b40255-2f", "ovs_interfaceid": "22b40255-2ff7-4639-8c10-0959ac5f5917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:05:ef,bridge_name='br-int',has_traffic_filtering=True,id=22b40255-2ff7-4639-8c10-0959ac5f5917,network=Network(5029031b-e67b-4f60-bc17-781cbdc88b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b40255-2f') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG os_vif [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:05:ef,bridge_name='br-int',has_traffic_filtering=True,id=22b40255-2ff7-4639-8c10-0959ac5f5917,network=Network(5029031b-e67b-4f60-bc17-781cbdc88b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b40255-2f') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: a57b1185-270e-40d0-a55e-986960826169] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e052c17d-a968-5c43-b2ab-c39c85390da2', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.compute.manager [req-e100df2b-97e5-444c-8a19-3dc2285db87e req-f0b2b57d-703f-4380-aff3-c9e92cb6d693 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received event network-vif-deleted-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:32:08 user nova-compute[74189]: INFO nova.compute.manager [req-e100df2b-97e5-444c-8a19-3dc2285db87e req-f0b2b57d-703f-4380-aff3-c9e92cb6d693 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Neutron deleted interface ecc4dd08-df4f-445b-81eb-b3946804aef8; detaching it from the instance and deleting it from the info cache
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.network.neutron [req-e100df2b-97e5-444c-8a19-3dc2285db87e req-f0b2b57d-703f-4380-aff3-c9e92cb6d693 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:32:08 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: a57b1185-270e-40d0-a55e-986960826169] Took 1.26 seconds to deallocate network for instance.
Oct 25 21:32:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22b40255-2f, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22b40255-2f, col_values=(('qos', UUID('6927507a-a8ad-477f-ac3f-bda25076cd3f')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22b40255-2f, col_values=(('external_ids', {'iface-id': '22b40255-2ff7-4639-8c10-0959ac5f5917', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:05:ef', 'vm-uuid': 'a393d263-97a8-4103-a9b4-866b5d6fc435'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:08 user nova-compute[74189]: INFO os_vif [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:05:ef,bridge_name='br-int',has_traffic_filtering=True,id=22b40255-2ff7-4639-8c10-0959ac5f5917,network=Network(5029031b-e67b-4f60-bc17-781cbdc88b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b40255-2f')
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.compute.manager [req-e100df2b-97e5-444c-8a19-3dc2285db87e req-f0b2b57d-703f-4380-aff3-c9e92cb6d693 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Detach interface failed, port_id=ecc4dd08-df4f-445b-81eb-b3946804aef8, reason: Instance a57b1185-270e-40d0-a55e-986960826169 could not be found. {{(pid=74189) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-28304a7f-641b-470a-a4a3-b69f26a8d8d5 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-28304a7f-641b-470a-a4a3-b69f26a8d8d5 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] No VIF found with MAC fa:16:3e:26:05:ef, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.compute.manager [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received event network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] Acquiring lock "a57b1185-270e-40d0-a55e-986960826169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] Lock "a57b1185-270e-40d0-a55e-986960826169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] Lock "a57b1185-270e-40d0-a55e-986960826169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.compute.manager [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] No waiting events found dispatching network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:32:08 user nova-compute[74189]: WARNING nova.compute.manager [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received unexpected event network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 for instance with vm_state deleted and task_state None.
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.compute.manager [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received event network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] Acquiring lock "a57b1185-270e-40d0-a55e-986960826169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] Lock "a57b1185-270e-40d0-a55e-986960826169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] Lock "a57b1185-270e-40d0-a55e-986960826169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.compute.manager [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] No waiting events found dispatching network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:32:08 user nova-compute[74189]: WARNING nova.compute.manager [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received unexpected event network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 for instance with vm_state deleted and task_state None.
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.compute.manager [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received event network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] Acquiring lock "a57b1185-270e-40d0-a55e-986960826169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] Lock "a57b1185-270e-40d0-a55e-986960826169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] Lock "a57b1185-270e-40d0-a55e-986960826169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.compute.manager [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] No waiting events found dispatching network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:32:08 user nova-compute[74189]: WARNING nova.compute.manager [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received unexpected event network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 for instance with vm_state deleted and task_state None.
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.compute.manager [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Received event network-changed-22b40255-2ff7-4639-8c10-0959ac5f5917 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.compute.manager [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Refreshing instance network info cache due to event network-changed-22b40255-2ff7-4639-8c10-0959ac5f5917. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] Acquiring lock "refresh_cache-a393d263-97a8-4103-a9b4-866b5d6fc435" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] Acquired lock "refresh_cache-a393d263-97a8-4103-a9b4-866b5d6fc435" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:32:08 user nova-compute[74189]: DEBUG nova.network.neutron [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Refreshing network info cache for port 22b40255-2ff7-4639-8c10-0959ac5f5917 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:32:09 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-28304a7f-641b-470a-a4a3-b69f26a8d8d5 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:32:09 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-28304a7f-641b-470a-a4a3-b69f26a8d8d5 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:32:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-28304a7f-641b-470a-a4a3-b69f26a8d8d5 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:09 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-28304a7f-641b-470a-a4a3-b69f26a8d8d5 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Deleted allocations for instance a57b1185-270e-40d0-a55e-986960826169
Oct 25 21:32:09 user nova-compute[74189]: DEBUG nova.network.neutron [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Updated VIF entry in instance network info cache for port 22b40255-2ff7-4639-8c10-0959ac5f5917. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:32:09 user nova-compute[74189]: DEBUG nova.network.neutron [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Updating instance_info_cache with network_info: [{"id": "22b40255-2ff7-4639-8c10-0959ac5f5917", "address": "fa:16:3e:26:05:ef", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b40255-2f", "ovs_interfaceid": "22b40255-2ff7-4639-8c10-0959ac5f5917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:32:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-28304a7f-641b-470a-a4a3-b69f26a8d8d5 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "a57b1185-270e-40d0-a55e-986960826169" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.108s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] Releasing lock "refresh_cache-a393d263-97a8-4103-a9b4-866b5d6fc435" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:32:09 user nova-compute[74189]: DEBUG nova.compute.manager [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received event network-vif-unplugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:32:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] Acquiring lock "a57b1185-270e-40d0-a55e-986960826169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] Lock "a57b1185-270e-40d0-a55e-986960826169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] Lock "a57b1185-270e-40d0-a55e-986960826169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:09 user nova-compute[74189]: DEBUG nova.compute.manager [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] No waiting events found dispatching network-vif-unplugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:32:09 user nova-compute[74189]: WARNING nova.compute.manager [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received unexpected event network-vif-unplugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 for instance with vm_state deleted and task_state None.
Oct 25 21:32:09 user nova-compute[74189]: DEBUG nova.compute.manager [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received event network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:32:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] Acquiring lock "a57b1185-270e-40d0-a55e-986960826169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] Lock "a57b1185-270e-40d0-a55e-986960826169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] Lock "a57b1185-270e-40d0-a55e-986960826169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:09 user nova-compute[74189]: DEBUG nova.compute.manager [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] No waiting events found dispatching network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:32:09 user nova-compute[74189]: WARNING nova.compute.manager [req-040e0ac9-e1da-4da6-aaf5-4e2b2d6f50ed req-b22d5f43-dbf5-4ad2-8876-aaff5dd02289 service nova] [instance: a57b1185-270e-40d0-a55e-986960826169] Received unexpected event network-vif-plugged-ecc4dd08-df4f-445b-81eb-b3946804aef8 for instance with vm_state deleted and task_state None.
Oct 25 21:32:09 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:32:09 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:32:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-0b4f80c4-98cc-440a-aac7-cd423b71a231" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:32:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-0b4f80c4-98cc-440a-aac7-cd423b71a231" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:32:09 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:32:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:10 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Updating instance_info_cache with network_info: [{"id": "ea4ece99-327d-46c3-9b70-762c2ceafa61", "address": "fa:16:3e:3f:e7:2a", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4ece99-32", "ovs_interfaceid": "ea4ece99-327d-46c3-9b70-762c2ceafa61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:32:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-0b4f80c4-98cc-440a-aac7-cd423b71a231" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:32:10 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:32:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:10 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:32:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:10 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:32:10 user nova-compute[74189]: DEBUG nova.compute.manager [req-7597e7a0-8a4e-489f-81db-b17c0c9f5fa6 req-babff347-64fa-4ae7-b3f2-534319e98ec1 service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Received event network-vif-plugged-22b40255-2ff7-4639-8c10-0959ac5f5917 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:32:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7597e7a0-8a4e-489f-81db-b17c0c9f5fa6 req-babff347-64fa-4ae7-b3f2-534319e98ec1 service nova] Acquiring lock "a393d263-97a8-4103-a9b4-866b5d6fc435-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7597e7a0-8a4e-489f-81db-b17c0c9f5fa6 req-babff347-64fa-4ae7-b3f2-534319e98ec1 service nova] Lock "a393d263-97a8-4103-a9b4-866b5d6fc435-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7597e7a0-8a4e-489f-81db-b17c0c9f5fa6 req-babff347-64fa-4ae7-b3f2-534319e98ec1 service nova] Lock "a393d263-97a8-4103-a9b4-866b5d6fc435-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:10 user nova-compute[74189]: DEBUG nova.compute.manager [req-7597e7a0-8a4e-489f-81db-b17c0c9f5fa6 req-babff347-64fa-4ae7-b3f2-534319e98ec1 service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] No waiting events found dispatching network-vif-plugged-22b40255-2ff7-4639-8c10-0959ac5f5917 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:32:10 user nova-compute[74189]: WARNING nova.compute.manager [req-7597e7a0-8a4e-489f-81db-b17c0c9f5fa6 req-babff347-64fa-4ae7-b3f2-534319e98ec1 service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Received unexpected event network-vif-plugged-22b40255-2ff7-4639-8c10-0959ac5f5917 for instance with vm_state building and task_state spawning.
Oct 25 21:32:10 user nova-compute[74189]: DEBUG nova.compute.manager [req-7597e7a0-8a4e-489f-81db-b17c0c9f5fa6 req-babff347-64fa-4ae7-b3f2-534319e98ec1 service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Received event network-vif-plugged-22b40255-2ff7-4639-8c10-0959ac5f5917 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:32:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7597e7a0-8a4e-489f-81db-b17c0c9f5fa6 req-babff347-64fa-4ae7-b3f2-534319e98ec1 service nova] Acquiring lock "a393d263-97a8-4103-a9b4-866b5d6fc435-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7597e7a0-8a4e-489f-81db-b17c0c9f5fa6 req-babff347-64fa-4ae7-b3f2-534319e98ec1 service nova] Lock "a393d263-97a8-4103-a9b4-866b5d6fc435-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7597e7a0-8a4e-489f-81db-b17c0c9f5fa6 req-babff347-64fa-4ae7-b3f2-534319e98ec1 service nova] Lock "a393d263-97a8-4103-a9b4-866b5d6fc435-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:10 user nova-compute[74189]: DEBUG nova.compute.manager [req-7597e7a0-8a4e-489f-81db-b17c0c9f5fa6 req-babff347-64fa-4ae7-b3f2-534319e98ec1 service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] No waiting events found dispatching network-vif-plugged-22b40255-2ff7-4639-8c10-0959ac5f5917 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:32:10 user nova-compute[74189]: WARNING nova.compute.manager [req-7597e7a0-8a4e-489f-81db-b17c0c9f5fa6 req-babff347-64fa-4ae7-b3f2-534319e98ec1 service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Received unexpected event network-vif-plugged-22b40255-2ff7-4639-8c10-0959ac5f5917 for instance with vm_state building and task_state spawning.
Oct 25 21:32:12 user nova-compute[74189]: DEBUG nova.compute.manager [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:32:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:32:12 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Instance spawned successfully.
Oct 25 21:32:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:32:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:32:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:32:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:32:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:32:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:32:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:32:12 user nova-compute[74189]: INFO nova.compute.manager [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Took 6.99 seconds to spawn the instance on the hypervisor.
Oct 25 21:32:12 user nova-compute[74189]: DEBUG nova.compute.manager [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:32:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:32:12 user nova-compute[74189]: INFO nova.compute.manager [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Took 7.82 seconds to build instance.
Oct 25 21:32:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-57e5162a-a015-4410-ba85-c1b93a93a366 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "a393d263-97a8-4103-a9b4-866b5d6fc435" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.929s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:32:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:32:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:32:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a393d263-97a8-4103-a9b4-866b5d6fc435/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:32:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a393d263-97a8-4103-a9b4-866b5d6fc435/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:32:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a393d263-97a8-4103-a9b4-866b5d6fc435/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:32:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a393d263-97a8-4103-a9b4-866b5d6fc435/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:32:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:32:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:32:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:32:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:32:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:32:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:32:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:32:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:32:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:32:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:32:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:32:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:32:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:32:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:32:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:32:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:32:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:32:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:32:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:32:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:32:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:32:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:32:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:32:15 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:32:15 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:32:15 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=7484MB free_disk=24.926868438720703GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:32:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:16 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance d7c3a99a-ab38-4e88-896d-94ae51a09a48 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:32:16 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance af1d7b3c-9950-4b74-8f15-b31011ccfa24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:32:16 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 932fe8ac-fdde-45c6-aa32-9bf866f19a4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:32:16 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 0b4f80c4-98cc-440a-aac7-cd423b71a231 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:32:16 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance cdb13b8f-c136-4f2b-95b9-e464babac28a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:32:16 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 9733d5c8-4476-4903-bd1b-16d43a54fdbd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:32:16 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance d6e14e1a-6ef7-4a47-afc7-096326de8f5e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:32:16 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:32:16 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3da14c0a-31a8-4fe3-bd5a-49378680af50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:32:16 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance a393d263-97a8-4103-a9b4-866b5d6fc435 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:32:16 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:32:16 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:32:16 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:32:16 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:32:16 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:32:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.536s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:17 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:32:17 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:32:17 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:32:17 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:32:17 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:32:17 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:32:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:19 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:32:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:32 user nova-compute[74189]: DEBUG nova.compute.manager [req-b3eb34d0-6dc1-4a31-b6c7-d8123d376f93 req-8a34e7c7-5bb0-45ad-b853-d253b806c633 service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Received event network-changed-1d25f7eb-3650-4049-a6b9-4fe9ff701593 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:32:32 user nova-compute[74189]: DEBUG nova.compute.manager [req-b3eb34d0-6dc1-4a31-b6c7-d8123d376f93 req-8a34e7c7-5bb0-45ad-b853-d253b806c633 service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Refreshing instance network info cache due to event network-changed-1d25f7eb-3650-4049-a6b9-4fe9ff701593. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:32:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b3eb34d0-6dc1-4a31-b6c7-d8123d376f93 req-8a34e7c7-5bb0-45ad-b853-d253b806c633 service nova] Acquiring lock "refresh_cache-d6e14e1a-6ef7-4a47-afc7-096326de8f5e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:32:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b3eb34d0-6dc1-4a31-b6c7-d8123d376f93 req-8a34e7c7-5bb0-45ad-b853-d253b806c633 service nova] Acquired lock "refresh_cache-d6e14e1a-6ef7-4a47-afc7-096326de8f5e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:32:32 user nova-compute[74189]: DEBUG nova.network.neutron [req-b3eb34d0-6dc1-4a31-b6c7-d8123d376f93 req-8a34e7c7-5bb0-45ad-b853-d253b806c633 service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Refreshing network info cache for port 1d25f7eb-3650-4049-a6b9-4fe9ff701593 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:32:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Acquiring lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Acquiring lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:32 user nova-compute[74189]: INFO nova.compute.manager [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Terminating instance
Oct 25 21:32:32 user nova-compute[74189]: DEBUG nova.compute.manager [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:32:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:32 user nova-compute[74189]: DEBUG nova.compute.manager [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:32:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:32 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:32:32 user nova-compute[74189]: INFO nova.compute.claims [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Claim successful on node user
Oct 25 21:32:32 user nova-compute[74189]: DEBUG nova.compute.manager [req-aa4a56e5-bfd4-4315-b99e-a6dd2ba95653 req-4a19672b-c698-4846-ac65-0b26cbd6838b service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Received event network-vif-unplugged-1d25f7eb-3650-4049-a6b9-4fe9ff701593 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:32:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-aa4a56e5-bfd4-4315-b99e-a6dd2ba95653 req-4a19672b-c698-4846-ac65-0b26cbd6838b service nova] Acquiring lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-aa4a56e5-bfd4-4315-b99e-a6dd2ba95653 req-4a19672b-c698-4846-ac65-0b26cbd6838b service nova] Lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-aa4a56e5-bfd4-4315-b99e-a6dd2ba95653 req-4a19672b-c698-4846-ac65-0b26cbd6838b service nova] Lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:32 user nova-compute[74189]: DEBUG nova.compute.manager [req-aa4a56e5-bfd4-4315-b99e-a6dd2ba95653 req-4a19672b-c698-4846-ac65-0b26cbd6838b service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] No waiting events found dispatching network-vif-unplugged-1d25f7eb-3650-4049-a6b9-4fe9ff701593 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:32:32 user nova-compute[74189]: DEBUG nova.compute.manager [req-aa4a56e5-bfd4-4315-b99e-a6dd2ba95653 req-4a19672b-c698-4846-ac65-0b26cbd6838b service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Received event network-vif-unplugged-1d25f7eb-3650-4049-a6b9-4fe9ff701593 for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:32:32 user nova-compute[74189]: DEBUG nova.network.neutron [req-b3eb34d0-6dc1-4a31-b6c7-d8123d376f93 req-8a34e7c7-5bb0-45ad-b853-d253b806c633 service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Updated VIF entry in instance network info cache for port 1d25f7eb-3650-4049-a6b9-4fe9ff701593. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:32:32 user nova-compute[74189]: DEBUG nova.network.neutron [req-b3eb34d0-6dc1-4a31-b6c7-d8123d376f93 req-8a34e7c7-5bb0-45ad-b853-d253b806c633 service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Updating instance_info_cache with network_info: [{"id": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "address": "fa:16:3e:58:36:23", "network": {"id": "1fce8fb6-f20e-4de3-80ec-3d74154c0e23", "bridge": "br-int", "label": "tempest-TestShelveInstance-1146708282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef48aafc7b54ce5aeda52b0b52f2714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d25f7eb-36", "ovs_interfaceid": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:32:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b3eb34d0-6dc1-4a31-b6c7-d8123d376f93 req-8a34e7c7-5bb0-45ad-b853-d253b806c633 service nova] Releasing lock "refresh_cache-d6e14e1a-6ef7-4a47-afc7-096326de8f5e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:32:33 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Instance destroyed successfully.
Oct 25 21:32:33 user nova-compute[74189]: DEBUG nova.objects.instance [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lazy-loading 'resources' on Instance uuid d6e14e1a-6ef7-4a47-afc7-096326de8f5e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T21:26:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1213251010',display_name='tempest-TestShelveInstance-server-1213251010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1213251010',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNqUIHf3I8RhYrvivy/tUrkctgg0VuWe78qUcgCaXcqN8tRyHKb0x17tdtbNu6jPaS71Or0GKwjH1tiyjOQJpFf+EUe1BDFHzAeH5wwreHNU2pAmWFu7FPqZaEfm+f0xA==',key_name='tempest-TestShelveInstance-290074196',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:31:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ef48aafc7b54ce5aeda52b0b52f2714',ramdisk_id='',reservation_id='r-fduvh40c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-715930903',owner_user_name='tempest-TestShelveInstance-715930903-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:31:22Z,user_data=None,user_id='0a958107c53f4eeb832f6040969c8a24',uuid=d6e14e1a-6ef7-4a47-afc7-096326de8f5e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "address": "fa:16:3e:58:36:23", "network": {"id": "1fce8fb6-f20e-4de3-80ec-3d74154c0e23", "bridge": "br-int", "label": "tempest-TestShelveInstance-1146708282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef48aafc7b54ce5aeda52b0b52f2714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d25f7eb-36", "ovs_interfaceid": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Converting VIF {"id": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "address": "fa:16:3e:58:36:23", "network": {"id": "1fce8fb6-f20e-4de3-80ec-3d74154c0e23", "bridge": "br-int", "label": "tempest-TestShelveInstance-1146708282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef48aafc7b54ce5aeda52b0b52f2714", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d25f7eb-36", "ovs_interfaceid": "1d25f7eb-3650-4049-a6b9-4fe9ff701593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:36:23,bridge_name='br-int',has_traffic_filtering=True,id=1d25f7eb-3650-4049-a6b9-4fe9ff701593,network=Network(1fce8fb6-f20e-4de3-80ec-3d74154c0e23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d25f7eb-36') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG os_vif [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:36:23,bridge_name='br-int',has_traffic_filtering=True,id=1d25f7eb-3650-4049-a6b9-4fe9ff701593,network=Network(1fce8fb6-f20e-4de3-80ec-3d74154c0e23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d25f7eb-36') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d25f7eb-36, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG nova.compute.manager [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=776798df-139f-4225-9147-8f0045eb4800) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:33 user nova-compute[74189]: INFO os_vif [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:36:23,bridge_name='br-int',has_traffic_filtering=True,id=1d25f7eb-3650-4049-a6b9-4fe9ff701593,network=Network(1fce8fb6-f20e-4de3-80ec-3d74154c0e23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d25f7eb-36')
Oct 25 21:32:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bBkaEFvy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:32:33 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:32:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[59570841-0d4b-41a1-9630-7d8e128b6fa1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:32:33 user nova-compute[74189]: No targets found.
Oct 25 21:32:33 user nova-compute[74189]: iSNS:
Oct 25 21:32:33 user nova-compute[74189]: No targets found.
Oct 25 21:32:33 user nova-compute[74189]: STATIC:
Oct 25 21:32:33 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce
Oct 25 21:32:33 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:32:33 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:32:33 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e
Oct 25 21:32:33 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:32:33 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:32:33 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:32:33 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:32:33 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:32:33 user nova-compute[74189]: FIRMWARE:
Oct 25 21:32:33 user nova-compute[74189]: No targets found.
Oct 25 21:32:33 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:32:33 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:32:33 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG nova.compute.manager [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG nova.network.neutron [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff98e0d-9a96-484b-b896-c83a420ec668]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:32:33 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:32:33 user nova-compute[74189]: DEBUG nova.compute.manager [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7c2a34-35c5-4b60-9081-4b6e6c0426bf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:32:33 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:32:33 user nova-compute[74189]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:32:33 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:32:33 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:32:33 user nova-compute[74189]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e (non-flash)
Oct 25 21:32:33 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2e41a17e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e'): ({'sdc'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Removing single pathed devices sdc {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb66f47-96df-4149-90e6-2c5c2164a179]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a081a6-6ddf-4b4d-a963-3975e23b4a79]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Flushing IO for device /dev/sdc {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG nova.policy [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e55da2b7458469e844fad1fe95cb695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d0f1deb7f04244920dae579032b287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccb42f8-9864-4bc0-abba-5da2a2de749f]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG nova.compute.manager [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:32:33 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Creating image(s)
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "/opt/stack/data/nova/instances/0da9f3bb-fbf4-4f9a-929f-0d223101b29e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "/opt/stack/data/nova/instances/0da9f3bb-fbf4-4f9a-929f-0d223101b29e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "/opt/stack/data/nova/instances/0da9f3bb-fbf4-4f9a-929f-0d223101b29e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b0c55b-6ca6-49f4-b8d4-cbc07e21cc00]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] SCSI volumes sdc have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d8973c-3bbd-47a9-9f49-8c3f77fb3fc8]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe5ea8c-328e-4665-bc67-84b0d354bcc2]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e, portal: 172.16.0.220,3260]
Oct 25 21:32:33 user nova-compute[74189]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e, portal: 172.16.0.220,3260] successful.
Oct 25 21:32:33 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e76a8bc1-8695-4085-874e-c1575956d75e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2145ac40-d2b1-4955-9e0b-a027a81640aa]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] <== disconnect_volume: return (380ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:32:33 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Deleting instance files /opt/stack/data/nova/instances/d6e14e1a-6ef7-4a47-afc7-096326de8f5e_del
Oct 25 21:32:33 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Deletion of /opt/stack/data/nova/instances/d6e14e1a-6ef7-4a47-afc7-096326de8f5e_del complete
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.191s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:32:33 user nova-compute[74189]: INFO nova.compute.manager [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Took 1.39 seconds to destroy the instance on the hypervisor.
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.173s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/0da9f3bb-fbf4-4f9a-929f-0d223101b29e/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/0da9f3bb-fbf4-4f9a-929f-0d223101b29e/disk 1073741824" returned: 0 in 0.104s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:32:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.179s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:32:34 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0da9f3bb-fbf4-4f9a-929f-0d223101b29e/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:32:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0da9f3bb-fbf4-4f9a-929f-0d223101b29e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:32:34 user nova-compute[74189]: DEBUG nova.network.neutron [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Successfully created port: 51ff1ff4-83d4-4393-81e2-750670c4af18 {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:32:34 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:32:34 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Took 0.50 seconds to deallocate network for instance.
Oct 25 21:32:34 user nova-compute[74189]: DEBUG nova.compute.manager [req-1727dc0c-f887-4122-875d-a36e3d83c29d req-989c723b-3467-4652-b5cc-bffbb8653305 service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Received event network-vif-deleted-1d25f7eb-3650-4049-a6b9-4fe9ff701593 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:32:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0da9f3bb-fbf4-4f9a-929f-0d223101b29e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:32:34 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Cannot resize image /opt/stack/data/nova/instances/0da9f3bb-fbf4-4f9a-929f-0d223101b29e/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:32:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:32:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Ensure instance console log exists: /opt/stack/data/nova/instances/0da9f3bb-fbf4-4f9a-929f-0d223101b29e/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:32:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:34 user nova-compute[74189]: DEBUG nova.compute.manager [req-cac9b9a8-93f6-43c0-92df-cfc0182f6acc req-a2b35479-e428-4f6e-b130-20433edec0f5 service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Received event network-vif-plugged-1d25f7eb-3650-4049-a6b9-4fe9ff701593 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:32:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-cac9b9a8-93f6-43c0-92df-cfc0182f6acc req-a2b35479-e428-4f6e-b130-20433edec0f5 service nova] Acquiring lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-cac9b9a8-93f6-43c0-92df-cfc0182f6acc req-a2b35479-e428-4f6e-b130-20433edec0f5 service nova] Lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-cac9b9a8-93f6-43c0-92df-cfc0182f6acc req-a2b35479-e428-4f6e-b130-20433edec0f5 service nova] Lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:34 user nova-compute[74189]: DEBUG nova.compute.manager [req-cac9b9a8-93f6-43c0-92df-cfc0182f6acc req-a2b35479-e428-4f6e-b130-20433edec0f5 service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] No waiting events found dispatching network-vif-plugged-1d25f7eb-3650-4049-a6b9-4fe9ff701593 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:32:34 user nova-compute[74189]: WARNING nova.compute.manager [req-cac9b9a8-93f6-43c0-92df-cfc0182f6acc req-a2b35479-e428-4f6e-b130-20433edec0f5 service nova] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Received unexpected event network-vif-plugged-1d25f7eb-3650-4049-a6b9-4fe9ff701593 for instance with vm_state active and task_state deleting.
Oct 25 21:32:34 user nova-compute[74189]: DEBUG nova.network.neutron [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Successfully updated port: 51ff1ff4-83d4-4393-81e2-750670c4af18 {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:32:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "refresh_cache-0da9f3bb-fbf4-4f9a-929f-0d223101b29e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:32:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquired lock "refresh_cache-0da9f3bb-fbf4-4f9a-929f-0d223101b29e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:32:34 user nova-compute[74189]: DEBUG nova.network.neutron [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:32:34 user nova-compute[74189]: DEBUG nova.compute.manager [req-d9305a9e-6eec-4b2a-9b4f-3bad0d6ad9a8 req-4c035a32-06e5-4aa5-9004-b5c7831240ec service nova] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Received event network-changed-51ff1ff4-83d4-4393-81e2-750670c4af18 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:32:34 user nova-compute[74189]: DEBUG nova.compute.manager [req-d9305a9e-6eec-4b2a-9b4f-3bad0d6ad9a8 req-4c035a32-06e5-4aa5-9004-b5c7831240ec service nova] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Refreshing instance network info cache due to event network-changed-51ff1ff4-83d4-4393-81e2-750670c4af18. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:32:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d9305a9e-6eec-4b2a-9b4f-3bad0d6ad9a8 req-4c035a32-06e5-4aa5-9004-b5c7831240ec service nova] Acquiring lock "refresh_cache-0da9f3bb-fbf4-4f9a-929f-0d223101b29e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:32:34 user nova-compute[74189]: DEBUG nova.network.neutron [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:32:35 user nova-compute[74189]: INFO nova.compute.manager [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Took 0.86 seconds to detach 1 volumes for instance.
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.compute.manager [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] [instance: d6e14e1a-6ef7-4a47-afc7-096326de8f5e] Deleting volume: e76a8bc1-8695-4085-874e-c1575956d75e {{(pid=74189) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.network.neutron [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Updating instance_info_cache with network_info: [{"id": "51ff1ff4-83d4-4393-81e2-750670c4af18", "address": "fa:16:3e:1b:34:34", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ff1ff4-83", "ovs_interfaceid": "51ff1ff4-83d4-4393-81e2-750670c4af18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Releasing lock "refresh_cache-0da9f3bb-fbf4-4f9a-929f-0d223101b29e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.compute.manager [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Instance network_info: |[{"id": "51ff1ff4-83d4-4393-81e2-750670c4af18", "address": "fa:16:3e:1b:34:34", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ff1ff4-83", "ovs_interfaceid": "51ff1ff4-83d4-4393-81e2-750670c4af18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d9305a9e-6eec-4b2a-9b4f-3bad0d6ad9a8 req-4c035a32-06e5-4aa5-9004-b5c7831240ec service nova] Acquired lock "refresh_cache-0da9f3bb-fbf4-4f9a-929f-0d223101b29e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.network.neutron [req-d9305a9e-6eec-4b2a-9b4f-3bad0d6ad9a8 req-4c035a32-06e5-4aa5-9004-b5c7831240ec service nova] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Refreshing network info cache for port 51ff1ff4-83d4-4393-81e2-750670c4af18 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Start _get_guest_xml network_info=[{"id": "51ff1ff4-83d4-4393-81e2-750670c4af18", "address": "fa:16:3e:1b:34:34", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ff1ff4-83", "ovs_interfaceid": "51ff1ff4-83d4-4393-81e2-750670c4af18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:32:35 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:32:35 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:32:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1238988633',display_name='tempest-AttachVolumeTestJSON-server-1238988633',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1238988633',id=35,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvvThZVIBq0Qv91G5mDXh1sOqIjUqxTIaJWbDtFw/xZTDwb8rtrc8He+Vjks+8c64acBJo7uGay0WgpMIAXhaQcEPLqIn9lTRwM4MXkHxLMtD081o+/22xwOohMZAFX+Q==',key_name='tempest-keypair-1327357363',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1d0f1deb7f04244920dae579032b287',ramdisk_id='',reservation_id='r-23eib0r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1213560671',owner_user_name='tempest-AttachVolumeTestJSON-1213560671-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:32:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e55da2b7458469e844fad1fe95cb695',uuid=0da9f3bb-fbf4-4f9a-929f-0d223101b29e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51ff1ff4-83d4-4393-81e2-750670c4af18", "address": "fa:16:3e:1b:34:34", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ff1ff4-83", "ovs_interfaceid": "51ff1ff4-83d4-4393-81e2-750670c4af18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Converting VIF {"id": "51ff1ff4-83d4-4393-81e2-750670c4af18", "address": "fa:16:3e:1b:34:34", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ff1ff4-83", "ovs_interfaceid": "51ff1ff4-83d4-4393-81e2-750670c4af18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:34:34,bridge_name='br-int',has_traffic_filtering=True,id=51ff1ff4-83d4-4393-81e2-750670c4af18,network=Network(1d219ea7-a949-4c77-9cd1-79cc99d6ac42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ff1ff4-83') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.objects.instance [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lazy-loading 'pci_devices' on Instance uuid 0da9f3bb-fbf4-4f9a-929f-0d223101b29e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:32:35 user nova-compute[74189]:   <uuid>0da9f3bb-fbf4-4f9a-929f-0d223101b29e</uuid>
Oct 25 21:32:35 user nova-compute[74189]:   <name>instance-00000023</name>
Oct 25 21:32:35 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:32:35 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:32:35 user nova-compute[74189]:   <metadata>
Oct 25 21:32:35 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:32:35 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:32:35 user nova-compute[74189]:       <nova:name>tempest-AttachVolumeTestJSON-server-1238988633</nova:name>
Oct 25 21:32:35 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:32:35</nova:creationTime>
Oct 25 21:32:35 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:32:35 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:32:35 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:32:35 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:32:35 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:32:35 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:32:35 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:32:35 user nova-compute[74189]:       <nova:owner>
Oct 25 21:32:35 user nova-compute[74189]:         <nova:user uuid="9e55da2b7458469e844fad1fe95cb695">tempest-AttachVolumeTestJSON-1213560671-project-member</nova:user>
Oct 25 21:32:35 user nova-compute[74189]:         <nova:project uuid="d1d0f1deb7f04244920dae579032b287">tempest-AttachVolumeTestJSON-1213560671</nova:project>
Oct 25 21:32:35 user nova-compute[74189]:       </nova:owner>
Oct 25 21:32:35 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:32:35 user nova-compute[74189]:       <nova:ports>
Oct 25 21:32:35 user nova-compute[74189]:         <nova:port uuid="51ff1ff4-83d4-4393-81e2-750670c4af18">
Oct 25 21:32:35 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 25 21:32:35 user nova-compute[74189]:         </nova:port>
Oct 25 21:32:35 user nova-compute[74189]:       </nova:ports>
Oct 25 21:32:35 user nova-compute[74189]:     </nova:instance>
Oct 25 21:32:35 user nova-compute[74189]:   </metadata>
Oct 25 21:32:35 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:32:35 user nova-compute[74189]:     <system>
Oct 25 21:32:35 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:32:35 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:32:35 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:32:35 user nova-compute[74189]:       <entry name="serial">0da9f3bb-fbf4-4f9a-929f-0d223101b29e</entry>
Oct 25 21:32:35 user nova-compute[74189]:       <entry name="uuid">0da9f3bb-fbf4-4f9a-929f-0d223101b29e</entry>
Oct 25 21:32:35 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:32:35 user nova-compute[74189]:     </system>
Oct 25 21:32:35 user nova-compute[74189]:   </sysinfo>
Oct 25 21:32:35 user nova-compute[74189]:   <os>
Oct 25 21:32:35 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:32:35 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:32:35 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:32:35 user nova-compute[74189]:   </os>
Oct 25 21:32:35 user nova-compute[74189]:   <features>
Oct 25 21:32:35 user nova-compute[74189]:     <acpi/>
Oct 25 21:32:35 user nova-compute[74189]:     <apic/>
Oct 25 21:32:35 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:32:35 user nova-compute[74189]:   </features>
Oct 25 21:32:35 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:32:35 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:32:35 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:32:35 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:32:35 user nova-compute[74189]:   </clock>
Oct 25 21:32:35 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:32:35 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:32:35 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:32:35 user nova-compute[74189]:   </cpu>
Oct 25 21:32:35 user nova-compute[74189]:   <devices>
Oct 25 21:32:35 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:32:35 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:32:35 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/0da9f3bb-fbf4-4f9a-929f-0d223101b29e/disk"/>
Oct 25 21:32:35 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:32:35 user nova-compute[74189]:     </disk>
Oct 25 21:32:35 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:32:35 user nova-compute[74189]:       <mac address="fa:16:3e:1b:34:34"/>
Oct 25 21:32:35 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:32:35 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:32:35 user nova-compute[74189]:       <target dev="tap51ff1ff4-83"/>
Oct 25 21:32:35 user nova-compute[74189]:     </interface>
Oct 25 21:32:35 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:32:35 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/0da9f3bb-fbf4-4f9a-929f-0d223101b29e/console.log" append="off"/>
Oct 25 21:32:35 user nova-compute[74189]:     </serial>
Oct 25 21:32:35 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:32:35 user nova-compute[74189]:     <video>
Oct 25 21:32:35 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:32:35 user nova-compute[74189]:     </video>
Oct 25 21:32:35 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:32:35 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:32:35 user nova-compute[74189]:     </rng>
Oct 25 21:32:35 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:32:35 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:32:35 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:32:35 user nova-compute[74189]:     </memballoon>
Oct 25 21:32:35 user nova-compute[74189]:   </devices>
Oct 25 21:32:35 user nova-compute[74189]: </domain>
Oct 25 21:32:35 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:32:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1238988633',display_name='tempest-AttachVolumeTestJSON-server-1238988633',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1238988633',id=35,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvvThZVIBq0Qv91G5mDXh1sOqIjUqxTIaJWbDtFw/xZTDwb8rtrc8He+Vjks+8c64acBJo7uGay0WgpMIAXhaQcEPLqIn9lTRwM4MXkHxLMtD081o+/22xwOohMZAFX+Q==',key_name='tempest-keypair-1327357363',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1d0f1deb7f04244920dae579032b287',ramdisk_id='',reservation_id='r-23eib0r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1213560671',owner_user_name='tempest-AttachVolumeTestJSON-1213560671-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:32:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e55da2b7458469e844fad1fe95cb695',uuid=0da9f3bb-fbf4-4f9a-929f-0d223101b29e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51ff1ff4-83d4-4393-81e2-750670c4af18", "address": "fa:16:3e:1b:34:34", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ff1ff4-83", "ovs_interfaceid": "51ff1ff4-83d4-4393-81e2-750670c4af18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Converting VIF {"id": "51ff1ff4-83d4-4393-81e2-750670c4af18", "address": "fa:16:3e:1b:34:34", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ff1ff4-83", "ovs_interfaceid": "51ff1ff4-83d4-4393-81e2-750670c4af18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:34:34,bridge_name='br-int',has_traffic_filtering=True,id=51ff1ff4-83d4-4393-81e2-750670c4af18,network=Network(1d219ea7-a949-4c77-9cd1-79cc99d6ac42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ff1ff4-83') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG os_vif [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:34:34,bridge_name='br-int',has_traffic_filtering=True,id=51ff1ff4-83d4-4393-81e2-750670c4af18,network=Network(1d219ea7-a949-4c77-9cd1-79cc99d6ac42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ff1ff4-83') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '238e6ab0-2b11-5d3d-bfd5-f8c72b26c067', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51ff1ff4-83, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51ff1ff4-83, col_values=(('qos', UUID('b4800c11-f53e-4556-827f-50edcdff2c2a')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51ff1ff4-83, col_values=(('external_ids', {'iface-id': '51ff1ff4-83d4-4393-81e2-750670c4af18', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:34:34', 'vm-uuid': '0da9f3bb-fbf4-4f9a-929f-0d223101b29e'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:35 user nova-compute[74189]: INFO os_vif [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:34:34,bridge_name='br-int',has_traffic_filtering=True,id=51ff1ff4-83d4-4393-81e2-750670c4af18,network=Network(1d219ea7-a949-4c77-9cd1-79cc99d6ac42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ff1ff4-83')
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] No VIF found with MAC fa:16:3e:1b:34:34, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:35 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Deleted allocations for instance d6e14e1a-6ef7-4a47-afc7-096326de8f5e
Oct 25 21:32:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ac403671-c4fb-456b-984c-0dd920b61328 tempest-TestShelveInstance-715930903 tempest-TestShelveInstance-715930903-project-member] Lock "d6e14e1a-6ef7-4a47-afc7-096326de8f5e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.468s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.network.neutron [req-d9305a9e-6eec-4b2a-9b4f-3bad0d6ad9a8 req-4c035a32-06e5-4aa5-9004-b5c7831240ec service nova] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Updated VIF entry in instance network info cache for port 51ff1ff4-83d4-4393-81e2-750670c4af18. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.network.neutron [req-d9305a9e-6eec-4b2a-9b4f-3bad0d6ad9a8 req-4c035a32-06e5-4aa5-9004-b5c7831240ec service nova] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Updating instance_info_cache with network_info: [{"id": "51ff1ff4-83d4-4393-81e2-750670c4af18", "address": "fa:16:3e:1b:34:34", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ff1ff4-83", "ovs_interfaceid": "51ff1ff4-83d4-4393-81e2-750670c4af18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d9305a9e-6eec-4b2a-9b4f-3bad0d6ad9a8 req-4c035a32-06e5-4aa5-9004-b5c7831240ec service nova] Releasing lock "refresh_cache-0da9f3bb-fbf4-4f9a-929f-0d223101b29e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8251baba-3982-4ec7-bf10-7c3d401aacd7 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "cdb13b8f-c136-4f2b-95b9-e464babac28a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8251baba-3982-4ec7-bf10-7c3d401aacd7 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "cdb13b8f-c136-4f2b-95b9-e464babac28a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8251baba-3982-4ec7-bf10-7c3d401aacd7 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "cdb13b8f-c136-4f2b-95b9-e464babac28a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8251baba-3982-4ec7-bf10-7c3d401aacd7 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "cdb13b8f-c136-4f2b-95b9-e464babac28a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8251baba-3982-4ec7-bf10-7c3d401aacd7 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "cdb13b8f-c136-4f2b-95b9-e464babac28a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:35 user nova-compute[74189]: INFO nova.compute.manager [None req-8251baba-3982-4ec7-bf10-7c3d401aacd7 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Terminating instance
Oct 25 21:32:35 user nova-compute[74189]: DEBUG nova.compute.manager [None req-8251baba-3982-4ec7-bf10-7c3d401aacd7 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:36 user nova-compute[74189]: DEBUG nova.compute.manager [req-2759cc9b-d167-406a-9a91-76765f9c574c req-a3d86f39-5f99-45f0-a259-8e8795628056 service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Received event network-vif-unplugged-6a146bba-178b-4b17-be10-0410392d8b06 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:32:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2759cc9b-d167-406a-9a91-76765f9c574c req-a3d86f39-5f99-45f0-a259-8e8795628056 service nova] Acquiring lock "cdb13b8f-c136-4f2b-95b9-e464babac28a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2759cc9b-d167-406a-9a91-76765f9c574c req-a3d86f39-5f99-45f0-a259-8e8795628056 service nova] Lock "cdb13b8f-c136-4f2b-95b9-e464babac28a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2759cc9b-d167-406a-9a91-76765f9c574c req-a3d86f39-5f99-45f0-a259-8e8795628056 service nova] Lock "cdb13b8f-c136-4f2b-95b9-e464babac28a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:36 user nova-compute[74189]: DEBUG nova.compute.manager [req-2759cc9b-d167-406a-9a91-76765f9c574c req-a3d86f39-5f99-45f0-a259-8e8795628056 service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] No waiting events found dispatching network-vif-unplugged-6a146bba-178b-4b17-be10-0410392d8b06 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:32:36 user nova-compute[74189]: DEBUG nova.compute.manager [req-2759cc9b-d167-406a-9a91-76765f9c574c req-a3d86f39-5f99-45f0-a259-8e8795628056 service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Received event network-vif-unplugged-6a146bba-178b-4b17-be10-0410392d8b06 for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:32:36 user nova-compute[74189]: DEBUG nova.compute.manager [req-2759cc9b-d167-406a-9a91-76765f9c574c req-a3d86f39-5f99-45f0-a259-8e8795628056 service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Received event network-vif-plugged-6a146bba-178b-4b17-be10-0410392d8b06 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:32:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2759cc9b-d167-406a-9a91-76765f9c574c req-a3d86f39-5f99-45f0-a259-8e8795628056 service nova] Acquiring lock "cdb13b8f-c136-4f2b-95b9-e464babac28a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2759cc9b-d167-406a-9a91-76765f9c574c req-a3d86f39-5f99-45f0-a259-8e8795628056 service nova] Lock "cdb13b8f-c136-4f2b-95b9-e464babac28a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2759cc9b-d167-406a-9a91-76765f9c574c req-a3d86f39-5f99-45f0-a259-8e8795628056 service nova] Lock "cdb13b8f-c136-4f2b-95b9-e464babac28a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:36 user nova-compute[74189]: DEBUG nova.compute.manager [req-2759cc9b-d167-406a-9a91-76765f9c574c req-a3d86f39-5f99-45f0-a259-8e8795628056 service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] No waiting events found dispatching network-vif-plugged-6a146bba-178b-4b17-be10-0410392d8b06 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:32:36 user nova-compute[74189]: WARNING nova.compute.manager [req-2759cc9b-d167-406a-9a91-76765f9c574c req-a3d86f39-5f99-45f0-a259-8e8795628056 service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Received unexpected event network-vif-plugged-6a146bba-178b-4b17-be10-0410392d8b06 for instance with vm_state active and task_state deleting.
Oct 25 21:32:37 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Instance destroyed successfully.
Oct 25 21:32:37 user nova-compute[74189]: DEBUG nova.objects.instance [None req-8251baba-3982-4ec7-bf10-7c3d401aacd7 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lazy-loading 'resources' on Instance uuid cdb13b8f-c136-4f2b-95b9-e464babac28a {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:32:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-8251baba-3982-4ec7-bf10-7c3d401aacd7 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:26:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-203509859',display_name='tempest-TestMinimumBasicScenario-server-203509859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-203509859',id=26,image_ref='aa2b6cc1-286b-43bf-b15c-d93296dcd109',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4z0OWc1huBv+7er3wDTCce5Gzj47ISPUaomWnov/1ylLmTYrJ3U3snYabzU/u51yiodhiArIMzrX6ZmmAOGafBpcWVPHiXEEAfzqGtBPL3XnJzz4AaxgWLjIB8rVfOCg==',key_name='tempest-TestMinimumBasicScenario-2109189230',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:27:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ee1339c959b4cbebeefd550fc436c61',ramdisk_id='',reservation_id='r-vdjf4bu6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa2b6cc1-286b-43bf-b15c-d93296dcd109',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1857244532',owner_user_name='tempest-TestMinimumBasicScenario-1857244532-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:29:53Z,user_data=None,user_id='a829dcf4095d45ab868a0ea904e9bfce',uuid=cdb13b8f-c136-4f2b-95b9-e464babac28a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a146bba-178b-4b17-be10-0410392d8b06", "address": "fa:16:3e:7f:d7:49", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a146bba-17", "ovs_interfaceid": "6a146bba-178b-4b17-be10-0410392d8b06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:32:37 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-8251baba-3982-4ec7-bf10-7c3d401aacd7 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Converting VIF {"id": "6a146bba-178b-4b17-be10-0410392d8b06", "address": "fa:16:3e:7f:d7:49", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a146bba-17", "ovs_interfaceid": "6a146bba-178b-4b17-be10-0410392d8b06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:32:37 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-8251baba-3982-4ec7-bf10-7c3d401aacd7 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:d7:49,bridge_name='br-int',has_traffic_filtering=True,id=6a146bba-178b-4b17-be10-0410392d8b06,network=Network(d0eb2495-d624-4f66-91a4-2d97b9461a19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a146bba-17') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:32:37 user nova-compute[74189]: DEBUG os_vif [None req-8251baba-3982-4ec7-bf10-7c3d401aacd7 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:d7:49,bridge_name='br-int',has_traffic_filtering=True,id=6a146bba-178b-4b17-be10-0410392d8b06,network=Network(d0eb2495-d624-4f66-91a4-2d97b9461a19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a146bba-17') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:32:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a146bba-17, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:32:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:32:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca6a64c3-5cac-48a0-9632-e383edc59aa1) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:32:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:32:37 user nova-compute[74189]: INFO os_vif [None req-8251baba-3982-4ec7-bf10-7c3d401aacd7 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:d7:49,bridge_name='br-int',has_traffic_filtering=True,id=6a146bba-178b-4b17-be10-0410392d8b06,network=Network(d0eb2495-d624-4f66-91a4-2d97b9461a19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a146bba-17')
Oct 25 21:32:37 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-8251baba-3982-4ec7-bf10-7c3d401aacd7 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Deleting instance files /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a_del
Oct 25 21:32:37 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-8251baba-3982-4ec7-bf10-7c3d401aacd7 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Deletion of /opt/stack/data/nova/instances/cdb13b8f-c136-4f2b-95b9-e464babac28a_del complete
Oct 25 21:32:37 user nova-compute[74189]: INFO nova.compute.manager [None req-8251baba-3982-4ec7-bf10-7c3d401aacd7 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Took 1.51 seconds to destroy the instance on the hypervisor.
Oct 25 21:32:37 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-8251baba-3982-4ec7-bf10-7c3d401aacd7 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:32:37 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:32:37 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:32:37 user nova-compute[74189]: DEBUG nova.compute.manager [req-330cad26-16b0-47de-a560-c567a5e4209c req-78cc3cdf-5d26-451c-b746-dc43c4743a89 service nova] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Received event network-vif-plugged-51ff1ff4-83d4-4393-81e2-750670c4af18 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:32:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-330cad26-16b0-47de-a560-c567a5e4209c req-78cc3cdf-5d26-451c-b746-dc43c4743a89 service nova] Acquiring lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-330cad26-16b0-47de-a560-c567a5e4209c req-78cc3cdf-5d26-451c-b746-dc43c4743a89 service nova] Lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-330cad26-16b0-47de-a560-c567a5e4209c req-78cc3cdf-5d26-451c-b746-dc43c4743a89 service nova] Lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:37 user nova-compute[74189]: DEBUG nova.compute.manager [req-330cad26-16b0-47de-a560-c567a5e4209c req-78cc3cdf-5d26-451c-b746-dc43c4743a89 service nova] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] No waiting events found dispatching network-vif-plugged-51ff1ff4-83d4-4393-81e2-750670c4af18 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:32:37 user nova-compute[74189]: WARNING nova.compute.manager [req-330cad26-16b0-47de-a560-c567a5e4209c req-78cc3cdf-5d26-451c-b746-dc43c4743a89 service nova] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Received unexpected event network-vif-plugged-51ff1ff4-83d4-4393-81e2-750670c4af18 for instance with vm_state building and task_state spawning.
Oct 25 21:32:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:37 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:32:37 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Took 0.58 seconds to deallocate network for instance.
Oct 25 21:32:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8251baba-3982-4ec7-bf10-7c3d401aacd7 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8251baba-3982-4ec7-bf10-7c3d401aacd7 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:38 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-8251baba-3982-4ec7-bf10-7c3d401aacd7 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:32:38 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-8251baba-3982-4ec7-bf10-7c3d401aacd7 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:32:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8251baba-3982-4ec7-bf10-7c3d401aacd7 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:38 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-8251baba-3982-4ec7-bf10-7c3d401aacd7 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Deleted allocations for instance cdb13b8f-c136-4f2b-95b9-e464babac28a
Oct 25 21:32:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8251baba-3982-4ec7-bf10-7c3d401aacd7 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "cdb13b8f-c136-4f2b-95b9-e464babac28a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.622s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:39 user nova-compute[74189]: DEBUG nova.compute.manager [req-0d041d57-0a91-45cd-8d56-0bc080ba0b9e req-fbf083b2-6b0d-4372-a9c3-026e25d2bce3 service nova] [instance: cdb13b8f-c136-4f2b-95b9-e464babac28a] Received event network-vif-deleted-6a146bba-178b-4b17-be10-0410392d8b06 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:32:39 user nova-compute[74189]: DEBUG nova.compute.manager [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:32:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:32:39 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Instance spawned successfully.
Oct 25 21:32:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:32:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:32:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:32:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:32:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:32:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:32:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:32:39 user nova-compute[74189]: DEBUG nova.compute.manager [req-3abfb813-b952-4532-9182-d13bee21effa req-eced2055-b169-4d41-814f-4412d228e411 service nova] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Received event network-vif-plugged-51ff1ff4-83d4-4393-81e2-750670c4af18 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:32:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3abfb813-b952-4532-9182-d13bee21effa req-eced2055-b169-4d41-814f-4412d228e411 service nova] Acquiring lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3abfb813-b952-4532-9182-d13bee21effa req-eced2055-b169-4d41-814f-4412d228e411 service nova] Lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3abfb813-b952-4532-9182-d13bee21effa req-eced2055-b169-4d41-814f-4412d228e411 service nova] Lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:39 user nova-compute[74189]: DEBUG nova.compute.manager [req-3abfb813-b952-4532-9182-d13bee21effa req-eced2055-b169-4d41-814f-4412d228e411 service nova] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] No waiting events found dispatching network-vif-plugged-51ff1ff4-83d4-4393-81e2-750670c4af18 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:32:39 user nova-compute[74189]: WARNING nova.compute.manager [req-3abfb813-b952-4532-9182-d13bee21effa req-eced2055-b169-4d41-814f-4412d228e411 service nova] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Received unexpected event network-vif-plugged-51ff1ff4-83d4-4393-81e2-750670c4af18 for instance with vm_state building and task_state spawning.
Oct 25 21:32:39 user nova-compute[74189]: INFO nova.compute.manager [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Took 6.16 seconds to spawn the instance on the hypervisor.
Oct 25 21:32:39 user nova-compute[74189]: DEBUG nova.compute.manager [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:32:39 user nova-compute[74189]: INFO nova.compute.manager [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Took 7.07 seconds to build instance.
Oct 25 21:32:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9711eb3d-9709-4375-89f2-30e873ab82aa tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.168s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:32:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:52 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:32:52 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:52 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 21:32:52 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:32:52 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:32:52 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:53 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:32:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:59 user nova-compute[74189]: DEBUG nova.compute.manager [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:32:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:32:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:32:59 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:32:59 user nova-compute[74189]: INFO nova.compute.claims [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Claim successful on node user
Oct 25 21:33:00 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:33:00 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:33:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:33:00 user nova-compute[74189]: DEBUG nova.compute.manager [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:33:00 user nova-compute[74189]: DEBUG nova.compute.manager [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:33:00 user nova-compute[74189]: DEBUG nova.network.neutron [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:33:00 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:33:00 user nova-compute[74189]: DEBUG nova.compute.manager [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:33:00 user nova-compute[74189]: DEBUG nova.policy [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6fb9b5c36f049c1af4ae44e11267264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45f8868c6a04e31ad1617ee6e9438a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:33:00 user nova-compute[74189]: DEBUG nova.compute.manager [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:33:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:33:00 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Creating image(s)
Oct 25 21:33:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:33:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "/opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:33:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "/opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:33:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.177s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:33:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:33:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.177s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk 1073741824" returned: 0 in 0.050s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:33:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:00 user nova-compute[74189]: DEBUG nova.network.neutron [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Successfully created port: b460e41a-4e06-48e4-80b4-b551c718126e {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:33:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.188s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:01 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:33:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:01 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Cannot resize image /opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:33:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:33:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Ensure instance console log exists: /opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:33:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:33:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:33:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:33:01 user nova-compute[74189]: INFO nova.compute.manager [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Rescuing
Oct 25 21:33:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "refresh_cache-3da14c0a-31a8-4fe3-bd5a-49378680af50" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:33:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquired lock "refresh_cache-3da14c0a-31a8-4fe3-bd5a-49378680af50" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:33:01 user nova-compute[74189]: DEBUG nova.network.neutron [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:33:02 user nova-compute[74189]: DEBUG nova.network.neutron [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Updating instance_info_cache with network_info: [{"id": "a5e7898d-caba-49d7-8310-630beb75bf21", "address": "fa:16:3e:9d:7f:d0", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5e7898d-ca", "ovs_interfaceid": "a5e7898d-caba-49d7-8310-630beb75bf21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:33:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Releasing lock "refresh_cache-3da14c0a-31a8-4fe3-bd5a-49378680af50" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:33:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:33:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:02 user nova-compute[74189]: DEBUG nova.network.neutron [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Successfully updated port: b460e41a-4e06-48e4-80b4-b551c718126e {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:33:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "refresh_cache-f1f19ee2-291f-4cc2-a7d9-db1874691e8e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:33:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquired lock "refresh_cache-f1f19ee2-291f-4cc2-a7d9-db1874691e8e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:33:02 user nova-compute[74189]: DEBUG nova.network.neutron [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:33:02 user nova-compute[74189]: DEBUG nova.compute.manager [req-e8360c7e-eb77-4cdb-b01c-59cfd345bc6c req-24e08e1e-cd2f-47ab-b670-1d9005fd79f4 service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Received event network-changed-b460e41a-4e06-48e4-80b4-b551c718126e {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:33:02 user nova-compute[74189]: DEBUG nova.compute.manager [req-e8360c7e-eb77-4cdb-b01c-59cfd345bc6c req-24e08e1e-cd2f-47ab-b670-1d9005fd79f4 service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Refreshing instance network info cache due to event network-changed-b460e41a-4e06-48e4-80b4-b551c718126e. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:33:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e8360c7e-eb77-4cdb-b01c-59cfd345bc6c req-24e08e1e-cd2f-47ab-b670-1d9005fd79f4 service nova] Acquiring lock "refresh_cache-f1f19ee2-291f-4cc2-a7d9-db1874691e8e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:33:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:02 user nova-compute[74189]: DEBUG nova.network.neutron [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:33:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:02 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Instance destroyed successfully.
Oct 25 21:33:02 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Attempting rescue
Oct 25 21:33:02 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74189) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 25 21:33:02 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Instance directory exists: not creating {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 21:33:02 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Creating image(s)
Oct 25 21:33:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "/opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:33:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "/opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:33:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "/opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:33:02 user nova-compute[74189]: DEBUG nova.objects.instance [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3da14c0a-31a8-4fe3-bd5a-49378680af50 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:33:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:33:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:33:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:02 user nova-compute[74189]: DEBUG nova.network.neutron [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Updating instance_info_cache with network_info: [{"id": "b460e41a-4e06-48e4-80b4-b551c718126e", "address": "fa:16:3e:4c:f4:6b", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb460e41a-4e", "ovs_interfaceid": "b460e41a-4e06-48e4-80b4-b551c718126e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:33:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Releasing lock "refresh_cache-f1f19ee2-291f-4cc2-a7d9-db1874691e8e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:33:02 user nova-compute[74189]: DEBUG nova.compute.manager [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Instance network_info: |[{"id": "b460e41a-4e06-48e4-80b4-b551c718126e", "address": "fa:16:3e:4c:f4:6b", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb460e41a-4e", "ovs_interfaceid": "b460e41a-4e06-48e4-80b4-b551c718126e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:33:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e8360c7e-eb77-4cdb-b01c-59cfd345bc6c req-24e08e1e-cd2f-47ab-b670-1d9005fd79f4 service nova] Acquired lock "refresh_cache-f1f19ee2-291f-4cc2-a7d9-db1874691e8e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:33:02 user nova-compute[74189]: DEBUG nova.network.neutron [req-e8360c7e-eb77-4cdb-b01c-59cfd345bc6c req-24e08e1e-cd2f-47ab-b670-1d9005fd79f4 service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Refreshing network info cache for port b460e41a-4e06-48e4-80b4-b551c718126e {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:33:02 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Start _get_guest_xml network_info=[{"id": "b460e41a-4e06-48e4-80b4-b551c718126e", "address": "fa:16:3e:4c:f4:6b", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb460e41a-4e", "ovs_interfaceid": "b460e41a-4e06-48e4-80b4-b551c718126e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:33:02 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:33:02 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:33:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.180s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue" returned: 0 in 0.049s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.objects.instance [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lazy-loading 'migration_context' on Instance uuid 3da14c0a-31a8-4fe3-bd5a-49378680af50 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-904043964',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-904043964',id=36,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDW8eZT8GP9FUTvkiTAgfGM4YmLWdp9/wvP9KJIr8BZ+VLv1ILm27EcVk7KzOgSldLDctcon+WPQZKUJOQ92ZAvyIXAKSBaSECwOXFFIt1GsdvKN8JqtBdn79vB0QfIe+w==',key_name='tempest-keypair-1324843434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e45f8868c6a04e31ad1617ee6e9438a2',ramdisk_id='',reservation_id='r-sk1uqinq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-846255404',owner_user_name='tempest-AttachVolumeShelveTestJSON-846255404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:33:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6fb9b5c36f049c1af4ae44e11267264',uuid=f1f19ee2-291f-4cc2-a7d9-db1874691e8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b460e41a-4e06-48e4-80b4-b551c718126e", "address": "fa:16:3e:4c:f4:6b", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb460e41a-4e", "ovs_interfaceid": "b460e41a-4e06-48e4-80b4-b551c718126e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Converting VIF {"id": "b460e41a-4e06-48e4-80b4-b551c718126e", "address": "fa:16:3e:4c:f4:6b", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb460e41a-4e", "ovs_interfaceid": "b460e41a-4e06-48e4-80b4-b551c718126e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:6b,bridge_name='br-int',has_traffic_filtering=True,id=b460e41a-4e06-48e4-80b4-b551c718126e,network=Network(09d8bdf6-f255-479c-aa38-55d468abf1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb460e41a-4e') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.objects.instance [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lazy-loading 'pci_devices' on Instance uuid f1f19ee2-291f-4cc2-a7d9-db1874691e8e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.objects.base [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Object Instance<3da14c0a-31a8-4fe3-bd5a-49378680af50> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Start _get_guest_xml network_info=[{"id": "a5e7898d-caba-49d7-8310-630beb75bf21", "address": "fa:16:3e:9d:7f:d0", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "vif_mac": "fa:16:3e:9d:7f:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5e7898d-ca", "ovs_interfaceid": "a5e7898d-caba-49d7-8310-630beb75bf21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.objects.instance [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lazy-loading 'resources' on Instance uuid 3da14c0a-31a8-4fe3-bd5a-49378680af50 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:33:03 user nova-compute[74189]:   <uuid>f1f19ee2-291f-4cc2-a7d9-db1874691e8e</uuid>
Oct 25 21:33:03 user nova-compute[74189]:   <name>instance-00000024</name>
Oct 25 21:33:03 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:33:03 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:33:03 user nova-compute[74189]:   <metadata>
Oct 25 21:33:03 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:33:03 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:33:03 user nova-compute[74189]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-904043964</nova:name>
Oct 25 21:33:03 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:33:02</nova:creationTime>
Oct 25 21:33:03 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:33:03 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:33:03 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:33:03 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:33:03 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:33:03 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:33:03 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:33:03 user nova-compute[74189]:       <nova:owner>
Oct 25 21:33:03 user nova-compute[74189]:         <nova:user uuid="e6fb9b5c36f049c1af4ae44e11267264">tempest-AttachVolumeShelveTestJSON-846255404-project-member</nova:user>
Oct 25 21:33:03 user nova-compute[74189]:         <nova:project uuid="e45f8868c6a04e31ad1617ee6e9438a2">tempest-AttachVolumeShelveTestJSON-846255404</nova:project>
Oct 25 21:33:03 user nova-compute[74189]:       </nova:owner>
Oct 25 21:33:03 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:33:03 user nova-compute[74189]:       <nova:ports>
Oct 25 21:33:03 user nova-compute[74189]:         <nova:port uuid="b460e41a-4e06-48e4-80b4-b551c718126e">
Oct 25 21:33:03 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 25 21:33:03 user nova-compute[74189]:         </nova:port>
Oct 25 21:33:03 user nova-compute[74189]:       </nova:ports>
Oct 25 21:33:03 user nova-compute[74189]:     </nova:instance>
Oct 25 21:33:03 user nova-compute[74189]:   </metadata>
Oct 25 21:33:03 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:33:03 user nova-compute[74189]:     <system>
Oct 25 21:33:03 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:33:03 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:33:03 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:33:03 user nova-compute[74189]:       <entry name="serial">f1f19ee2-291f-4cc2-a7d9-db1874691e8e</entry>
Oct 25 21:33:03 user nova-compute[74189]:       <entry name="uuid">f1f19ee2-291f-4cc2-a7d9-db1874691e8e</entry>
Oct 25 21:33:03 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:33:03 user nova-compute[74189]:     </system>
Oct 25 21:33:03 user nova-compute[74189]:   </sysinfo>
Oct 25 21:33:03 user nova-compute[74189]:   <os>
Oct 25 21:33:03 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:33:03 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:33:03 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:33:03 user nova-compute[74189]:   </os>
Oct 25 21:33:03 user nova-compute[74189]:   <features>
Oct 25 21:33:03 user nova-compute[74189]:     <acpi/>
Oct 25 21:33:03 user nova-compute[74189]:     <apic/>
Oct 25 21:33:03 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:33:03 user nova-compute[74189]:   </features>
Oct 25 21:33:03 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:33:03 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:33:03 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:33:03 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:33:03 user nova-compute[74189]:   </clock>
Oct 25 21:33:03 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:33:03 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:33:03 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:33:03 user nova-compute[74189]:   </cpu>
Oct 25 21:33:03 user nova-compute[74189]:   <devices>
Oct 25 21:33:03 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:33:03 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:33:03 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk"/>
Oct 25 21:33:03 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:33:03 user nova-compute[74189]:     </disk>
Oct 25 21:33:03 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:33:03 user nova-compute[74189]:       <mac address="fa:16:3e:4c:f4:6b"/>
Oct 25 21:33:03 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:33:03 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:33:03 user nova-compute[74189]:       <target dev="tapb460e41a-4e"/>
Oct 25 21:33:03 user nova-compute[74189]:     </interface>
Oct 25 21:33:03 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:33:03 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/console.log" append="off"/>
Oct 25 21:33:03 user nova-compute[74189]:     </serial>
Oct 25 21:33:03 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:33:03 user nova-compute[74189]:     <video>
Oct 25 21:33:03 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:33:03 user nova-compute[74189]:     </video>
Oct 25 21:33:03 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:33:03 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:33:03 user nova-compute[74189]:     </rng>
Oct 25 21:33:03 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:33:03 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:33:03 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:33:03 user nova-compute[74189]:     </memballoon>
Oct 25 21:33:03 user nova-compute[74189]:   </devices>
Oct 25 21:33:03 user nova-compute[74189]: </domain>
Oct 25 21:33:03 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-904043964',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-904043964',id=36,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDW8eZT8GP9FUTvkiTAgfGM4YmLWdp9/wvP9KJIr8BZ+VLv1ILm27EcVk7KzOgSldLDctcon+WPQZKUJOQ92ZAvyIXAKSBaSECwOXFFIt1GsdvKN8JqtBdn79vB0QfIe+w==',key_name='tempest-keypair-1324843434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e45f8868c6a04e31ad1617ee6e9438a2',ramdisk_id='',reservation_id='r-sk1uqinq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-846255404',owner_user_name='tempest-AttachVolumeShelveTestJSON-846255404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:33:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6fb9b5c36f049c1af4ae44e11267264',uuid=f1f19ee2-291f-4cc2-a7d9-db1874691e8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b460e41a-4e06-48e4-80b4-b551c718126e", "address": "fa:16:3e:4c:f4:6b", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb460e41a-4e", "ovs_interfaceid": "b460e41a-4e06-48e4-80b4-b551c718126e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Converting VIF {"id": "b460e41a-4e06-48e4-80b4-b551c718126e", "address": "fa:16:3e:4c:f4:6b", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb460e41a-4e", "ovs_interfaceid": "b460e41a-4e06-48e4-80b4-b551c718126e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:6b,bridge_name='br-int',has_traffic_filtering=True,id=b460e41a-4e06-48e4-80b4-b551c718126e,network=Network(09d8bdf6-f255-479c-aa38-55d468abf1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb460e41a-4e') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG os_vif [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:6b,bridge_name='br-int',has_traffic_filtering=True,id=b460e41a-4e06-48e4-80b4-b551c718126e,network=Network(09d8bdf6-f255-479c-aa38-55d468abf1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb460e41a-4e') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.objects.base [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Object Instance<3da14c0a-31a8-4fe3-bd5a-49378680af50> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.objects.instance [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lazy-loading 'numa_topology' on Instance uuid 3da14c0a-31a8-4fe3-bd5a-49378680af50 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b9c0050-a9b6-5451-bf0d-1b7056c334ba', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.objects.base [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Object Instance<3da14c0a-31a8-4fe3-bd5a-49378680af50> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb460e41a-4e, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb460e41a-4e, col_values=(('qos', UUID('c5e9750f-dbd7-4863-acba-5d3434aab179')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb460e41a-4e, col_values=(('external_ids', {'iface-id': 'b460e41a-4e06-48e4-80b4-b551c718126e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:f4:6b', 'vm-uuid': 'f1f19ee2-291f-4cc2-a7d9-db1874691e8e'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:03 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:33:03 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:33:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.objects.instance [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3da14c0a-31a8-4fe3-bd5a-49378680af50 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:03 user nova-compute[74189]: INFO os_vif [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:6b,bridge_name='br-int',has_traffic_filtering=True,id=b460e41a-4e06-48e4-80b4-b551c718126e,network=Network(09d8bdf6-f255-479c-aa38-55d468abf1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb460e41a-4e')
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.objects.base [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Object Instance<3da14c0a-31a8-4fe3-bd5a-49378680af50> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:31:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1418568783',display_name='tempest-ServerRescueNegativeTestJSON-server-1418568783',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1418568783',id=33,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:31:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3df03fc18fc3467db76e336c6de78c92',ramdisk_id='',reservation_id='r-6kitp7g7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-383982506',owner_user_name='tempest-ServerRescueNegativeTestJSON-383982506-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:31:22Z,user_data=None,user_id='155c948b95c64c9083da984cdf6af494',uuid=3da14c0a-31a8-4fe3-bd5a-49378680af50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5e7898d-caba-49d7-8310-630beb75bf21", "address": "fa:16:3e:9d:7f:d0", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "vif_mac": "fa:16:3e:9d:7f:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5e7898d-ca", "ovs_interfaceid": "a5e7898d-caba-49d7-8310-630beb75bf21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Converting VIF {"id": "a5e7898d-caba-49d7-8310-630beb75bf21", "address": "fa:16:3e:9d:7f:d0", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "vif_mac": "fa:16:3e:9d:7f:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5e7898d-ca", "ovs_interfaceid": "a5e7898d-caba-49d7-8310-630beb75bf21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:7f:d0,bridge_name='br-int',has_traffic_filtering=True,id=a5e7898d-caba-49d7-8310-630beb75bf21,network=Network(b496a106-2367-44dc-a788-bcd22ec98feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5e7898d-ca') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.objects.instance [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lazy-loading 'pci_devices' on Instance uuid 3da14c0a-31a8-4fe3-bd5a-49378680af50 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.objects.base [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Object Instance<3da14c0a-31a8-4fe3-bd5a-49378680af50> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:33:03 user nova-compute[74189]:   <uuid>3da14c0a-31a8-4fe3-bd5a-49378680af50</uuid>
Oct 25 21:33:03 user nova-compute[74189]:   <name>instance-00000021</name>
Oct 25 21:33:03 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:33:03 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:33:03 user nova-compute[74189]:   <metadata>
Oct 25 21:33:03 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:33:03 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:33:03 user nova-compute[74189]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1418568783</nova:name>
Oct 25 21:33:03 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:33:03</nova:creationTime>
Oct 25 21:33:03 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:33:03 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:33:03 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:33:03 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:33:03 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:33:03 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:33:03 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:33:03 user nova-compute[74189]:       <nova:owner>
Oct 25 21:33:03 user nova-compute[74189]:         <nova:user uuid="155c948b95c64c9083da984cdf6af494">tempest-ServerRescueNegativeTestJSON-383982506-project-member</nova:user>
Oct 25 21:33:03 user nova-compute[74189]:         <nova:project uuid="3df03fc18fc3467db76e336c6de78c92">tempest-ServerRescueNegativeTestJSON-383982506</nova:project>
Oct 25 21:33:03 user nova-compute[74189]:       </nova:owner>
Oct 25 21:33:03 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:33:03 user nova-compute[74189]:       <nova:ports>
Oct 25 21:33:03 user nova-compute[74189]:         <nova:port uuid="a5e7898d-caba-49d7-8310-630beb75bf21">
Oct 25 21:33:03 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 25 21:33:03 user nova-compute[74189]:         </nova:port>
Oct 25 21:33:03 user nova-compute[74189]:       </nova:ports>
Oct 25 21:33:03 user nova-compute[74189]:     </nova:instance>
Oct 25 21:33:03 user nova-compute[74189]:   </metadata>
Oct 25 21:33:03 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:33:03 user nova-compute[74189]:     <system>
Oct 25 21:33:03 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:33:03 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:33:03 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:33:03 user nova-compute[74189]:       <entry name="serial">3da14c0a-31a8-4fe3-bd5a-49378680af50</entry>
Oct 25 21:33:03 user nova-compute[74189]:       <entry name="uuid">3da14c0a-31a8-4fe3-bd5a-49378680af50</entry>
Oct 25 21:33:03 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:33:03 user nova-compute[74189]:     </system>
Oct 25 21:33:03 user nova-compute[74189]:   </sysinfo>
Oct 25 21:33:03 user nova-compute[74189]:   <os>
Oct 25 21:33:03 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:33:03 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:33:03 user nova-compute[74189]:   </os>
Oct 25 21:33:03 user nova-compute[74189]:   <features>
Oct 25 21:33:03 user nova-compute[74189]:     <acpi/>
Oct 25 21:33:03 user nova-compute[74189]:     <apic/>
Oct 25 21:33:03 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:33:03 user nova-compute[74189]:   </features>
Oct 25 21:33:03 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:33:03 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:33:03 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:33:03 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:33:03 user nova-compute[74189]:   </clock>
Oct 25 21:33:03 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:33:03 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:33:03 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:33:03 user nova-compute[74189]:   </cpu>
Oct 25 21:33:03 user nova-compute[74189]:   <devices>
Oct 25 21:33:03 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:33:03 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:33:03 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue"/>
Oct 25 21:33:03 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:33:03 user nova-compute[74189]:     </disk>
Oct 25 21:33:03 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:33:03 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:33:03 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk"/>
Oct 25 21:33:03 user nova-compute[74189]:       <target dev="vdb" bus="virtio"/>
Oct 25 21:33:03 user nova-compute[74189]:     </disk>
Oct 25 21:33:03 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:33:03 user nova-compute[74189]:       <mac address="fa:16:3e:9d:7f:d0"/>
Oct 25 21:33:03 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:33:03 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:33:03 user nova-compute[74189]:       <target dev="tapa5e7898d-ca"/>
Oct 25 21:33:03 user nova-compute[74189]:     </interface>
Oct 25 21:33:03 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:33:03 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/console.log" append="off"/>
Oct 25 21:33:03 user nova-compute[74189]:     </serial>
Oct 25 21:33:03 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:33:03 user nova-compute[74189]:     <video>
Oct 25 21:33:03 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:33:03 user nova-compute[74189]:     </video>
Oct 25 21:33:03 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:33:03 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:33:03 user nova-compute[74189]:     </rng>
Oct 25 21:33:03 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:33:03 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:33:03 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:33:03 user nova-compute[74189]:     </memballoon>
Oct 25 21:33:03 user nova-compute[74189]:   </devices>
Oct 25 21:33:03 user nova-compute[74189]: </domain>
Oct 25 21:33:03 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:33:03 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Instance destroyed successfully.
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] No VIF found with MAC fa:16:3e:4c:f4:6b, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] No VIF found with MAC fa:16:3e:9d:7f:d0, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.network.neutron [req-e8360c7e-eb77-4cdb-b01c-59cfd345bc6c req-24e08e1e-cd2f-47ab-b670-1d9005fd79f4 service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Updated VIF entry in instance network info cache for port b460e41a-4e06-48e4-80b4-b551c718126e. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG nova.network.neutron [req-e8360c7e-eb77-4cdb-b01c-59cfd345bc6c req-24e08e1e-cd2f-47ab-b670-1d9005fd79f4 service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Updating instance_info_cache with network_info: [{"id": "b460e41a-4e06-48e4-80b4-b551c718126e", "address": "fa:16:3e:4c:f4:6b", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb460e41a-4e", "ovs_interfaceid": "b460e41a-4e06-48e4-80b4-b551c718126e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e8360c7e-eb77-4cdb-b01c-59cfd345bc6c req-24e08e1e-cd2f-47ab-b670-1d9005fd79f4 service nova] Releasing lock "refresh_cache-f1f19ee2-291f-4cc2-a7d9-db1874691e8e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:33:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:04 user nova-compute[74189]: DEBUG nova.compute.manager [req-8479fe9e-916e-4c28-883f-bdbcb6f773c3 req-e8ec238c-585a-4223-990c-1b7b005600a9 service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Received event network-vif-unplugged-a5e7898d-caba-49d7-8310-630beb75bf21 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:33:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8479fe9e-916e-4c28-883f-bdbcb6f773c3 req-e8ec238c-585a-4223-990c-1b7b005600a9 service nova] Acquiring lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:33:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8479fe9e-916e-4c28-883f-bdbcb6f773c3 req-e8ec238c-585a-4223-990c-1b7b005600a9 service nova] Lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:33:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8479fe9e-916e-4c28-883f-bdbcb6f773c3 req-e8ec238c-585a-4223-990c-1b7b005600a9 service nova] Lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:33:04 user nova-compute[74189]: DEBUG nova.compute.manager [req-8479fe9e-916e-4c28-883f-bdbcb6f773c3 req-e8ec238c-585a-4223-990c-1b7b005600a9 service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] No waiting events found dispatching network-vif-unplugged-a5e7898d-caba-49d7-8310-630beb75bf21 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:33:04 user nova-compute[74189]: WARNING nova.compute.manager [req-8479fe9e-916e-4c28-883f-bdbcb6f773c3 req-e8ec238c-585a-4223-990c-1b7b005600a9 service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Received unexpected event network-vif-unplugged-a5e7898d-caba-49d7-8310-630beb75bf21 for instance with vm_state active and task_state rescuing.
Oct 25 21:33:04 user nova-compute[74189]: DEBUG nova.compute.manager [req-8479fe9e-916e-4c28-883f-bdbcb6f773c3 req-e8ec238c-585a-4223-990c-1b7b005600a9 service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Received event network-vif-plugged-a5e7898d-caba-49d7-8310-630beb75bf21 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:33:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8479fe9e-916e-4c28-883f-bdbcb6f773c3 req-e8ec238c-585a-4223-990c-1b7b005600a9 service nova] Acquiring lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:33:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8479fe9e-916e-4c28-883f-bdbcb6f773c3 req-e8ec238c-585a-4223-990c-1b7b005600a9 service nova] Lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:33:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8479fe9e-916e-4c28-883f-bdbcb6f773c3 req-e8ec238c-585a-4223-990c-1b7b005600a9 service nova] Lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:33:04 user nova-compute[74189]: DEBUG nova.compute.manager [req-8479fe9e-916e-4c28-883f-bdbcb6f773c3 req-e8ec238c-585a-4223-990c-1b7b005600a9 service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] No waiting events found dispatching network-vif-plugged-a5e7898d-caba-49d7-8310-630beb75bf21 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:33:04 user nova-compute[74189]: WARNING nova.compute.manager [req-8479fe9e-916e-4c28-883f-bdbcb6f773c3 req-e8ec238c-585a-4223-990c-1b7b005600a9 service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Received unexpected event network-vif-plugged-a5e7898d-caba-49d7-8310-630beb75bf21 for instance with vm_state active and task_state rescuing.
Oct 25 21:33:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:05 user nova-compute[74189]: DEBUG nova.compute.manager [req-7c64f315-4683-4335-942c-47337e61375c req-5f06b445-ccb1-43cd-996a-5244fda93a77 service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Received event network-vif-plugged-b460e41a-4e06-48e4-80b4-b551c718126e {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:33:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7c64f315-4683-4335-942c-47337e61375c req-5f06b445-ccb1-43cd-996a-5244fda93a77 service nova] Acquiring lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:33:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7c64f315-4683-4335-942c-47337e61375c req-5f06b445-ccb1-43cd-996a-5244fda93a77 service nova] Lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:33:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7c64f315-4683-4335-942c-47337e61375c req-5f06b445-ccb1-43cd-996a-5244fda93a77 service nova] Lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:33:05 user nova-compute[74189]: DEBUG nova.compute.manager [req-7c64f315-4683-4335-942c-47337e61375c req-5f06b445-ccb1-43cd-996a-5244fda93a77 service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] No waiting events found dispatching network-vif-plugged-b460e41a-4e06-48e4-80b4-b551c718126e {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:33:05 user nova-compute[74189]: WARNING nova.compute.manager [req-7c64f315-4683-4335-942c-47337e61375c req-5f06b445-ccb1-43cd-996a-5244fda93a77 service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Received unexpected event network-vif-plugged-b460e41a-4e06-48e4-80b4-b551c718126e for instance with vm_state building and task_state spawning.
Oct 25 21:33:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:06 user nova-compute[74189]: DEBUG nova.compute.manager [req-8ac45078-d02d-4489-bdd4-c024eb8b0e4f req-a58ced5b-372f-4700-a674-7b75449cad2d service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Received event network-vif-plugged-a5e7898d-caba-49d7-8310-630beb75bf21 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:33:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8ac45078-d02d-4489-bdd4-c024eb8b0e4f req-a58ced5b-372f-4700-a674-7b75449cad2d service nova] Acquiring lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:33:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8ac45078-d02d-4489-bdd4-c024eb8b0e4f req-a58ced5b-372f-4700-a674-7b75449cad2d service nova] Lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:33:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8ac45078-d02d-4489-bdd4-c024eb8b0e4f req-a58ced5b-372f-4700-a674-7b75449cad2d service nova] Lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:33:06 user nova-compute[74189]: DEBUG nova.compute.manager [req-8ac45078-d02d-4489-bdd4-c024eb8b0e4f req-a58ced5b-372f-4700-a674-7b75449cad2d service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] No waiting events found dispatching network-vif-plugged-a5e7898d-caba-49d7-8310-630beb75bf21 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:33:06 user nova-compute[74189]: WARNING nova.compute.manager [req-8ac45078-d02d-4489-bdd4-c024eb8b0e4f req-a58ced5b-372f-4700-a674-7b75449cad2d service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Received unexpected event network-vif-plugged-a5e7898d-caba-49d7-8310-630beb75bf21 for instance with vm_state active and task_state rescuing.
Oct 25 21:33:06 user nova-compute[74189]: DEBUG nova.compute.manager [req-8ac45078-d02d-4489-bdd4-c024eb8b0e4f req-a58ced5b-372f-4700-a674-7b75449cad2d service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Received event network-vif-plugged-a5e7898d-caba-49d7-8310-630beb75bf21 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:33:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8ac45078-d02d-4489-bdd4-c024eb8b0e4f req-a58ced5b-372f-4700-a674-7b75449cad2d service nova] Acquiring lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:33:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8ac45078-d02d-4489-bdd4-c024eb8b0e4f req-a58ced5b-372f-4700-a674-7b75449cad2d service nova] Lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:33:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8ac45078-d02d-4489-bdd4-c024eb8b0e4f req-a58ced5b-372f-4700-a674-7b75449cad2d service nova] Lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:33:06 user nova-compute[74189]: DEBUG nova.compute.manager [req-8ac45078-d02d-4489-bdd4-c024eb8b0e4f req-a58ced5b-372f-4700-a674-7b75449cad2d service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] No waiting events found dispatching network-vif-plugged-a5e7898d-caba-49d7-8310-630beb75bf21 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:33:06 user nova-compute[74189]: WARNING nova.compute.manager [req-8ac45078-d02d-4489-bdd4-c024eb8b0e4f req-a58ced5b-372f-4700-a674-7b75449cad2d service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Received unexpected event network-vif-plugged-a5e7898d-caba-49d7-8310-630beb75bf21 for instance with vm_state active and task_state rescuing.
Oct 25 21:33:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "6d7cbba0-f920-424a-a204-0a935471afa0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:33:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "6d7cbba0-f920-424a-a204-0a935471afa0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:33:06 user nova-compute[74189]: DEBUG nova.compute.manager [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:33:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:33:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:33:06 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:33:06 user nova-compute[74189]: INFO nova.compute.claims [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Claim successful on node user
Oct 25 21:33:07 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:33:07 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:33:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:33:07 user nova-compute[74189]: DEBUG nova.compute.manager [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:33:07 user nova-compute[74189]: DEBUG nova.compute.manager [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:33:07 user nova-compute[74189]: DEBUG nova.network.neutron [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:33:07 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:33:07 user nova-compute[74189]: DEBUG nova.compute.manager [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:33:07 user nova-compute[74189]: DEBUG nova.policy [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '77a27a7ebb4a458097c901871c378bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e893e8f3f58e4e15920d313b6391682c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:33:07 user nova-compute[74189]: INFO nova.virt.block_device [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Booting with volume 8c22cfde-db3c-4c83-994c-46925b21920d at /dev/vda
Oct 25 21:33:07 user nova-compute[74189]: DEBUG os_brick.utils [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:33:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:07 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbd25b5-c04b-41d3-9ece-b2abcfb2e016]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:33:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:07 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70a943c-e3d2-4602-9ada-20b2b2c3fe64]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:33:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:07 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[38addb6a-ce87-4f92-9c2b-d543594e6909]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:33:07 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd80e230-d4a9-4697-a651-dc2fb00b1de4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:33:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:33:07 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:33:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:33:07 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:33:07 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d485eb9-8589-4333-9517-32a860c213bb]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:33:07 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:33:07 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:33:07 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:33:07 user nova-compute[74189]: DEBUG os_brick.utils [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:33:07 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Updating existing volume attachment record: 509cc951-dc50-4811-b4c8-5e721d585251 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:33:07 user nova-compute[74189]: DEBUG nova.compute.manager [req-56111456-d2be-4adc-bf27-0ea9fcf07f33 req-d7fe7642-9a07-41b7-a1ae-b6097111081b service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Received event network-vif-plugged-b460e41a-4e06-48e4-80b4-b551c718126e {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:33:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-56111456-d2be-4adc-bf27-0ea9fcf07f33 req-d7fe7642-9a07-41b7-a1ae-b6097111081b service nova] Acquiring lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:33:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-56111456-d2be-4adc-bf27-0ea9fcf07f33 req-d7fe7642-9a07-41b7-a1ae-b6097111081b service nova] Lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:33:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-56111456-d2be-4adc-bf27-0ea9fcf07f33 req-d7fe7642-9a07-41b7-a1ae-b6097111081b service nova] Lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:33:07 user nova-compute[74189]: DEBUG nova.compute.manager [req-56111456-d2be-4adc-bf27-0ea9fcf07f33 req-d7fe7642-9a07-41b7-a1ae-b6097111081b service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] No waiting events found dispatching network-vif-plugged-b460e41a-4e06-48e4-80b4-b551c718126e {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:33:07 user nova-compute[74189]: WARNING nova.compute.manager [req-56111456-d2be-4adc-bf27-0ea9fcf07f33 req-d7fe7642-9a07-41b7-a1ae-b6097111081b service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Received unexpected event network-vif-plugged-b460e41a-4e06-48e4-80b4-b551c718126e for instance with vm_state building and task_state spawning.
Oct 25 21:33:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:08 user nova-compute[74189]: DEBUG nova.network.neutron [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Successfully created port: 43319393-6b0f-4945-965c-54d74152d41e {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:33:08 user nova-compute[74189]: DEBUG nova.compute.manager [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:33:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:33:08 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Instance spawned successfully.
Oct 25 21:33:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:33:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:33:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:33:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:33:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:33:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:33:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:33:08 user nova-compute[74189]: DEBUG nova.network.neutron [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Successfully updated port: 43319393-6b0f-4945-965c-54d74152d41e {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:33:08 user nova-compute[74189]: INFO nova.compute.manager [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Took 8.42 seconds to spawn the instance on the hypervisor.
Oct 25 21:33:08 user nova-compute[74189]: DEBUG nova.compute.manager [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:33:08 user nova-compute[74189]: DEBUG nova.compute.manager [req-acbed904-47af-4480-b209-b0814fb681e8 req-5517b730-34db-4234-9571-5f5559dc255d service nova] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Received event network-changed-43319393-6b0f-4945-965c-54d74152d41e {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:33:08 user nova-compute[74189]: DEBUG nova.compute.manager [req-acbed904-47af-4480-b209-b0814fb681e8 req-5517b730-34db-4234-9571-5f5559dc255d service nova] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Refreshing instance network info cache due to event network-changed-43319393-6b0f-4945-965c-54d74152d41e. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:33:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-acbed904-47af-4480-b209-b0814fb681e8 req-5517b730-34db-4234-9571-5f5559dc255d service nova] Acquiring lock "refresh_cache-6d7cbba0-f920-424a-a204-0a935471afa0" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:33:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-acbed904-47af-4480-b209-b0814fb681e8 req-5517b730-34db-4234-9571-5f5559dc255d service nova] Acquired lock "refresh_cache-6d7cbba0-f920-424a-a204-0a935471afa0" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:33:08 user nova-compute[74189]: DEBUG nova.network.neutron [req-acbed904-47af-4480-b209-b0814fb681e8 req-5517b730-34db-4234-9571-5f5559dc255d service nova] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Refreshing network info cache for port 43319393-6b0f-4945-965c-54d74152d41e {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:33:08 user nova-compute[74189]: DEBUG nova.compute.manager [None req-f07c09a2-5732-4efe-8caa-05ae0981f00d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:33:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "refresh_cache-6d7cbba0-f920-424a-a204-0a935471afa0" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:33:08 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:33:08 user nova-compute[74189]: DEBUG nova.network.neutron [req-acbed904-47af-4480-b209-b0814fb681e8 req-5517b730-34db-4234-9571-5f5559dc255d service nova] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:33:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:08 user nova-compute[74189]: INFO nova.compute.manager [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Took 9.21 seconds to build instance.
Oct 25 21:33:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-094acded-510d-43d3-9fff-063fec88f80a tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.308s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:33:09 user nova-compute[74189]: DEBUG nova.network.neutron [req-acbed904-47af-4480-b209-b0814fb681e8 req-5517b730-34db-4234-9571-5f5559dc255d service nova] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:33:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-acbed904-47af-4480-b209-b0814fb681e8 req-5517b730-34db-4234-9571-5f5559dc255d service nova] Releasing lock "refresh_cache-6d7cbba0-f920-424a-a204-0a935471afa0" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:33:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquired lock "refresh_cache-6d7cbba0-f920-424a-a204-0a935471afa0" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:33:09 user nova-compute[74189]: DEBUG nova.network.neutron [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:33:09 user nova-compute[74189]: DEBUG nova.network.neutron [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:33:09 user nova-compute[74189]: DEBUG nova.network.neutron [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Updating instance_info_cache with network_info: [{"id": "43319393-6b0f-4945-965c-54d74152d41e", "address": "fa:16:3e:d9:e3:8c", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43319393-6b", "ovs_interfaceid": "43319393-6b0f-4945-965c-54d74152d41e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:33:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Releasing lock "refresh_cache-6d7cbba0-f920-424a-a204-0a935471afa0" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:33:09 user nova-compute[74189]: DEBUG nova.compute.manager [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Instance network_info: |[{"id": "43319393-6b0f-4945-965c-54d74152d41e", "address": "fa:16:3e:d9:e3:8c", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43319393-6b", "ovs_interfaceid": "43319393-6b0f-4945-965c-54d74152d41e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:33:09 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:33:09 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:33:09 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Didn't find any instances for network info cache update. {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 21:33:10 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:33:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:33:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:33:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:33:10 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:33:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a393d263-97a8-4103-a9b4-866b5d6fc435/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a393d263-97a8-4103-a9b4-866b5d6fc435/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a393d263-97a8-4103-a9b4-866b5d6fc435/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a393d263-97a8-4103-a9b4-866b5d6fc435/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0da9f3bb-fbf4-4f9a-929f-0d223101b29e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0da9f3bb-fbf4-4f9a-929f-0d223101b29e/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0da9f3bb-fbf4-4f9a-929f-0d223101b29e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0da9f3bb-fbf4-4f9a-929f-0d223101b29e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:33:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:33:15 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:33:15 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:33:15 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=7621MB free_disk=24.893016815185547GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:33:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:33:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:33:15 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance d7c3a99a-ab38-4e88-896d-94ae51a09a48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:33:15 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance af1d7b3c-9950-4b74-8f15-b31011ccfa24 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:33:15 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 932fe8ac-fdde-45c6-aa32-9bf866f19a4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:33:15 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 0b4f80c4-98cc-440a-aac7-cd423b71a231 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:33:15 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 9733d5c8-4476-4903-bd1b-16d43a54fdbd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:33:15 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:33:15 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3da14c0a-31a8-4fe3-bd5a-49378680af50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:33:15 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance a393d263-97a8-4103-a9b4-866b5d6fc435 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:33:15 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 0da9f3bb-fbf4-4f9a-929f-0d223101b29e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:33:15 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance f1f19ee2-291f-4cc2-a7d9-db1874691e8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:33:15 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 6d7cbba0-f920-424a-a204-0a935471afa0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:33:15 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:33:15 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:33:15 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:33:15 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:33:15 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:33:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.519s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:33:16 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:33:16 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:33:16 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:33:16 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:33:16 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:33:16 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:33:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:33:18 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:33:19 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:33:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:33:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:25 user nova-compute[74189]: DEBUG nova.compute.manager [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:33:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:33:25 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Creating image(s)
Oct 25 21:33:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Did not create local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 21:33:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Ensure instance console log exists: /opt/stack/data/nova/instances/6d7cbba0-f920-424a-a204-0a935471afa0/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:33:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:33:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:33:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Start _get_guest_xml network_info=[{"id": "43319393-6b0f-4945-965c-54d74152d41e", "address": "fa:16:3e:d9:e3:8c", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43319393-6b", "ovs_interfaceid": "43319393-6b0f-4945-965c-54d74152d41e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oXdtAbSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6d7cbba0-f920-424a-a204-0a935471afa0', 'attached_at': '', 'detached_at': '', 'volume_id': '8c22cfde-db3c-4c83-994c-46925b21920d', 'serial': '8c22cfde-db3c-4c83-994c-46925b21920d'}, 'attachment_id': '509cc951-dc50-4811-b4c8-5e721d585251', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:33:26 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:33:26 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:33:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oXdtAbSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:33:26 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:33:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:33:26 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:33:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:33:26 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:33:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60aec15-b85e-4806-bd3b-21a161c903f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:33:26 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0835c77e-b2c2-4707-9055-e91834f53c3c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d] added
Oct 25 21:33:26 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d519a6-0241-42ba-bd84-ffa4126e155d]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54f01f8-4cb1-4dcd-989e-c614d6d73089]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oXdtAbSH {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oXdtAbSH" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[760dd260-4307-4cdf-9ef3-7daea577a25e]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oXdtAbSH'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eaf5ebc-9a4e-4258-ac9c-27f750b27139]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bce3e8-adc3-479a-bce1-fb85bb017687]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:33:26 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:33:26 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:33:26 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:33:26 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4070df2d-8e94-4c9d-8c92-b075ab6d2d5d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d, portal: 172.16.0.220,3260]
Oct 25 21:33:26 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d, portal: 172.16.0.220,3260] successful.
Oct 25 21:33:26 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[edaa3181-5b1d-4224-b5c8-9484c3d7dca9]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b204ce30-dab7-4497-90b2-f97bb883d030]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:33:26 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:33:26 user nova-compute[74189]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)
Oct 25 21:33:26 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:33:26 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:33:26 user nova-compute[74189]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)
Oct 25 21:33:26 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e9684e-90de-4e61-88ad-1c1d72da3b57]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:33:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oXdtAbSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:33:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:33:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23337663031383738', 'path': '/dev/sdc'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:33:27 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337663031383738', 'path': '/dev/sdc'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:33:27 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:33:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1328267637',display_name='tempest-TestVolumeBootPattern-server-1328267637',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1328267637',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbWjlurUdlTqM38TJIvyWArBvgtPS5ByZ7GvbbNhterPxeMByoQxHeDSj3q/FAwbfZCzxGnbhX1L/9RQ/CSBOb1BJ9rZaqesREBo++7UKa99YIwO5kH0uL2CiEzhHllXw==',key_name='tempest-TestVolumeBootPattern-16841960',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e893e8f3f58e4e15920d313b6391682c',ramdisk_id='',reservation_id='r-v198xzw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1934687878',owner_user_name='tempest-TestVolumeBootPattern-1934687878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:33:07Z,user_data=None,user_id='77a27a7ebb4a458097c901871c378bc8',uuid=6d7cbba0-f920-424a-a204-0a935471afa0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43319393-6b0f-4945-965c-54d74152d41e", "address": "fa:16:3e:d9:e3:8c", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43319393-6b", "ovs_interfaceid": "43319393-6b0f-4945-965c-54d74152d41e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:33:27 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converting VIF {"id": "43319393-6b0f-4945-965c-54d74152d41e", "address": "fa:16:3e:d9:e3:8c", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43319393-6b", "ovs_interfaceid": "43319393-6b0f-4945-965c-54d74152d41e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:33:27 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e3:8c,bridge_name='br-int',has_traffic_filtering=True,id=43319393-6b0f-4945-965c-54d74152d41e,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43319393-6b') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:33:27 user nova-compute[74189]: DEBUG nova.objects.instance [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d7cbba0-f920-424a-a204-0a935471afa0 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:33:27 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:33:27 user nova-compute[74189]:   <uuid>6d7cbba0-f920-424a-a204-0a935471afa0</uuid>
Oct 25 21:33:27 user nova-compute[74189]:   <name>instance-00000025</name>
Oct 25 21:33:27 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:33:27 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:33:27 user nova-compute[74189]:   <metadata>
Oct 25 21:33:27 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:33:27 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:33:27 user nova-compute[74189]:       <nova:name>tempest-TestVolumeBootPattern-server-1328267637</nova:name>
Oct 25 21:33:27 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:33:26</nova:creationTime>
Oct 25 21:33:27 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:33:27 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:33:27 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:33:27 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:33:27 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:33:27 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:33:27 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:33:27 user nova-compute[74189]:       <nova:owner>
Oct 25 21:33:27 user nova-compute[74189]:         <nova:user uuid="77a27a7ebb4a458097c901871c378bc8">tempest-TestVolumeBootPattern-1934687878-project-member</nova:user>
Oct 25 21:33:27 user nova-compute[74189]:         <nova:project uuid="e893e8f3f58e4e15920d313b6391682c">tempest-TestVolumeBootPattern-1934687878</nova:project>
Oct 25 21:33:27 user nova-compute[74189]:       </nova:owner>
Oct 25 21:33:27 user nova-compute[74189]:       <nova:ports>
Oct 25 21:33:27 user nova-compute[74189]:         <nova:port uuid="43319393-6b0f-4945-965c-54d74152d41e">
Oct 25 21:33:27 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 21:33:27 user nova-compute[74189]:         </nova:port>
Oct 25 21:33:27 user nova-compute[74189]:       </nova:ports>
Oct 25 21:33:27 user nova-compute[74189]:     </nova:instance>
Oct 25 21:33:27 user nova-compute[74189]:   </metadata>
Oct 25 21:33:27 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:33:27 user nova-compute[74189]:     <system>
Oct 25 21:33:27 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:33:27 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:33:27 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:33:27 user nova-compute[74189]:       <entry name="serial">6d7cbba0-f920-424a-a204-0a935471afa0</entry>
Oct 25 21:33:27 user nova-compute[74189]:       <entry name="uuid">6d7cbba0-f920-424a-a204-0a935471afa0</entry>
Oct 25 21:33:27 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:33:27 user nova-compute[74189]:     </system>
Oct 25 21:33:27 user nova-compute[74189]:   </sysinfo>
Oct 25 21:33:27 user nova-compute[74189]:   <os>
Oct 25 21:33:27 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:33:27 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:33:27 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:33:27 user nova-compute[74189]:   </os>
Oct 25 21:33:27 user nova-compute[74189]:   <features>
Oct 25 21:33:27 user nova-compute[74189]:     <acpi/>
Oct 25 21:33:27 user nova-compute[74189]:     <apic/>
Oct 25 21:33:27 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:33:27 user nova-compute[74189]:   </features>
Oct 25 21:33:27 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:33:27 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:33:27 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:33:27 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:33:27 user nova-compute[74189]:   </clock>
Oct 25 21:33:27 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:33:27 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:33:27 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:33:27 user nova-compute[74189]:   </cpu>
Oct 25 21:33:27 user nova-compute[74189]:   <devices>
Oct 25 21:33:27 user nova-compute[74189]:     <disk type="block" device="disk">
Oct 25 21:33:27 user nova-compute[74189]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:33:27 user nova-compute[74189]:       <source dev="/dev/sdc"/>
Oct 25 21:33:27 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:33:27 user nova-compute[74189]:       <serial>8c22cfde-db3c-4c83-994c-46925b21920d</serial>
Oct 25 21:33:27 user nova-compute[74189]:     </disk>
Oct 25 21:33:27 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:33:27 user nova-compute[74189]:       <mac address="fa:16:3e:d9:e3:8c"/>
Oct 25 21:33:27 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:33:27 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:33:27 user nova-compute[74189]:       <target dev="tap43319393-6b"/>
Oct 25 21:33:27 user nova-compute[74189]:     </interface>
Oct 25 21:33:27 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:33:27 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/6d7cbba0-f920-424a-a204-0a935471afa0/console.log" append="off"/>
Oct 25 21:33:27 user nova-compute[74189]:     </serial>
Oct 25 21:33:27 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:33:27 user nova-compute[74189]:     <video>
Oct 25 21:33:27 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:33:27 user nova-compute[74189]:     </video>
Oct 25 21:33:27 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:33:27 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:33:27 user nova-compute[74189]:     </rng>
Oct 25 21:33:27 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:33:27 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:33:27 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:33:27 user nova-compute[74189]:     </memballoon>
Oct 25 21:33:27 user nova-compute[74189]:   </devices>
Oct 25 21:33:27 user nova-compute[74189]: </domain>
Oct 25 21:33:27 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:33:27 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:33:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1328267637',display_name='tempest-TestVolumeBootPattern-server-1328267637',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1328267637',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbWjlurUdlTqM38TJIvyWArBvgtPS5ByZ7GvbbNhterPxeMByoQxHeDSj3q/FAwbfZCzxGnbhX1L/9RQ/CSBOb1BJ9rZaqesREBo++7UKa99YIwO5kH0uL2CiEzhHllXw==',key_name='tempest-TestVolumeBootPattern-16841960',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e893e8f3f58e4e15920d313b6391682c',ramdisk_id='',reservation_id='r-v198xzw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1934687878',owner_user_name='tempest-TestVolumeBootPattern-1934687878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:33:07Z,user_data=None,user_id='77a27a7ebb4a458097c901871c378bc8',uuid=6d7cbba0-f920-424a-a204-0a935471afa0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43319393-6b0f-4945-965c-54d74152d41e", "address": "fa:16:3e:d9:e3:8c", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43319393-6b", "ovs_interfaceid": "43319393-6b0f-4945-965c-54d74152d41e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:33:27 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converting VIF {"id": "43319393-6b0f-4945-965c-54d74152d41e", "address": "fa:16:3e:d9:e3:8c", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43319393-6b", "ovs_interfaceid": "43319393-6b0f-4945-965c-54d74152d41e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:33:27 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e3:8c,bridge_name='br-int',has_traffic_filtering=True,id=43319393-6b0f-4945-965c-54d74152d41e,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43319393-6b') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:33:27 user nova-compute[74189]: DEBUG os_vif [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e3:8c,bridge_name='br-int',has_traffic_filtering=True,id=43319393-6b0f-4945-965c-54d74152d41e,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43319393-6b') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:33:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:33:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:33:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '65fe5b31-2904-526f-92fa-f66f5a4d66f7', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:33:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:33:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43319393-6b, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:33:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap43319393-6b, col_values=(('qos', UUID('ad9f8ade-7ff7-41a1-90b3-19920ceec832')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:33:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap43319393-6b, col_values=(('external_ids', {'iface-id': '43319393-6b0f-4945-965c-54d74152d41e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:e3:8c', 'vm-uuid': '6d7cbba0-f920-424a-a204-0a935471afa0'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:33:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:33:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:27 user nova-compute[74189]: INFO os_vif [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e3:8c,bridge_name='br-int',has_traffic_filtering=True,id=43319393-6b0f-4945-965c-54d74152d41e,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43319393-6b')
Oct 25 21:33:27 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:33:27 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] No VIF found with MAC fa:16:3e:d9:e3:8c, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:33:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-13445670-09f7-427c-97a6-fc5b9e2fa84b req-d18093b7-94a1-421c-9ca3-49920cc98960 service nova] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Received event network-vif-plugged-43319393-6b0f-4945-965c-54d74152d41e {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:33:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-13445670-09f7-427c-97a6-fc5b9e2fa84b req-d18093b7-94a1-421c-9ca3-49920cc98960 service nova] Acquiring lock "6d7cbba0-f920-424a-a204-0a935471afa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:33:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-13445670-09f7-427c-97a6-fc5b9e2fa84b req-d18093b7-94a1-421c-9ca3-49920cc98960 service nova] Lock "6d7cbba0-f920-424a-a204-0a935471afa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:33:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-13445670-09f7-427c-97a6-fc5b9e2fa84b req-d18093b7-94a1-421c-9ca3-49920cc98960 service nova] Lock "6d7cbba0-f920-424a-a204-0a935471afa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:33:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-13445670-09f7-427c-97a6-fc5b9e2fa84b req-d18093b7-94a1-421c-9ca3-49920cc98960 service nova] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] No waiting events found dispatching network-vif-plugged-43319393-6b0f-4945-965c-54d74152d41e {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:33:29 user nova-compute[74189]: WARNING nova.compute.manager [req-13445670-09f7-427c-97a6-fc5b9e2fa84b req-d18093b7-94a1-421c-9ca3-49920cc98960 service nova] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Received unexpected event network-vif-plugged-43319393-6b0f-4945-965c-54d74152d41e for instance with vm_state building and task_state spawning.
Oct 25 21:33:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "8f61139d-d075-41d7-bd04-cc977ec87578" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:33:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "8f61139d-d075-41d7-bd04-cc977ec87578" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:33:29 user nova-compute[74189]: DEBUG nova.compute.manager [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:33:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:33:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:33:30 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:33:30 user nova-compute[74189]: INFO nova.compute.claims [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Claim successful on node user
Oct 25 21:33:30 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:33:30 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:33:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.602s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:33:30 user nova-compute[74189]: DEBUG nova.compute.manager [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:33:30 user nova-compute[74189]: DEBUG nova.compute.manager [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:33:30 user nova-compute[74189]: DEBUG nova.network.neutron [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:33:30 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:33:30 user nova-compute[74189]: DEBUG nova.compute.manager [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:33:30 user nova-compute[74189]: DEBUG nova.policy [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a829dcf4095d45ab868a0ea904e9bfce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee1339c959b4cbebeefd550fc436c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:33:30 user nova-compute[74189]: DEBUG nova.compute.manager [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:33:30 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:33:30 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Creating image(s)
Oct 25 21:33:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "/opt/stack/data/nova/instances/8f61139d-d075-41d7-bd04-cc977ec87578/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:33:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "/opt/stack/data/nova/instances/8f61139d-d075-41d7-bd04-cc977ec87578/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:33:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "/opt/stack/data/nova/instances/8f61139d-d075-41d7-bd04-cc977ec87578/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:33:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "3d05a980ab0df46df2e211bfe8133762d6a32a18" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:33:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "3d05a980ab0df46df2e211bfe8133762d6a32a18" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:33:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d05a980ab0df46df2e211bfe8133762d6a32a18.part --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:31 user nova-compute[74189]: DEBUG nova.compute.manager [req-5fdb8c69-49d2-45ee-a8ec-6daded75381e req-6f1eacb3-73bc-4346-a970-fc9677cbbfb3 service nova] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Received event network-vif-plugged-43319393-6b0f-4945-965c-54d74152d41e {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:33:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-5fdb8c69-49d2-45ee-a8ec-6daded75381e req-6f1eacb3-73bc-4346-a970-fc9677cbbfb3 service nova] Acquiring lock "6d7cbba0-f920-424a-a204-0a935471afa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:33:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-5fdb8c69-49d2-45ee-a8ec-6daded75381e req-6f1eacb3-73bc-4346-a970-fc9677cbbfb3 service nova] Lock "6d7cbba0-f920-424a-a204-0a935471afa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.013s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:33:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-5fdb8c69-49d2-45ee-a8ec-6daded75381e req-6f1eacb3-73bc-4346-a970-fc9677cbbfb3 service nova] Lock "6d7cbba0-f920-424a-a204-0a935471afa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:33:31 user nova-compute[74189]: DEBUG nova.compute.manager [req-5fdb8c69-49d2-45ee-a8ec-6daded75381e req-6f1eacb3-73bc-4346-a970-fc9677cbbfb3 service nova] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] No waiting events found dispatching network-vif-plugged-43319393-6b0f-4945-965c-54d74152d41e {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:33:31 user nova-compute[74189]: WARNING nova.compute.manager [req-5fdb8c69-49d2-45ee-a8ec-6daded75381e req-6f1eacb3-73bc-4346-a970-fc9677cbbfb3 service nova] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Received unexpected event network-vif-plugged-43319393-6b0f-4945-965c-54d74152d41e for instance with vm_state building and task_state spawning.
Oct 25 21:33:31 user nova-compute[74189]: DEBUG nova.compute.manager [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:33:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:33:31 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Instance spawned successfully.
Oct 25 21:33:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:33:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:33:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:33:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:33:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:33:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:33:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:33:32 user nova-compute[74189]: DEBUG nova.network.neutron [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Successfully created port: 83f7d737-3cbc-4a68-8f5f-da99acae2d42 {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:33:32 user nova-compute[74189]: INFO nova.compute.manager [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Took 6.09 seconds to spawn the instance on the hypervisor.
Oct 25 21:33:32 user nova-compute[74189]: DEBUG nova.compute.manager [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:33:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d05a980ab0df46df2e211bfe8133762d6a32a18.part --force-share --output=json" returned: 0 in 0.230s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:32 user nova-compute[74189]: DEBUG nova.virt.images [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] edd168b8-e584-4508-a289-5067f7a9a84f was qcow2, converting to raw {{(pid=74189) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 21:33:32 user nova-compute[74189]: DEBUG nova.privsep.utils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74189) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 21:33:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3d05a980ab0df46df2e211bfe8133762d6a32a18.part /opt/stack/data/nova/instances/_base/3d05a980ab0df46df2e211bfe8133762d6a32a18.converted {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:32 user nova-compute[74189]: INFO nova.compute.manager [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Took 25.48 seconds to build instance.
Oct 25 21:33:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-99bb3e94-f8e7-407e-92e3-947ba4deb374 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "6d7cbba0-f920-424a-a204-0a935471afa0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.589s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:33:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3d05a980ab0df46df2e211bfe8133762d6a32a18.part /opt/stack/data/nova/instances/_base/3d05a980ab0df46df2e211bfe8133762d6a32a18.converted" returned: 0 in 0.317s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d05a980ab0df46df2e211bfe8133762d6a32a18.converted --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d05a980ab0df46df2e211bfe8133762d6a32a18.converted --force-share --output=json" returned: 0 in 0.201s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "3d05a980ab0df46df2e211bfe8133762d6a32a18" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.773s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:33:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d05a980ab0df46df2e211bfe8133762d6a32a18 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:32 user nova-compute[74189]: DEBUG nova.network.neutron [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Successfully updated port: 83f7d737-3cbc-4a68-8f5f-da99acae2d42 {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:33:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "refresh_cache-8f61139d-d075-41d7-bd04-cc977ec87578" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:33:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquired lock "refresh_cache-8f61139d-d075-41d7-bd04-cc977ec87578" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:33:32 user nova-compute[74189]: DEBUG nova.network.neutron [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:33:32 user nova-compute[74189]: DEBUG nova.network.neutron [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:33:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d05a980ab0df46df2e211bfe8133762d6a32a18 --force-share --output=json" returned: 0 in 0.191s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "3d05a980ab0df46df2e211bfe8133762d6a32a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:33:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "3d05a980ab0df46df2e211bfe8133762d6a32a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:33:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d05a980ab0df46df2e211bfe8133762d6a32a18 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d05a980ab0df46df2e211bfe8133762d6a32a18 --force-share --output=json" returned: 0 in 0.195s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3d05a980ab0df46df2e211bfe8133762d6a32a18,backing_fmt=raw /opt/stack/data/nova/instances/8f61139d-d075-41d7-bd04-cc977ec87578/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3d05a980ab0df46df2e211bfe8133762d6a32a18,backing_fmt=raw /opt/stack/data/nova/instances/8f61139d-d075-41d7-bd04-cc977ec87578/disk 1073741824" returned: 0 in 0.059s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "3d05a980ab0df46df2e211bfe8133762d6a32a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d05a980ab0df46df2e211bfe8133762d6a32a18 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d05a980ab0df46df2e211bfe8133762d6a32a18 --force-share --output=json" returned: 0 in 0.205s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8f61139d-d075-41d7-bd04-cc977ec87578/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f61139d-d075-41d7-bd04-cc977ec87578/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-39f0806d-5e95-463a-9e7b-c2905b3d2501 req-034834af-8b05-42e3-9435-674729fd5817 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Received event network-changed-83f7d737-3cbc-4a68-8f5f-da99acae2d42 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-39f0806d-5e95-463a-9e7b-c2905b3d2501 req-034834af-8b05-42e3-9435-674729fd5817 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Refreshing instance network info cache due to event network-changed-83f7d737-3cbc-4a68-8f5f-da99acae2d42. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-39f0806d-5e95-463a-9e7b-c2905b3d2501 req-034834af-8b05-42e3-9435-674729fd5817 service nova] Acquiring lock "refresh_cache-8f61139d-d075-41d7-bd04-cc977ec87578" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f61139d-d075-41d7-bd04-cc977ec87578/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Cannot resize image /opt/stack/data/nova/instances/8f61139d-d075-41d7-bd04-cc977ec87578/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Ensure instance console log exists: /opt/stack/data/nova/instances/8f61139d-d075-41d7-bd04-cc977ec87578/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.network.neutron [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Updating instance_info_cache with network_info: [{"id": "83f7d737-3cbc-4a68-8f5f-da99acae2d42", "address": "fa:16:3e:f8:7c:39", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f7d737-3c", "ovs_interfaceid": "83f7d737-3cbc-4a68-8f5f-da99acae2d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Releasing lock "refresh_cache-8f61139d-d075-41d7-bd04-cc977ec87578" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.compute.manager [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Instance network_info: |[{"id": "83f7d737-3cbc-4a68-8f5f-da99acae2d42", "address": "fa:16:3e:f8:7c:39", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f7d737-3c", "ovs_interfaceid": "83f7d737-3cbc-4a68-8f5f-da99acae2d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-39f0806d-5e95-463a-9e7b-c2905b3d2501 req-034834af-8b05-42e3-9435-674729fd5817 service nova] Acquired lock "refresh_cache-8f61139d-d075-41d7-bd04-cc977ec87578" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.network.neutron [req-39f0806d-5e95-463a-9e7b-c2905b3d2501 req-034834af-8b05-42e3-9435-674729fd5817 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Refreshing network info cache for port 83f7d737-3cbc-4a68-8f5f-da99acae2d42 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Start _get_guest_xml network_info=[{"id": "83f7d737-3cbc-4a68-8f5f-da99acae2d42", "address": "fa:16:3e:f8:7c:39", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f7d737-3c", "ovs_interfaceid": "83f7d737-3cbc-4a68-8f5f-da99acae2d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:33:27Z,direct_url=<?>,disk_format='qcow2',id=edd168b8-e584-4508-a289-5067f7a9a84f,min_disk=0,min_ram=0,name='tempest-scenario-img--543387807',owner='3ee1339c959b4cbebeefd550fc436c61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:33:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': 'edd168b8-e584-4508-a289-5067f7a9a84f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:33:33 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:33:33 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:33:27Z,direct_url=<?>,disk_format='qcow2',id=edd168b8-e584-4508-a289-5067f7a9a84f,min_disk=0,min_ram=0,name='tempest-scenario-img--543387807',owner='3ee1339c959b4cbebeefd550fc436c61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:33:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:33:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1184132038',display_name='tempest-TestMinimumBasicScenario-server-1184132038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1184132038',id=38,image_ref='edd168b8-e584-4508-a289-5067f7a9a84f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFABeGb2eW9FWXwpk7mHuxZn/QzdpuTanR0gI8CR6makjXS81iGEmSQVwyQe8yttiTuvjVGFiCkhwTeUstfZnfc30mXENFXNpKYGkEYJZDpv7vYHE8TIrHRK8ElvlDxug==',key_name='tempest-TestMinimumBasicScenario-1999727037',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ee1339c959b4cbebeefd550fc436c61',ramdisk_id='',reservation_id='r-6y278z7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='edd168b8-e584-4508-a289-5067f7a9a84f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1857244532',owner_user_name='tempest-TestMinimumBasicScenario-1857244532-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:33:31Z,user_data=None,user_id='a829dcf4095d45ab868a0ea904e9bfce',uuid=8f61139d-d075-41d7-bd04-cc977ec87578,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83f7d737-3cbc-4a68-8f5f-da99acae2d42", "address": "fa:16:3e:f8:7c:39", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f7d737-3c", "ovs_interfaceid": "83f7d737-3cbc-4a68-8f5f-da99acae2d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Converting VIF {"id": "83f7d737-3cbc-4a68-8f5f-da99acae2d42", "address": "fa:16:3e:f8:7c:39", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f7d737-3c", "ovs_interfaceid": "83f7d737-3cbc-4a68-8f5f-da99acae2d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:7c:39,bridge_name='br-int',has_traffic_filtering=True,id=83f7d737-3cbc-4a68-8f5f-da99acae2d42,network=Network(d0eb2495-d624-4f66-91a4-2d97b9461a19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83f7d737-3c') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.objects.instance [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f61139d-d075-41d7-bd04-cc977ec87578 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:33:33 user nova-compute[74189]:   <uuid>8f61139d-d075-41d7-bd04-cc977ec87578</uuid>
Oct 25 21:33:33 user nova-compute[74189]:   <name>instance-00000026</name>
Oct 25 21:33:33 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:33:33 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:33:33 user nova-compute[74189]:   <metadata>
Oct 25 21:33:33 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:33:33 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:33:33 user nova-compute[74189]:       <nova:name>tempest-TestMinimumBasicScenario-server-1184132038</nova:name>
Oct 25 21:33:33 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:33:33</nova:creationTime>
Oct 25 21:33:33 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:33:33 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:33:33 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:33:33 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:33:33 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:33:33 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:33:33 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:33:33 user nova-compute[74189]:       <nova:owner>
Oct 25 21:33:33 user nova-compute[74189]:         <nova:user uuid="a829dcf4095d45ab868a0ea904e9bfce">tempest-TestMinimumBasicScenario-1857244532-project-member</nova:user>
Oct 25 21:33:33 user nova-compute[74189]:         <nova:project uuid="3ee1339c959b4cbebeefd550fc436c61">tempest-TestMinimumBasicScenario-1857244532</nova:project>
Oct 25 21:33:33 user nova-compute[74189]:       </nova:owner>
Oct 25 21:33:33 user nova-compute[74189]:       <nova:root type="image" uuid="edd168b8-e584-4508-a289-5067f7a9a84f"/>
Oct 25 21:33:33 user nova-compute[74189]:       <nova:ports>
Oct 25 21:33:33 user nova-compute[74189]:         <nova:port uuid="83f7d737-3cbc-4a68-8f5f-da99acae2d42">
Oct 25 21:33:33 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 25 21:33:33 user nova-compute[74189]:         </nova:port>
Oct 25 21:33:33 user nova-compute[74189]:       </nova:ports>
Oct 25 21:33:33 user nova-compute[74189]:     </nova:instance>
Oct 25 21:33:33 user nova-compute[74189]:   </metadata>
Oct 25 21:33:33 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:33:33 user nova-compute[74189]:     <system>
Oct 25 21:33:33 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:33:33 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:33:33 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:33:33 user nova-compute[74189]:       <entry name="serial">8f61139d-d075-41d7-bd04-cc977ec87578</entry>
Oct 25 21:33:33 user nova-compute[74189]:       <entry name="uuid">8f61139d-d075-41d7-bd04-cc977ec87578</entry>
Oct 25 21:33:33 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:33:33 user nova-compute[74189]:     </system>
Oct 25 21:33:33 user nova-compute[74189]:   </sysinfo>
Oct 25 21:33:33 user nova-compute[74189]:   <os>
Oct 25 21:33:33 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:33:33 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:33:33 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:33:33 user nova-compute[74189]:   </os>
Oct 25 21:33:33 user nova-compute[74189]:   <features>
Oct 25 21:33:33 user nova-compute[74189]:     <acpi/>
Oct 25 21:33:33 user nova-compute[74189]:     <apic/>
Oct 25 21:33:33 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:33:33 user nova-compute[74189]:   </features>
Oct 25 21:33:33 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:33:33 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:33:33 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:33:33 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:33:33 user nova-compute[74189]:   </clock>
Oct 25 21:33:33 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:33:33 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:33:33 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:33:33 user nova-compute[74189]:   </cpu>
Oct 25 21:33:33 user nova-compute[74189]:   <devices>
Oct 25 21:33:33 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:33:33 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:33:33 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/8f61139d-d075-41d7-bd04-cc977ec87578/disk"/>
Oct 25 21:33:33 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:33:33 user nova-compute[74189]:     </disk>
Oct 25 21:33:33 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:33:33 user nova-compute[74189]:       <mac address="fa:16:3e:f8:7c:39"/>
Oct 25 21:33:33 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:33:33 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:33:33 user nova-compute[74189]:       <target dev="tap83f7d737-3c"/>
Oct 25 21:33:33 user nova-compute[74189]:     </interface>
Oct 25 21:33:33 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:33:33 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/8f61139d-d075-41d7-bd04-cc977ec87578/console.log" append="off"/>
Oct 25 21:33:33 user nova-compute[74189]:     </serial>
Oct 25 21:33:33 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:33:33 user nova-compute[74189]:     <video>
Oct 25 21:33:33 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:33:33 user nova-compute[74189]:     </video>
Oct 25 21:33:33 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:33:33 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:33:33 user nova-compute[74189]:     </rng>
Oct 25 21:33:33 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:33:33 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:33:33 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:33:33 user nova-compute[74189]:     </memballoon>
Oct 25 21:33:33 user nova-compute[74189]:   </devices>
Oct 25 21:33:33 user nova-compute[74189]: </domain>
Oct 25 21:33:33 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:33:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1184132038',display_name='tempest-TestMinimumBasicScenario-server-1184132038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1184132038',id=38,image_ref='edd168b8-e584-4508-a289-5067f7a9a84f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFABeGb2eW9FWXwpk7mHuxZn/QzdpuTanR0gI8CR6makjXS81iGEmSQVwyQe8yttiTuvjVGFiCkhwTeUstfZnfc30mXENFXNpKYGkEYJZDpv7vYHE8TIrHRK8ElvlDxug==',key_name='tempest-TestMinimumBasicScenario-1999727037',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ee1339c959b4cbebeefd550fc436c61',ramdisk_id='',reservation_id='r-6y278z7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='edd168b8-e584-4508-a289-5067f7a9a84f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1857244532',owner_user_name='tempest-TestMinimumBasicScenario-1857244532-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:33:31Z,user_data=None,user_id='a829dcf4095d45ab868a0ea904e9bfce',uuid=8f61139d-d075-41d7-bd04-cc977ec87578,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83f7d737-3cbc-4a68-8f5f-da99acae2d42", "address": "fa:16:3e:f8:7c:39", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f7d737-3c", "ovs_interfaceid": "83f7d737-3cbc-4a68-8f5f-da99acae2d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Converting VIF {"id": "83f7d737-3cbc-4a68-8f5f-da99acae2d42", "address": "fa:16:3e:f8:7c:39", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f7d737-3c", "ovs_interfaceid": "83f7d737-3cbc-4a68-8f5f-da99acae2d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:7c:39,bridge_name='br-int',has_traffic_filtering=True,id=83f7d737-3cbc-4a68-8f5f-da99acae2d42,network=Network(d0eb2495-d624-4f66-91a4-2d97b9461a19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83f7d737-3c') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG os_vif [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:7c:39,bridge_name='br-int',has_traffic_filtering=True,id=83f7d737-3cbc-4a68-8f5f-da99acae2d42,network=Network(d0eb2495-d624-4f66-91a4-2d97b9461a19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83f7d737-3c') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d719162-7d36-56a2-8530-4fd803fc7479', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83f7d737-3c, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap83f7d737-3c, col_values=(('qos', UUID('98dea269-9938-4097-bd24-0457f0f288c8')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap83f7d737-3c, col_values=(('external_ids', {'iface-id': '83f7d737-3cbc-4a68-8f5f-da99acae2d42', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:7c:39', 'vm-uuid': '8f61139d-d075-41d7-bd04-cc977ec87578'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:33 user nova-compute[74189]: INFO os_vif [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:7c:39,bridge_name='br-int',has_traffic_filtering=True,id=83f7d737-3cbc-4a68-8f5f-da99acae2d42,network=Network(d0eb2495-d624-4f66-91a4-2d97b9461a19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83f7d737-3c')
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] No VIF found with MAC fa:16:3e:f8:7c:39, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:33:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:34 user nova-compute[74189]: DEBUG nova.network.neutron [req-39f0806d-5e95-463a-9e7b-c2905b3d2501 req-034834af-8b05-42e3-9435-674729fd5817 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Updated VIF entry in instance network info cache for port 83f7d737-3cbc-4a68-8f5f-da99acae2d42. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:33:34 user nova-compute[74189]: DEBUG nova.network.neutron [req-39f0806d-5e95-463a-9e7b-c2905b3d2501 req-034834af-8b05-42e3-9435-674729fd5817 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Updating instance_info_cache with network_info: [{"id": "83f7d737-3cbc-4a68-8f5f-da99acae2d42", "address": "fa:16:3e:f8:7c:39", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f7d737-3c", "ovs_interfaceid": "83f7d737-3cbc-4a68-8f5f-da99acae2d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:33:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-39f0806d-5e95-463a-9e7b-c2905b3d2501 req-034834af-8b05-42e3-9435-674729fd5817 service nova] Releasing lock "refresh_cache-8f61139d-d075-41d7-bd04-cc977ec87578" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:33:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-4df0b262-4d74-4b11-bf17-54f37829c4d1 req-c09f96cd-3d5b-4843-bf12-190891ddb0a4 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Received event network-vif-plugged-83f7d737-3cbc-4a68-8f5f-da99acae2d42 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:33:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4df0b262-4d74-4b11-bf17-54f37829c4d1 req-c09f96cd-3d5b-4843-bf12-190891ddb0a4 service nova] Acquiring lock "8f61139d-d075-41d7-bd04-cc977ec87578-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:33:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4df0b262-4d74-4b11-bf17-54f37829c4d1 req-c09f96cd-3d5b-4843-bf12-190891ddb0a4 service nova] Lock "8f61139d-d075-41d7-bd04-cc977ec87578-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:33:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4df0b262-4d74-4b11-bf17-54f37829c4d1 req-c09f96cd-3d5b-4843-bf12-190891ddb0a4 service nova] Lock "8f61139d-d075-41d7-bd04-cc977ec87578-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:33:35 user nova-compute[74189]: DEBUG nova.compute.manager [req-4df0b262-4d74-4b11-bf17-54f37829c4d1 req-c09f96cd-3d5b-4843-bf12-190891ddb0a4 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] No waiting events found dispatching network-vif-plugged-83f7d737-3cbc-4a68-8f5f-da99acae2d42 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:33:35 user nova-compute[74189]: WARNING nova.compute.manager [req-4df0b262-4d74-4b11-bf17-54f37829c4d1 req-c09f96cd-3d5b-4843-bf12-190891ddb0a4 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Received unexpected event network-vif-plugged-83f7d737-3cbc-4a68-8f5f-da99acae2d42 for instance with vm_state building and task_state spawning.
Oct 25 21:33:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:37 user nova-compute[74189]: DEBUG nova.compute.manager [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:33:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:33:37 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Instance spawned successfully.
Oct 25 21:33:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:33:37 user nova-compute[74189]: DEBUG nova.compute.manager [req-36f354e4-f2b0-4ca3-916a-3273c3b47e0b req-715be773-ac8a-4d8f-9efd-04b1e939779f service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Received event network-vif-plugged-83f7d737-3cbc-4a68-8f5f-da99acae2d42 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:33:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-36f354e4-f2b0-4ca3-916a-3273c3b47e0b req-715be773-ac8a-4d8f-9efd-04b1e939779f service nova] Acquiring lock "8f61139d-d075-41d7-bd04-cc977ec87578-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:33:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-36f354e4-f2b0-4ca3-916a-3273c3b47e0b req-715be773-ac8a-4d8f-9efd-04b1e939779f service nova] Lock "8f61139d-d075-41d7-bd04-cc977ec87578-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:33:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-36f354e4-f2b0-4ca3-916a-3273c3b47e0b req-715be773-ac8a-4d8f-9efd-04b1e939779f service nova] Lock "8f61139d-d075-41d7-bd04-cc977ec87578-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:33:37 user nova-compute[74189]: DEBUG nova.compute.manager [req-36f354e4-f2b0-4ca3-916a-3273c3b47e0b req-715be773-ac8a-4d8f-9efd-04b1e939779f service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] No waiting events found dispatching network-vif-plugged-83f7d737-3cbc-4a68-8f5f-da99acae2d42 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:33:37 user nova-compute[74189]: WARNING nova.compute.manager [req-36f354e4-f2b0-4ca3-916a-3273c3b47e0b req-715be773-ac8a-4d8f-9efd-04b1e939779f service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Received unexpected event network-vif-plugged-83f7d737-3cbc-4a68-8f5f-da99acae2d42 for instance with vm_state building and task_state spawning.
Oct 25 21:33:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:33:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:33:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:33:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:33:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:33:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:33:37 user nova-compute[74189]: INFO nova.compute.manager [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Took 6.77 seconds to spawn the instance on the hypervisor.
Oct 25 21:33:37 user nova-compute[74189]: DEBUG nova.compute.manager [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:33:37 user nova-compute[74189]: INFO nova.compute.manager [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Took 7.76 seconds to build instance.
Oct 25 21:33:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6b88e92f-f247-4676-9594-1cb3ccdf851a tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "8f61139d-d075-41d7-bd04-cc977ec87578" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.859s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:33:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:46 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "1926c2ce-9643-4d00-9f54-a6747e71875b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:33:46 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "1926c2ce-9643-4d00-9f54-a6747e71875b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:33:46 user nova-compute[74189]: DEBUG nova.compute.manager [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:33:46 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:33:46 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:33:46 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:33:46 user nova-compute[74189]: INFO nova.compute.claims [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Claim successful on node user
Oct 25 21:33:46 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:33:46 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:33:46 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.510s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:33:46 user nova-compute[74189]: DEBUG nova.compute.manager [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:33:46 user nova-compute[74189]: DEBUG nova.compute.manager [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:33:46 user nova-compute[74189]: DEBUG nova.network.neutron [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:33:46 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:33:46 user nova-compute[74189]: DEBUG nova.compute.manager [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:33:46 user nova-compute[74189]: DEBUG nova.policy [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b34817b1868f40a38a32a51d0e970d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4815aedea48841188ed8797a0eb51925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:33:46 user nova-compute[74189]: INFO nova.virt.block_device [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Booting with volume 4eb01afd-1b09-48a3-ab75-9326700c7e98 at /dev/vda
Oct 25 21:33:46 user nova-compute[74189]: DEBUG os_brick.utils [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:33:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:47 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53d80ea-4ed9-4aa3-9002-2f62b58e7de9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:33:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:47 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f6c59a-7405-4d60-918f-93c90fd41d02]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:33:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:47 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8b4e09-756f-4016-95cc-10801ad9b8e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:33:47 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0462ebab-72d4-431b-a96e-1f26a9ef598d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:33:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:33:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:33:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:33:47 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:33:47 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4703577a-5bb8-4984-a506-3301fe232f83]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:33:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:33:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:33:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:33:47 user nova-compute[74189]: DEBUG os_brick.utils [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:33:47 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Updating existing volume attachment record: c303fa9e-803a-4a32-80c5-8e0913eb0ce6 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:33:47 user nova-compute[74189]: DEBUG nova.network.neutron [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Successfully created port: 5d26f4c0-286d-4528-95fc-2d881f739fd2 {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:33:48 user nova-compute[74189]: DEBUG nova.network.neutron [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Successfully updated port: 5d26f4c0-286d-4528-95fc-2d881f739fd2 {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:33:48 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "refresh_cache-1926c2ce-9643-4d00-9f54-a6747e71875b" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:33:48 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquired lock "refresh_cache-1926c2ce-9643-4d00-9f54-a6747e71875b" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:33:48 user nova-compute[74189]: DEBUG nova.network.neutron [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:33:48 user nova-compute[74189]: DEBUG nova.compute.manager [req-9c3155cf-f224-4812-a1d9-3366d95beb7e req-6ad367d9-ee18-401c-a3ff-65a425773223 service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Received event network-changed-5d26f4c0-286d-4528-95fc-2d881f739fd2 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:33:48 user nova-compute[74189]: DEBUG nova.compute.manager [req-9c3155cf-f224-4812-a1d9-3366d95beb7e req-6ad367d9-ee18-401c-a3ff-65a425773223 service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Refreshing instance network info cache due to event network-changed-5d26f4c0-286d-4528-95fc-2d881f739fd2. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:33:48 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9c3155cf-f224-4812-a1d9-3366d95beb7e req-6ad367d9-ee18-401c-a3ff-65a425773223 service nova] Acquiring lock "refresh_cache-1926c2ce-9643-4d00-9f54-a6747e71875b" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:33:48 user nova-compute[74189]: DEBUG nova.network.neutron [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:33:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:49 user nova-compute[74189]: DEBUG nova.network.neutron [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Updating instance_info_cache with network_info: [{"id": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "address": "fa:16:3e:6e:2f:0e", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d26f4c0-28", "ovs_interfaceid": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:33:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Releasing lock "refresh_cache-1926c2ce-9643-4d00-9f54-a6747e71875b" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:33:49 user nova-compute[74189]: DEBUG nova.compute.manager [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Instance network_info: |[{"id": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "address": "fa:16:3e:6e:2f:0e", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d26f4c0-28", "ovs_interfaceid": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:33:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9c3155cf-f224-4812-a1d9-3366d95beb7e req-6ad367d9-ee18-401c-a3ff-65a425773223 service nova] Acquired lock "refresh_cache-1926c2ce-9643-4d00-9f54-a6747e71875b" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:33:49 user nova-compute[74189]: DEBUG nova.network.neutron [req-9c3155cf-f224-4812-a1d9-3366d95beb7e req-6ad367d9-ee18-401c-a3ff-65a425773223 service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Refreshing network info cache for port 5d26f4c0-286d-4528-95fc-2d881f739fd2 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:33:49 user nova-compute[74189]: DEBUG nova.network.neutron [req-9c3155cf-f224-4812-a1d9-3366d95beb7e req-6ad367d9-ee18-401c-a3ff-65a425773223 service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Updated VIF entry in instance network info cache for port 5d26f4c0-286d-4528-95fc-2d881f739fd2. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:33:49 user nova-compute[74189]: DEBUG nova.network.neutron [req-9c3155cf-f224-4812-a1d9-3366d95beb7e req-6ad367d9-ee18-401c-a3ff-65a425773223 service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Updating instance_info_cache with network_info: [{"id": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "address": "fa:16:3e:6e:2f:0e", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d26f4c0-28", "ovs_interfaceid": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:33:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9c3155cf-f224-4812-a1d9-3366d95beb7e req-6ad367d9-ee18-401c-a3ff-65a425773223 service nova] Releasing lock "refresh_cache-1926c2ce-9643-4d00-9f54-a6747e71875b" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:33:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:33:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:33:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:33:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:33:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:33:49 user nova-compute[74189]: INFO nova.compute.manager [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Terminating instance
Oct 25 21:33:49 user nova-compute[74189]: DEBUG nova.compute.manager [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG nova.compute.manager [req-8ce21a18-2de4-4307-b9a2-4412b6775597 req-9fe4b352-22af-4ca0-b7e4-52360832ee3f service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Received event network-vif-unplugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8ce21a18-2de4-4307-b9a2-4412b6775597 req-9fe4b352-22af-4ca0-b7e4-52360832ee3f service nova] Acquiring lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8ce21a18-2de4-4307-b9a2-4412b6775597 req-9fe4b352-22af-4ca0-b7e4-52360832ee3f service nova] Lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8ce21a18-2de4-4307-b9a2-4412b6775597 req-9fe4b352-22af-4ca0-b7e4-52360832ee3f service nova] Lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG nova.compute.manager [req-8ce21a18-2de4-4307-b9a2-4412b6775597 req-9fe4b352-22af-4ca0-b7e4-52360832ee3f service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] No waiting events found dispatching network-vif-unplugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG nova.compute.manager [req-8ce21a18-2de4-4307-b9a2-4412b6775597 req-9fe4b352-22af-4ca0-b7e4-52360832ee3f service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Received event network-vif-unplugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:50 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Instance destroyed successfully.
Oct 25 21:33:50 user nova-compute[74189]: DEBUG nova.objects.instance [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lazy-loading 'resources' on Instance uuid 9733d5c8-4476-4903-bd1b-16d43a54fdbd {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:28:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1402889467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1402889467',id=30,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:30:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='acbb4f93936848a8949477ad124bf98e',ramdisk_id='',reservation_id='r-d1r52c8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-571481303',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:32:04Z,user_data=None,user_id='fc377c1beaab443683a6d776f2f734ff',uuid=9733d5c8-4476-4903-bd1b-16d43a54fdbd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "005bac46-8900-46a0-bb7f-d8672c6d2fc1", "address": "fa:16:3e:1d:ce:94", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap005bac46-89", "ovs_interfaceid": "005bac46-8900-46a0-bb7f-d8672c6d2fc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Converting VIF {"id": "005bac46-8900-46a0-bb7f-d8672c6d2fc1", "address": "fa:16:3e:1d:ce:94", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap005bac46-89", "ovs_interfaceid": "005bac46-8900-46a0-bb7f-d8672c6d2fc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:ce:94,bridge_name='br-int',has_traffic_filtering=True,id=005bac46-8900-46a0-bb7f-d8672c6d2fc1,network=Network(f202171f-dfd8-4a19-9321-788318413ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap005bac46-89') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG os_vif [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:ce:94,bridge_name='br-int',has_traffic_filtering=True,id=005bac46-8900-46a0-bb7f-d8672c6d2fc1,network=Network(f202171f-dfd8-4a19-9321-788318413ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap005bac46-89') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap005bac46-89, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fb256f93-1dc6-4f2e-91bf-d4aa1bde3efc) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:50 user nova-compute[74189]: INFO os_vif [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:ce:94,bridge_name='br-int',has_traffic_filtering=True,id=005bac46-8900-46a0-bb7f-d8672c6d2fc1,network=Network(f202171f-dfd8-4a19-9321-788318413ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap005bac46-89')
Oct 25 21:33:50 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vTqMWNCD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:33:50 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:33:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0ef7b2-4ea2-4122-b5c8-cabac064216c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:33:50 user nova-compute[74189]: No targets found.
Oct 25 21:33:50 user nova-compute[74189]: iSNS:
Oct 25 21:33:50 user nova-compute[74189]: No targets found.
Oct 25 21:33:50 user nova-compute[74189]: STATIC:
Oct 25 21:33:50 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce
Oct 25 21:33:50 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:33:50 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:33:50 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d
Oct 25 21:33:50 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:33:50 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:33:50 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:33:50 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:33:50 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:33:50 user nova-compute[74189]: FIRMWARE:
Oct 25 21:33:50 user nova-compute[74189]: No targets found.
Oct 25 21:33:50 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:33:50 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:33:50 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b42394-3801-45cd-9a10-c98810a920ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b095258c-100e-45d5-be5b-e21c9d4b80cc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:33:50 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:33:50 user nova-compute[74189]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)
Oct 25 21:33:50 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:33:50 user nova-compute[74189]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce (non-flash)
Oct 25 21:33:50 user nova-compute[74189]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)
Oct 25 21:33:50 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2e4243130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce'): ({'sde'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Removing single pathed devices sde {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2465a6-185c-4483-b2db-d9ba8029d167]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5e29bc-79c4-4fad-97e9-10d740e444ad]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Flushing IO for device /dev/sde {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:51 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a8e257-a262-483d-8307-d6d4e7987d62]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:33:51 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:33:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:51 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d17f50-0d28-4653-8b33-7a35bf9a04f3]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:33:51 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:33:51 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] SCSI volumes sde have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:33:51 user nova-compute[74189]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_f084d933', '/dev/disk/by-id/scsi-1SCST_BIOf084d933-93d7b814bf16fd1d', '/dev/disk/by-id/scsi-23933643762383134') {{(pid=85079) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 25 21:33:51 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8be954-5b47-4147-bb2b-1e334a17f3ba]: (4, None) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:33:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:33:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:51 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f011955f-d6dc-407c-86ef-62d88b3e0b29]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:33:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:33:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:51 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9837b893-e4a3-46c6-8499-3b259a9442af]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:33:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce, portal: 172.16.0.220,3260]
Oct 25 21:33:51 user nova-compute[74189]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce, portal: 172.16.0.220,3260] successful.
Oct 25 21:33:51 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:33:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:33:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfec83e7-d226-4e7e-958d-1d53f9ddcbce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:33:51 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc24bdac-d201-4616-b847-c028ca3c341b]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:33:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:33:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:33:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] <== disconnect_volume: return (339ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:33:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:33:51 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Deleting instance files /opt/stack/data/nova/instances/9733d5c8-4476-4903-bd1b-16d43a54fdbd_del
Oct 25 21:33:51 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Deletion of /opt/stack/data/nova/instances/9733d5c8-4476-4903-bd1b-16d43a54fdbd_del complete
Oct 25 21:33:51 user nova-compute[74189]: INFO nova.compute.manager [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Took 1.25 seconds to destroy the instance on the hypervisor.
Oct 25 21:33:51 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:33:51 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:33:51 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:33:51 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:33:51 user nova-compute[74189]: DEBUG nova.compute.manager [req-93729776-110f-40f4-857c-651bdabdcd88 req-38808aca-1f2f-4ad8-ad46-78aa939c04f5 service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Received event network-vif-deleted-005bac46-8900-46a0-bb7f-d8672c6d2fc1 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:33:51 user nova-compute[74189]: INFO nova.compute.manager [req-93729776-110f-40f4-857c-651bdabdcd88 req-38808aca-1f2f-4ad8-ad46-78aa939c04f5 service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Neutron deleted interface 005bac46-8900-46a0-bb7f-d8672c6d2fc1; detaching it from the instance and deleting it from the info cache
Oct 25 21:33:51 user nova-compute[74189]: DEBUG nova.network.neutron [req-93729776-110f-40f4-857c-651bdabdcd88 req-38808aca-1f2f-4ad8-ad46-78aa939c04f5 service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:33:51 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Took 0.66 seconds to deallocate network for instance.
Oct 25 21:33:51 user nova-compute[74189]: DEBUG nova.compute.manager [req-93729776-110f-40f4-857c-651bdabdcd88 req-38808aca-1f2f-4ad8-ad46-78aa939c04f5 service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Detach interface failed, port_id=005bac46-8900-46a0-bb7f-d8672c6d2fc1, reason: Instance 9733d5c8-4476-4903-bd1b-16d43a54fdbd could not be found. {{(pid=74189) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 21:33:52 user nova-compute[74189]: DEBUG nova.compute.manager [req-42a36477-ac6e-4c5e-a770-90b36f501428 req-5350a201-aa2a-430c-b334-c5e11323a951 service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Received event network-vif-plugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:33:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-42a36477-ac6e-4c5e-a770-90b36f501428 req-5350a201-aa2a-430c-b334-c5e11323a951 service nova] Acquiring lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:33:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-42a36477-ac6e-4c5e-a770-90b36f501428 req-5350a201-aa2a-430c-b334-c5e11323a951 service nova] Lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:33:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-42a36477-ac6e-4c5e-a770-90b36f501428 req-5350a201-aa2a-430c-b334-c5e11323a951 service nova] Lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:33:52 user nova-compute[74189]: DEBUG nova.compute.manager [req-42a36477-ac6e-4c5e-a770-90b36f501428 req-5350a201-aa2a-430c-b334-c5e11323a951 service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] No waiting events found dispatching network-vif-plugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:33:52 user nova-compute[74189]: WARNING nova.compute.manager [req-42a36477-ac6e-4c5e-a770-90b36f501428 req-5350a201-aa2a-430c-b334-c5e11323a951 service nova] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Received unexpected event network-vif-plugged-005bac46-8900-46a0-bb7f-d8672c6d2fc1 for instance with vm_state active and task_state deleting.
Oct 25 21:33:52 user nova-compute[74189]: INFO nova.compute.manager [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 9733d5c8-4476-4903-bd1b-16d43a54fdbd] Took 0.87 seconds to detach 1 volumes for instance.
Oct 25 21:33:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:33:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:33:53 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:33:53 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:33:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.444s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:33:53 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Deleted allocations for instance 9733d5c8-4476-4903-bd1b-16d43a54fdbd
Oct 25 21:33:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-46e2707c-e4fe-48da-82f4-2be0a428c434 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "9733d5c8-4476-4903-bd1b-16d43a54fdbd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.458s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:33:53 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:33:55 user nova-compute[74189]: DEBUG nova.compute.manager [req-bbf33ea9-1a4a-42bd-af44-aa854e874c80 req-cdef82f7-48a4-4fb5-86fd-66ce81c384ab service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Received event network-changed-22b40255-2ff7-4639-8c10-0959ac5f5917 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:33:55 user nova-compute[74189]: DEBUG nova.compute.manager [req-bbf33ea9-1a4a-42bd-af44-aa854e874c80 req-cdef82f7-48a4-4fb5-86fd-66ce81c384ab service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Refreshing instance network info cache due to event network-changed-22b40255-2ff7-4639-8c10-0959ac5f5917. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:33:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bbf33ea9-1a4a-42bd-af44-aa854e874c80 req-cdef82f7-48a4-4fb5-86fd-66ce81c384ab service nova] Acquiring lock "refresh_cache-a393d263-97a8-4103-a9b4-866b5d6fc435" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:33:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bbf33ea9-1a4a-42bd-af44-aa854e874c80 req-cdef82f7-48a4-4fb5-86fd-66ce81c384ab service nova] Acquired lock "refresh_cache-a393d263-97a8-4103-a9b4-866b5d6fc435" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:33:55 user nova-compute[74189]: DEBUG nova.network.neutron [req-bbf33ea9-1a4a-42bd-af44-aa854e874c80 req-cdef82f7-48a4-4fb5-86fd-66ce81c384ab service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Refreshing network info cache for port 22b40255-2ff7-4639-8c10-0959ac5f5917 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:33:56 user nova-compute[74189]: DEBUG nova.network.neutron [req-bbf33ea9-1a4a-42bd-af44-aa854e874c80 req-cdef82f7-48a4-4fb5-86fd-66ce81c384ab service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Updated VIF entry in instance network info cache for port 22b40255-2ff7-4639-8c10-0959ac5f5917. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:33:56 user nova-compute[74189]: DEBUG nova.network.neutron [req-bbf33ea9-1a4a-42bd-af44-aa854e874c80 req-cdef82f7-48a4-4fb5-86fd-66ce81c384ab service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Updating instance_info_cache with network_info: [{"id": "22b40255-2ff7-4639-8c10-0959ac5f5917", "address": "fa:16:3e:26:05:ef", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b40255-2f", "ovs_interfaceid": "22b40255-2ff7-4639-8c10-0959ac5f5917", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:33:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bbf33ea9-1a4a-42bd-af44-aa854e874c80 req-cdef82f7-48a4-4fb5-86fd-66ce81c384ab service nova] Releasing lock "refresh_cache-a393d263-97a8-4103-a9b4-866b5d6fc435" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:33:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "a393d263-97a8-4103-a9b4-866b5d6fc435" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:34:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "a393d263-97a8-4103-a9b4-866b5d6fc435" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:34:03 user nova-compute[74189]: DEBUG nova.objects.instance [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lazy-loading 'flavor' on Instance uuid a393d263-97a8-4103-a9b4-866b5d6fc435 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:34:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "a393d263-97a8-4103-a9b4-866b5d6fc435" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:34:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "a393d263-97a8-4103-a9b4-866b5d6fc435" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:34:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "a393d263-97a8-4103-a9b4-866b5d6fc435" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:34:03 user nova-compute[74189]: INFO nova.compute.manager [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Attaching volume 7f48db4b-d544-44f3-9123-208a34e8731c to /dev/vdb
Oct 25 21:34:03 user nova-compute[74189]: DEBUG os_brick.utils [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:34:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d47846-26bc-4682-bc31-c19adf0ff9e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7efe68-1fc8-490d-830e-d885826620de]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[717f9ae3-10bf-43c7-8b6c-2012310c28e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c8aaff-720d-4481-aca5-d7a485b62b35]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:34:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:34:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:34:03 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:34:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cf5bf0-d223-4e00-aa62-23591e68822e]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:34:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:34:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:34:03 user nova-compute[74189]: DEBUG os_brick.utils [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:34:03 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Updating existing volume attachment record: 767f656c-2a46-4b75-a4df-b1bf19124427 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:34:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG nova.compute.manager [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:34:05 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Creating image(s)
Oct 25 21:34:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Did not create local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Ensure instance console log exists: /opt/stack/data/nova/instances/1926c2ce-9643-4d00-9f54-a6747e71875b/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Start _get_guest_xml network_info=[{"id": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "address": "fa:16:3e:6e:2f:0e", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d26f4c0-28", "ovs_interfaceid": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsJSLGjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1926c2ce-9643-4d00-9f54-a6747e71875b', 'attached_at': '', 'detached_at': '', 'volume_id': '4eb01afd-1b09-48a3-ab75-9326700c7e98', 'serial': '4eb01afd-1b09-48a3-ab75-9326700c7e98'}, 'attachment_id': 'c303fa9e-803a-4a32-80c5-8e0913eb0ce6', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:34:05 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:34:05 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:34:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsJSLGjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:34:05 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:34:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:34:05 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:34:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:34:05 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d143e10a-76b8-49b9-84f7-ef7fec80002e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:34:05 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c1c0b6-3b9d-4cac-aa44-2bd1c520375b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98] added
Oct 25 21:34:05 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba0243c-e059-4c65-9948-9e8f3208c1e2]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3589ab24-6337-413d-9f27-a858420a2d28]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EsJSLGjP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EsJSLGjP" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[097cc6e1-31d9-4363-9690-9dfc028c892e]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EsJSLGjP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32c9951-46c0-45de-a80e-d86f1121fd22]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[001dcad4-5f04-4a8c-9e37-e1562d357959]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:34:05 user nova-compute[74189]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)
Oct 25 21:34:05 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:34:05 user nova-compute[74189]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)
Oct 25 21:34:05 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f8eadf-2731-4197-aa96-6c4fcf85a108]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98, portal: 172.16.0.220,3260]
Oct 25 21:34:05 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98, portal: 172.16.0.220,3260] successful.
Oct 25 21:34:05 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec24c22-bcb6-4ed2-8c16-17487b86b483]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[22eff1f8-0948-4d7d-a33b-f04e278a5038]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:34:05 user nova-compute[74189]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)
Oct 25 21:34:05 user nova-compute[74189]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:34:05 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:34:05 user nova-compute[74189]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)
Oct 25 21:34:05 user nova-compute[74189]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:34:05 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e290db5c-b367-427a-b3aa-7fdd4efd4843]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:05 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: None {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:34:06 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:34:06 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsJSLGjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:34:06 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:34:06 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26161313362333438', 'path': '/dev/sdd'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:34:06 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161313362333438', 'path': '/dev/sdd'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:34:06 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:33:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1901274081',display_name='tempest-ServerActionsTestOtherA-server-1901274081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1901274081',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2S7seSL6H542o42+kjhdFVCcVB3vmP0zFQehKH4IjkXrBgeXgKPGixJeOzeDKKnbCU86Dz8L3oU7gAYCj2cW/f6u+7OuTUBmRTwo8tpApDh9NwCKVzKxF9Lu0jaZZAvw==',key_name='tempest-keypair-2141227250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4815aedea48841188ed8797a0eb51925',ramdisk_id='',reservation_id='r-984gu0e6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1355855048',owner_user_name='tempest-ServerActionsTestOtherA-1355855048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:33:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b34817b1868f40a38a32a51d0e970d51',uuid=1926c2ce-9643-4d00-9f54-a6747e71875b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "address": "fa:16:3e:6e:2f:0e", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d26f4c0-28", "ovs_interfaceid": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:34:06 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Converting VIF {"id": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "address": "fa:16:3e:6e:2f:0e", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d26f4c0-28", "ovs_interfaceid": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:34:06 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2f:0e,bridge_name='br-int',has_traffic_filtering=True,id=5d26f4c0-286d-4528-95fc-2d881f739fd2,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d26f4c0-28') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:34:06 user nova-compute[74189]: DEBUG nova.objects.instance [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lazy-loading 'pci_devices' on Instance uuid 1926c2ce-9643-4d00-9f54-a6747e71875b {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:34:06 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:34:06 user nova-compute[74189]:   <uuid>1926c2ce-9643-4d00-9f54-a6747e71875b</uuid>
Oct 25 21:34:06 user nova-compute[74189]:   <name>instance-00000027</name>
Oct 25 21:34:06 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:34:06 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:34:06 user nova-compute[74189]:   <metadata>
Oct 25 21:34:06 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:34:06 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:34:06 user nova-compute[74189]:       <nova:name>tempest-ServerActionsTestOtherA-server-1901274081</nova:name>
Oct 25 21:34:06 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:34:05</nova:creationTime>
Oct 25 21:34:06 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:34:06 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:34:06 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:34:06 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:34:06 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:34:06 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:34:06 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:34:06 user nova-compute[74189]:       <nova:owner>
Oct 25 21:34:06 user nova-compute[74189]:         <nova:user uuid="b34817b1868f40a38a32a51d0e970d51">tempest-ServerActionsTestOtherA-1355855048-project-member</nova:user>
Oct 25 21:34:06 user nova-compute[74189]:         <nova:project uuid="4815aedea48841188ed8797a0eb51925">tempest-ServerActionsTestOtherA-1355855048</nova:project>
Oct 25 21:34:06 user nova-compute[74189]:       </nova:owner>
Oct 25 21:34:06 user nova-compute[74189]:       <nova:ports>
Oct 25 21:34:06 user nova-compute[74189]:         <nova:port uuid="5d26f4c0-286d-4528-95fc-2d881f739fd2">
Oct 25 21:34:06 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 25 21:34:06 user nova-compute[74189]:         </nova:port>
Oct 25 21:34:06 user nova-compute[74189]:       </nova:ports>
Oct 25 21:34:06 user nova-compute[74189]:     </nova:instance>
Oct 25 21:34:06 user nova-compute[74189]:   </metadata>
Oct 25 21:34:06 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:34:06 user nova-compute[74189]:     <system>
Oct 25 21:34:06 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:34:06 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:34:06 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:34:06 user nova-compute[74189]:       <entry name="serial">1926c2ce-9643-4d00-9f54-a6747e71875b</entry>
Oct 25 21:34:06 user nova-compute[74189]:       <entry name="uuid">1926c2ce-9643-4d00-9f54-a6747e71875b</entry>
Oct 25 21:34:06 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:34:06 user nova-compute[74189]:     </system>
Oct 25 21:34:06 user nova-compute[74189]:   </sysinfo>
Oct 25 21:34:06 user nova-compute[74189]:   <os>
Oct 25 21:34:06 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:34:06 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:34:06 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:34:06 user nova-compute[74189]:   </os>
Oct 25 21:34:06 user nova-compute[74189]:   <features>
Oct 25 21:34:06 user nova-compute[74189]:     <acpi/>
Oct 25 21:34:06 user nova-compute[74189]:     <apic/>
Oct 25 21:34:06 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:34:06 user nova-compute[74189]:   </features>
Oct 25 21:34:06 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:34:06 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:34:06 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:34:06 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:34:06 user nova-compute[74189]:   </clock>
Oct 25 21:34:06 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:34:06 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:34:06 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:34:06 user nova-compute[74189]:   </cpu>
Oct 25 21:34:06 user nova-compute[74189]:   <devices>
Oct 25 21:34:06 user nova-compute[74189]:     <disk type="block" device="disk">
Oct 25 21:34:06 user nova-compute[74189]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:34:06 user nova-compute[74189]:       <source dev="/dev/sdd"/>
Oct 25 21:34:06 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:34:06 user nova-compute[74189]:       <serial>4eb01afd-1b09-48a3-ab75-9326700c7e98</serial>
Oct 25 21:34:06 user nova-compute[74189]:     </disk>
Oct 25 21:34:06 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:34:06 user nova-compute[74189]:       <mac address="fa:16:3e:6e:2f:0e"/>
Oct 25 21:34:06 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:34:06 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:34:06 user nova-compute[74189]:       <target dev="tap5d26f4c0-28"/>
Oct 25 21:34:06 user nova-compute[74189]:     </interface>
Oct 25 21:34:06 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:34:06 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/1926c2ce-9643-4d00-9f54-a6747e71875b/console.log" append="off"/>
Oct 25 21:34:06 user nova-compute[74189]:     </serial>
Oct 25 21:34:06 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:34:06 user nova-compute[74189]:     <video>
Oct 25 21:34:06 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:34:06 user nova-compute[74189]:     </video>
Oct 25 21:34:06 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:34:06 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:34:06 user nova-compute[74189]:     </rng>
Oct 25 21:34:06 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:34:06 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:34:06 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:34:06 user nova-compute[74189]:     </memballoon>
Oct 25 21:34:06 user nova-compute[74189]:   </devices>
Oct 25 21:34:06 user nova-compute[74189]: </domain>
Oct 25 21:34:06 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:34:06 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:33:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1901274081',display_name='tempest-ServerActionsTestOtherA-server-1901274081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1901274081',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2S7seSL6H542o42+kjhdFVCcVB3vmP0zFQehKH4IjkXrBgeXgKPGixJeOzeDKKnbCU86Dz8L3oU7gAYCj2cW/f6u+7OuTUBmRTwo8tpApDh9NwCKVzKxF9Lu0jaZZAvw==',key_name='tempest-keypair-2141227250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4815aedea48841188ed8797a0eb51925',ramdisk_id='',reservation_id='r-984gu0e6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1355855048',owner_user_name='tempest-ServerActionsTestOtherA-1355855048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:33:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b34817b1868f40a38a32a51d0e970d51',uuid=1926c2ce-9643-4d00-9f54-a6747e71875b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "address": "fa:16:3e:6e:2f:0e", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d26f4c0-28", "ovs_interfaceid": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:34:06 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Converting VIF {"id": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "address": "fa:16:3e:6e:2f:0e", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d26f4c0-28", "ovs_interfaceid": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:34:06 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2f:0e,bridge_name='br-int',has_traffic_filtering=True,id=5d26f4c0-286d-4528-95fc-2d881f739fd2,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d26f4c0-28') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:34:06 user nova-compute[74189]: DEBUG os_vif [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2f:0e,bridge_name='br-int',has_traffic_filtering=True,id=5d26f4c0-286d-4528-95fc-2d881f739fd2,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d26f4c0-28') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:34:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:34:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:34:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79c5c800-1d61-5e21-8235-498969c5f04d', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:34:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d26f4c0-28, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:34:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5d26f4c0-28, col_values=(('qos', UUID('d2890000-931e-484f-ba7c-9e5dfdbfd282')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:34:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5d26f4c0-28, col_values=(('external_ids', {'iface-id': '5d26f4c0-286d-4528-95fc-2d881f739fd2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:2f:0e', 'vm-uuid': '1926c2ce-9643-4d00-9f54-a6747e71875b'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:34:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:34:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:06 user nova-compute[74189]: INFO os_vif [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2f:0e,bridge_name='br-int',has_traffic_filtering=True,id=5d26f4c0-286d-4528-95fc-2d881f739fd2,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d26f4c0-28')
Oct 25 21:34:07 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:34:07 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] No VIF found with MAC fa:16:3e:6e:2f:0e, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:34:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:08 user nova-compute[74189]: DEBUG nova.compute.manager [req-d4253297-f3ee-4faf-a34a-11e15e2d99dd req-fa92898a-7863-487a-b5c8-0cc9623aed1d service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Received event network-vif-plugged-5d26f4c0-286d-4528-95fc-2d881f739fd2 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:34:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d4253297-f3ee-4faf-a34a-11e15e2d99dd req-fa92898a-7863-487a-b5c8-0cc9623aed1d service nova] Acquiring lock "1926c2ce-9643-4d00-9f54-a6747e71875b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:34:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d4253297-f3ee-4faf-a34a-11e15e2d99dd req-fa92898a-7863-487a-b5c8-0cc9623aed1d service nova] Lock "1926c2ce-9643-4d00-9f54-a6747e71875b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:34:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d4253297-f3ee-4faf-a34a-11e15e2d99dd req-fa92898a-7863-487a-b5c8-0cc9623aed1d service nova] Lock "1926c2ce-9643-4d00-9f54-a6747e71875b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:34:08 user nova-compute[74189]: DEBUG nova.compute.manager [req-d4253297-f3ee-4faf-a34a-11e15e2d99dd req-fa92898a-7863-487a-b5c8-0cc9623aed1d service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] No waiting events found dispatching network-vif-plugged-5d26f4c0-286d-4528-95fc-2d881f739fd2 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:34:08 user nova-compute[74189]: WARNING nova.compute.manager [req-d4253297-f3ee-4faf-a34a-11e15e2d99dd req-fa92898a-7863-487a-b5c8-0cc9623aed1d service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Received unexpected event network-vif-plugged-5d26f4c0-286d-4528-95fc-2d881f739fd2 for instance with vm_state building and task_state spawning.
Oct 25 21:34:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:09 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:34:10 user nova-compute[74189]: DEBUG nova.compute.manager [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:34:10 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:34:10 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Instance spawned successfully.
Oct 25 21:34:10 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:34:10 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:34:10 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:34:10 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:34:10 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:34:10 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:34:10 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:34:10 user nova-compute[74189]: INFO nova.compute.manager [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Took 4.97 seconds to spawn the instance on the hypervisor.
Oct 25 21:34:10 user nova-compute[74189]: DEBUG nova.compute.manager [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:34:10 user nova-compute[74189]: DEBUG nova.compute.manager [req-0225a1a6-a0fa-42e5-a96b-c8121389360e req-2a8d50a0-8dd6-4a3b-a815-2f687276cda8 service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Received event network-vif-plugged-5d26f4c0-286d-4528-95fc-2d881f739fd2 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:34:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0225a1a6-a0fa-42e5-a96b-c8121389360e req-2a8d50a0-8dd6-4a3b-a815-2f687276cda8 service nova] Acquiring lock "1926c2ce-9643-4d00-9f54-a6747e71875b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:34:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0225a1a6-a0fa-42e5-a96b-c8121389360e req-2a8d50a0-8dd6-4a3b-a815-2f687276cda8 service nova] Lock "1926c2ce-9643-4d00-9f54-a6747e71875b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:34:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0225a1a6-a0fa-42e5-a96b-c8121389360e req-2a8d50a0-8dd6-4a3b-a815-2f687276cda8 service nova] Lock "1926c2ce-9643-4d00-9f54-a6747e71875b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:34:10 user nova-compute[74189]: DEBUG nova.compute.manager [req-0225a1a6-a0fa-42e5-a96b-c8121389360e req-2a8d50a0-8dd6-4a3b-a815-2f687276cda8 service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] No waiting events found dispatching network-vif-plugged-5d26f4c0-286d-4528-95fc-2d881f739fd2 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:34:10 user nova-compute[74189]: WARNING nova.compute.manager [req-0225a1a6-a0fa-42e5-a96b-c8121389360e req-2a8d50a0-8dd6-4a3b-a815-2f687276cda8 service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Received unexpected event network-vif-plugged-5d26f4c0-286d-4528-95fc-2d881f739fd2 for instance with vm_state building and task_state spawning.
Oct 25 21:34:10 user nova-compute[74189]: INFO nova.compute.manager [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Took 24.36 seconds to build instance.
Oct 25 21:34:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-1462ee16-7f8c-4ff4-b8f5-30f10ac82b88 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "1926c2ce-9643-4d00-9f54-a6747e71875b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.465s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:34:11 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:34:11 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:34:11 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Rebuilding the list of instances to heal {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 21:34:11 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:11 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-d7c3a99a-ab38-4e88-896d-94ae51a09a48" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:34:11 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-d7c3a99a-ab38-4e88-896d-94ae51a09a48" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:34:11 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:34:11 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lazy-loading 'info_cache' on Instance uuid d7c3a99a-ab38-4e88-896d-94ae51a09a48 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:34:12 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Updating instance_info_cache with network_info: [{"id": "44169902-69da-4fe1-8292-a23e0ff15fc7", "address": "fa:16:3e:b9:37:c6", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44169902-69", "ovs_interfaceid": "44169902-69da-4fe1-8292-a23e0ff15fc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:34:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-d7c3a99a-ab38-4e88-896d-94ae51a09a48" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:34:12 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:34:12 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:34:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:34:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:34:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:34:12 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:34:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a393d263-97a8-4103-a9b4-866b5d6fc435/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a393d263-97a8-4103-a9b4-866b5d6fc435/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a393d263-97a8-4103-a9b4-866b5d6fc435/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a393d263-97a8-4103-a9b4-866b5d6fc435/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0da9f3bb-fbf4-4f9a-929f-0d223101b29e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0da9f3bb-fbf4-4f9a-929f-0d223101b29e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0da9f3bb-fbf4-4f9a-929f-0d223101b29e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0da9f3bb-fbf4-4f9a-929f-0d223101b29e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:34:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f61139d-d075-41d7-bd04-cc977ec87578/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f61139d-d075-41d7-bd04-cc977ec87578/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f61139d-d075-41d7-bd04-cc977ec87578/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f61139d-d075-41d7-bd04-cc977ec87578/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:34:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:16 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:34:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:17 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:34:17 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:34:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=7322MB free_disk=24.787494659423828GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:34:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:34:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:34:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance d7c3a99a-ab38-4e88-896d-94ae51a09a48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:34:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance af1d7b3c-9950-4b74-8f15-b31011ccfa24 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:34:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 932fe8ac-fdde-45c6-aa32-9bf866f19a4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:34:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 0b4f80c4-98cc-440a-aac7-cd423b71a231 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:34:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:34:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3da14c0a-31a8-4fe3-bd5a-49378680af50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:34:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance a393d263-97a8-4103-a9b4-866b5d6fc435 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:34:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 0da9f3bb-fbf4-4f9a-929f-0d223101b29e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:34:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance f1f19ee2-291f-4cc2-a7d9-db1874691e8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:34:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 6d7cbba0-f920-424a-a204-0a935471afa0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:34:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 8f61139d-d075-41d7-bd04-cc977ec87578 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:34:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 1926c2ce-9643-4d00-9f54-a6747e71875b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:34:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:34:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:34:17 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:34:17 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:34:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:34:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.750s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:34:18 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:34:18 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:34:18 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:34:18 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:34:18 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:34:18 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:34:20 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qSUYTIjX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:34:22 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:34:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:34:22 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:34:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:34:22 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:34:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97815a4-5c74-437a-8364-34dcfb85e672]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:34:22 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[15287bc7-7d3f-4953-9ced-4ac66662232e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c] added
Oct 25 21:34:22 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[003ad851-5299-4b54-9397-cd3639ed38a5]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d371008-81f0-4731-950b-19942d1ed436]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qSUYTIjX {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qSUYTIjX" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6473ff-448d-4ef9-bf33-a1e86747bea4]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qSUYTIjX'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b016fd09-1e26-4cb1-b0ef-bf76ba3e2042]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f9382c-3084-457c-bb00-53e8d707d162]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdb03b38-d5df-4b6d-bec1-efbe30dc72a0 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:34:22 user nova-compute[74189]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)
Oct 25 21:34:22 user nova-compute[74189]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:34:22 user nova-compute[74189]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdb03b38-d5df-4b6d-bec1-efbe30dc72a0 (non-flash)
Oct 25 21:34:22 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:34:22 user nova-compute[74189]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)
Oct 25 21:34:22 user nova-compute[74189]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:34:22 user nova-compute[74189]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdb03b38-d5df-4b6d-bec1-efbe30dc72a0 (non-flash)
Oct 25 21:34:22 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d00805-e3a7-4038-86e1-12a2ebe01a57]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c, portal: 172.16.0.220,3260]
Oct 25 21:34:22 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c, portal: 172.16.0.220,3260] successful.
Oct 25 21:34:22 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf39dbb-9beb-496a-ba1e-ccb4e2251fd0]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[178723a9-7c89-4f60-9de1-6dae05b0bdc2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdb03b38-d5df-4b6d-bec1-efbe30dc72a0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:34:22 user nova-compute[74189]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)
Oct 25 21:34:22 user nova-compute[74189]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:34:22 user nova-compute[74189]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdb03b38-d5df-4b6d-bec1-efbe30dc72a0 (non-flash)
Oct 25 21:34:22 user nova-compute[74189]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c (non-flash)
Oct 25 21:34:22 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:34:22 user nova-compute[74189]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)
Oct 25 21:34:22 user nova-compute[74189]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:34:22 user nova-compute[74189]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdb03b38-d5df-4b6d-bec1-efbe30dc72a0 (non-flash)
Oct 25 21:34:22 user nova-compute[74189]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c (non-flash)
Oct 25 21:34:22 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] HCTL ('37', '-', '-', 0) found on session 43 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40b816b-4537-4198-9581-6293813edc1e]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:22 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Searching for a device in session 43 and hctl ['37', '*', '*', 0] yield: None {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:34:23 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Searching for a device in session 43 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:34:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qSUYTIjX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:34:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:34:23 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23935623763616137', 'path': '/dev/sdf'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:34:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935623763616137', 'path': '/dev/sdf'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:34:23 user nova-compute[74189]: DEBUG nova.objects.instance [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lazy-loading 'flavor' on Instance uuid a393d263-97a8-4103-a9b4-866b5d6fc435 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:34:23 user nova-compute[74189]: DEBUG nova.compute.manager [req-40d12a8d-8e9b-40c6-bef6-efd79c8cf49d req-4ee409ca-d8f7-4cec-ac80-df32a82a7a14 service nova] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Received event network-changed-51ff1ff4-83d4-4393-81e2-750670c4af18 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:34:23 user nova-compute[74189]: DEBUG nova.compute.manager [req-40d12a8d-8e9b-40c6-bef6-efd79c8cf49d req-4ee409ca-d8f7-4cec-ac80-df32a82a7a14 service nova] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Refreshing instance network info cache due to event network-changed-51ff1ff4-83d4-4393-81e2-750670c4af18. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:34:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-40d12a8d-8e9b-40c6-bef6-efd79c8cf49d req-4ee409ca-d8f7-4cec-ac80-df32a82a7a14 service nova] Acquiring lock "refresh_cache-0da9f3bb-fbf4-4f9a-929f-0d223101b29e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:34:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-40d12a8d-8e9b-40c6-bef6-efd79c8cf49d req-4ee409ca-d8f7-4cec-ac80-df32a82a7a14 service nova] Acquired lock "refresh_cache-0da9f3bb-fbf4-4f9a-929f-0d223101b29e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:34:23 user nova-compute[74189]: DEBUG nova.network.neutron [req-40d12a8d-8e9b-40c6-bef6-efd79c8cf49d req-4ee409ca-d8f7-4cec-ac80-df32a82a7a14 service nova] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Refreshing network info cache for port 51ff1ff4-83d4-4393-81e2-750670c4af18 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:34:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 21:34:23 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:34:23 user nova-compute[74189]:   <source dev="/dev/sdf"/>
Oct 25 21:34:23 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:34:23 user nova-compute[74189]:   <serial>7f48db4b-d544-44f3-9123-208a34e8731c</serial>
Oct 25 21:34:23 user nova-compute[74189]: </disk>
Oct 25 21:34:23 user nova-compute[74189]:  {{(pid=74189) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 21:34:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:24 user nova-compute[74189]: DEBUG nova.network.neutron [req-40d12a8d-8e9b-40c6-bef6-efd79c8cf49d req-4ee409ca-d8f7-4cec-ac80-df32a82a7a14 service nova] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Updated VIF entry in instance network info cache for port 51ff1ff4-83d4-4393-81e2-750670c4af18. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:34:24 user nova-compute[74189]: DEBUG nova.network.neutron [req-40d12a8d-8e9b-40c6-bef6-efd79c8cf49d req-4ee409ca-d8f7-4cec-ac80-df32a82a7a14 service nova] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Updating instance_info_cache with network_info: [{"id": "51ff1ff4-83d4-4393-81e2-750670c4af18", "address": "fa:16:3e:1b:34:34", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ff1ff4-83", "ovs_interfaceid": "51ff1ff4-83d4-4393-81e2-750670c4af18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:34:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:34:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:34:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] No VIF found with MAC fa:16:3e:26:05:ef, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:34:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-40d12a8d-8e9b-40c6-bef6-efd79c8cf49d req-4ee409ca-d8f7-4cec-ac80-df32a82a7a14 service nova] Releasing lock "refresh_cache-0da9f3bb-fbf4-4f9a-929f-0d223101b29e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:34:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-79a558a9-978b-417f-a0b2-e8eb18bf2229 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "a393d263-97a8-4103-a9b4-866b5d6fc435" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.864s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:34:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "a393d263-97a8-4103-a9b4-866b5d6fc435" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:34:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "a393d263-97a8-4103-a9b4-866b5d6fc435" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:34:25 user nova-compute[74189]: INFO nova.compute.manager [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Detaching volume 7f48db4b-d544-44f3-9123-208a34e8731c
Oct 25 21:34:25 user nova-compute[74189]: INFO nova.virt.block_device [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Attempting to driver detach volume 7f48db4b-d544-44f3-9123-208a34e8731c from mountpoint /dev/vdb
Oct 25 21:34:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Attempting to detach device vdb from instance a393d263-97a8-4103-a9b4-866b5d6fc435 from the persistent domain config. {{(pid=74189) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 21:34:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:34:25 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:34:25 user nova-compute[74189]:   <source dev="/dev/sdf"/>
Oct 25 21:34:25 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:34:25 user nova-compute[74189]:   <serial>7f48db4b-d544-44f3-9123-208a34e8731c</serial>
Oct 25 21:34:25 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:34:25 user nova-compute[74189]: </disk>
Oct 25 21:34:25 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:34:25 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Successfully detached device vdb from instance a393d263-97a8-4103-a9b4-866b5d6fc435 from the persistent domain config.
Oct 25 21:34:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a393d263-97a8-4103-a9b4-866b5d6fc435 from the live domain config. {{(pid=74189) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 21:34:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:34:25 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:34:25 user nova-compute[74189]:   <source dev="/dev/sdf"/>
Oct 25 21:34:25 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:34:25 user nova-compute[74189]:   <serial>7f48db4b-d544-44f3-9123-208a34e8731c</serial>
Oct 25 21:34:25 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:34:25 user nova-compute[74189]: </disk>
Oct 25 21:34:25 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:34:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a393d263-97a8-4103-a9b4-866b5d6fc435 {{(pid=74189) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 21:34:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:34:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:34:29 user nova-compute[74189]: DEBUG nova.objects.instance [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lazy-loading 'flavor' on Instance uuid 0da9f3bb-fbf4-4f9a-929f-0d223101b29e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:34:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:34:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:34:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:34:29 user nova-compute[74189]: INFO nova.compute.manager [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Attaching volume fde9143a-cf40-4e9c-8655-8bf020517feb to /dev/vdb
Oct 25 21:34:29 user nova-compute[74189]: DEBUG os_brick.utils [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:34:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc979960-c9ad-4229-8186-5a12bdfe1617]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[34742af0-7a08-40e9-97d9-301df2902948]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8a4b59-2ebc-4d6d-9131-ccc09bf735c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8029a07a-2ca7-44fb-9170-caec91d50747]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:34:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:34:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:34:30 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:34:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cafd04-3f22-4b32-bba9-d31253d06c75]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:34:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:34:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:34:30 user nova-compute[74189]: DEBUG os_brick.utils [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:34:30 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Updating existing volume attachment record: 25c1acbe-e684-4bf9-ac55-f4764ad8ffd4 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:34:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-1f1dcb53-4ac0-4bab-a877-1856b1fd9000 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "0b4f80c4-98cc-440a-aac7-cd423b71a231" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:34:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-1f1dcb53-4ac0-4bab-a877-1856b1fd9000 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "0b4f80c4-98cc-440a-aac7-cd423b71a231" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:34:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-1f1dcb53-4ac0-4bab-a877-1856b1fd9000 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "0b4f80c4-98cc-440a-aac7-cd423b71a231-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:34:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-1f1dcb53-4ac0-4bab-a877-1856b1fd9000 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "0b4f80c4-98cc-440a-aac7-cd423b71a231-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:34:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-1f1dcb53-4ac0-4bab-a877-1856b1fd9000 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "0b4f80c4-98cc-440a-aac7-cd423b71a231-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:34:40 user nova-compute[74189]: INFO nova.compute.manager [None req-1f1dcb53-4ac0-4bab-a877-1856b1fd9000 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Terminating instance
Oct 25 21:34:40 user nova-compute[74189]: DEBUG nova.compute.manager [None req-1f1dcb53-4ac0-4bab-a877-1856b1fd9000 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:34:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:41 user nova-compute[74189]: DEBUG nova.compute.manager [req-dbe01954-5660-4557-9901-02ebfe5bab36 req-036fa599-6129-4459-9e8d-afb60370c165 service nova] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Received event network-vif-unplugged-ea4ece99-327d-46c3-9b70-762c2ceafa61 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:34:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-dbe01954-5660-4557-9901-02ebfe5bab36 req-036fa599-6129-4459-9e8d-afb60370c165 service nova] Acquiring lock "0b4f80c4-98cc-440a-aac7-cd423b71a231-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:34:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-dbe01954-5660-4557-9901-02ebfe5bab36 req-036fa599-6129-4459-9e8d-afb60370c165 service nova] Lock "0b4f80c4-98cc-440a-aac7-cd423b71a231-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:34:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-dbe01954-5660-4557-9901-02ebfe5bab36 req-036fa599-6129-4459-9e8d-afb60370c165 service nova] Lock "0b4f80c4-98cc-440a-aac7-cd423b71a231-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:34:41 user nova-compute[74189]: DEBUG nova.compute.manager [req-dbe01954-5660-4557-9901-02ebfe5bab36 req-036fa599-6129-4459-9e8d-afb60370c165 service nova] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] No waiting events found dispatching network-vif-unplugged-ea4ece99-327d-46c3-9b70-762c2ceafa61 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:34:41 user nova-compute[74189]: DEBUG nova.compute.manager [req-dbe01954-5660-4557-9901-02ebfe5bab36 req-036fa599-6129-4459-9e8d-afb60370c165 service nova] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Received event network-vif-unplugged-ea4ece99-327d-46c3-9b70-762c2ceafa61 for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:34:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:41 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Instance destroyed successfully.
Oct 25 21:34:41 user nova-compute[74189]: DEBUG nova.objects.instance [None req-1f1dcb53-4ac0-4bab-a877-1856b1fd9000 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lazy-loading 'resources' on Instance uuid 0b4f80c4-98cc-440a-aac7-cd423b71a231 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:34:41 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-1f1dcb53-4ac0-4bab-a877-1856b1fd9000 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:24:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-837784140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-837784140',id=22,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:24:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='acbb4f93936848a8949477ad124bf98e',ramdisk_id='',reservation_id='r-jebb70wk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-571481303',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:26:25Z,user_data=None,user_id='fc377c1beaab443683a6d776f2f734ff',uuid=0b4f80c4-98cc-440a-aac7-cd423b71a231,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea4ece99-327d-46c3-9b70-762c2ceafa61", "address": "fa:16:3e:3f:e7:2a", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4ece99-32", "ovs_interfaceid": "ea4ece99-327d-46c3-9b70-762c2ceafa61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:34:41 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-1f1dcb53-4ac0-4bab-a877-1856b1fd9000 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Converting VIF {"id": "ea4ece99-327d-46c3-9b70-762c2ceafa61", "address": "fa:16:3e:3f:e7:2a", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4ece99-32", "ovs_interfaceid": "ea4ece99-327d-46c3-9b70-762c2ceafa61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:34:41 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-1f1dcb53-4ac0-4bab-a877-1856b1fd9000 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:e7:2a,bridge_name='br-int',has_traffic_filtering=True,id=ea4ece99-327d-46c3-9b70-762c2ceafa61,network=Network(f202171f-dfd8-4a19-9321-788318413ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea4ece99-32') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:34:41 user nova-compute[74189]: DEBUG os_vif [None req-1f1dcb53-4ac0-4bab-a877-1856b1fd9000 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:e7:2a,bridge_name='br-int',has_traffic_filtering=True,id=ea4ece99-327d-46c3-9b70-762c2ceafa61,network=Network(f202171f-dfd8-4a19-9321-788318413ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea4ece99-32') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:34:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea4ece99-32, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:34:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:34:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8a95ad1d-66bd-40b6-ba01-249ca3c87265) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:34:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:41 user nova-compute[74189]: INFO os_vif [None req-1f1dcb53-4ac0-4bab-a877-1856b1fd9000 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:e7:2a,bridge_name='br-int',has_traffic_filtering=True,id=ea4ece99-327d-46c3-9b70-762c2ceafa61,network=Network(f202171f-dfd8-4a19-9321-788318413ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea4ece99-32')
Oct 25 21:34:41 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-1f1dcb53-4ac0-4bab-a877-1856b1fd9000 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Deleting instance files /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231_del
Oct 25 21:34:41 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-1f1dcb53-4ac0-4bab-a877-1856b1fd9000 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Deletion of /opt/stack/data/nova/instances/0b4f80c4-98cc-440a-aac7-cd423b71a231_del complete
Oct 25 21:34:41 user nova-compute[74189]: INFO nova.compute.manager [None req-1f1dcb53-4ac0-4bab-a877-1856b1fd9000 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 25 21:34:41 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-1f1dcb53-4ac0-4bab-a877-1856b1fd9000 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:34:41 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:34:41 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:34:42 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:34:42 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Took 0.52 seconds to deallocate network for instance.
Oct 25 21:34:42 user nova-compute[74189]: DEBUG nova.compute.manager [req-f719a5ea-ac4c-44fc-bd46-4bc52039e77a req-58c0f3c4-aa7b-48fe-8cf1-de30041731cc service nova] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Received event network-vif-deleted-ea4ece99-327d-46c3-9b70-762c2ceafa61 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:34:42 user nova-compute[74189]: INFO nova.compute.manager [req-f719a5ea-ac4c-44fc-bd46-4bc52039e77a req-58c0f3c4-aa7b-48fe-8cf1-de30041731cc service nova] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Neutron deleted interface ea4ece99-327d-46c3-9b70-762c2ceafa61; detaching it from the instance and deleting it from the info cache
Oct 25 21:34:42 user nova-compute[74189]: DEBUG nova.network.neutron [req-f719a5ea-ac4c-44fc-bd46-4bc52039e77a req-58c0f3c4-aa7b-48fe-8cf1-de30041731cc service nova] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:34:42 user nova-compute[74189]: DEBUG nova.compute.manager [req-f719a5ea-ac4c-44fc-bd46-4bc52039e77a req-58c0f3c4-aa7b-48fe-8cf1-de30041731cc service nova] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Detach interface failed, port_id=ea4ece99-327d-46c3-9b70-762c2ceafa61, reason: Instance 0b4f80c4-98cc-440a-aac7-cd423b71a231 could not be found. {{(pid=74189) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 21:34:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-1f1dcb53-4ac0-4bab-a877-1856b1fd9000 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:34:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-1f1dcb53-4ac0-4bab-a877-1856b1fd9000 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:34:42 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-1f1dcb53-4ac0-4bab-a877-1856b1fd9000 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:34:42 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-1f1dcb53-4ac0-4bab-a877-1856b1fd9000 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:34:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-1f1dcb53-4ac0-4bab-a877-1856b1fd9000 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:34:42 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-1f1dcb53-4ac0-4bab-a877-1856b1fd9000 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Deleted allocations for instance 0b4f80c4-98cc-440a-aac7-cd423b71a231
Oct 25 21:34:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-1f1dcb53-4ac0-4bab-a877-1856b1fd9000 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "0b4f80c4-98cc-440a-aac7-cd423b71a231" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.019s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:34:43 user nova-compute[74189]: DEBUG nova.compute.manager [req-d4d4ed1f-242e-4fb9-8203-e9e3cab4e0fb req-ff5a101b-2505-41de-9199-332537b28a40 service nova] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Received event network-vif-plugged-ea4ece99-327d-46c3-9b70-762c2ceafa61 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:34:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d4d4ed1f-242e-4fb9-8203-e9e3cab4e0fb req-ff5a101b-2505-41de-9199-332537b28a40 service nova] Acquiring lock "0b4f80c4-98cc-440a-aac7-cd423b71a231-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:34:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d4d4ed1f-242e-4fb9-8203-e9e3cab4e0fb req-ff5a101b-2505-41de-9199-332537b28a40 service nova] Lock "0b4f80c4-98cc-440a-aac7-cd423b71a231-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:34:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d4d4ed1f-242e-4fb9-8203-e9e3cab4e0fb req-ff5a101b-2505-41de-9199-332537b28a40 service nova] Lock "0b4f80c4-98cc-440a-aac7-cd423b71a231-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:34:43 user nova-compute[74189]: DEBUG nova.compute.manager [req-d4d4ed1f-242e-4fb9-8203-e9e3cab4e0fb req-ff5a101b-2505-41de-9199-332537b28a40 service nova] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] No waiting events found dispatching network-vif-plugged-ea4ece99-327d-46c3-9b70-762c2ceafa61 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:34:43 user nova-compute[74189]: WARNING nova.compute.manager [req-d4d4ed1f-242e-4fb9-8203-e9e3cab4e0fb req-ff5a101b-2505-41de-9199-332537b28a40 service nova] [instance: 0b4f80c4-98cc-440a-aac7-cd423b71a231] Received unexpected event network-vif-plugged-ea4ece99-327d-46c3-9b70-762c2ceafa61 for instance with vm_state deleted and task_state None.
Oct 25 21:34:46 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a393d263-97a8-4103-a9b4-866b5d6fc435 is timed out.
Oct 25 21:34:46 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Successfully detached device vdb from instance a393d263-97a8-4103-a9b4-866b5d6fc435 from the live domain config.
Oct 25 21:34:46 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qSUYTIjX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:34:46 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:34:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b381079-6ac0-420c-8535-480b2d9ae065]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fdb03b38-d5df-4b6d-bec1-efbe30dc72a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55e0cd10-9603-4f02-9056-60b644c7f964\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:34:46 user nova-compute[74189]: No targets found.
Oct 25 21:34:46 user nova-compute[74189]: iSNS:
Oct 25 21:34:46 user nova-compute[74189]: No targets found.
Oct 25 21:34:46 user nova-compute[74189]: STATIC:
Oct 25 21:34:46 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c
Oct 25 21:34:46 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:34:46 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:34:46 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:fdb03b38-d5df-4b6d-bec1-efbe30dc72a0
Oct 25 21:34:46 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:34:46 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:34:46 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:55e0cd10-9603-4f02-9056-60b644c7f964
Oct 25 21:34:46 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:34:46 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:34:46 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d
Oct 25 21:34:46 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:34:46 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:34:46 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:34:46 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:34:46 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:34:46 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98
Oct 25 21:34:46 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:34:46 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:34:46 user nova-compute[74189]: FIRMWARE:
Oct 25 21:34:46 user nova-compute[74189]: No targets found.
Oct 25 21:34:46 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:34:46 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:34:46 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5081d9e6-64b9-4ae7-a05e-5bd17419477c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55e0cd10-9603-4f02-9056-60b644c7f964\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdb03b38-d5df-4b6d-bec1-efbe30dc72a0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aefd39f-ea64-41ee-9cd0-a97c48be870d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdb03b38-d5df-4b6d-bec1-efbe30dc72a0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0cd10-9603-4f02-9056-60b644c7f964 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:34:46 user nova-compute[74189]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)
Oct 25 21:34:46 user nova-compute[74189]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:34:46 user nova-compute[74189]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdb03b38-d5df-4b6d-bec1-efbe30dc72a0 (non-flash)
Oct 25 21:34:46 user nova-compute[74189]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c (non-flash)
Oct 25 21:34:46 user nova-compute[74189]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0cd10-9603-4f02-9056-60b644c7f964 (non-flash)
Oct 25 21:34:46 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:34:46 user nova-compute[74189]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)
Oct 25 21:34:46 user nova-compute[74189]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:34:46 user nova-compute[74189]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdb03b38-d5df-4b6d-bec1-efbe30dc72a0 (non-flash)
Oct 25 21:34:46 user nova-compute[74189]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c (non-flash)
Oct 25 21:34:46 user nova-compute[74189]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0cd10-9603-4f02-9056-60b644c7f964 (non-flash)
Oct 25 21:34:46 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3043816c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c'): ({'sdf'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Removing single pathed devices sdf {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0fa4a2-40a9-43f0-8271-e2cf7304dad7]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0482528-e62c-49ee-a206-4d6c71e6f255]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Flushing IO for device /dev/sdf {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ee2a85-cdef-4894-be72-42de7fa28d1d]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[86539d43-a580-4572-97f1-a15a061ec7d1]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] SCSI volumes sdf have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f633fca1-bd7d-4dc2-ac5d-0cdfe84d1e9f]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[126274ce-5806-4106-b1df-77c37465247b]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c, portal: 172.16.0.220,3260]
Oct 25 21:34:46 user nova-compute[74189]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c, portal: 172.16.0.220,3260] successful.
Oct 25 21:34:46 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f48db4b-d544-44f3-9123-208a34e8731c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ec0c15-7fa7-45d3-a225-71b8dd091c31]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] <== disconnect_volume: return (371ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:34:46 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:34:47 user nova-compute[74189]: DEBUG nova.objects.instance [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lazy-loading 'flavor' on Instance uuid a393d263-97a8-4103-a9b4-866b5d6fc435 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:34:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b53c0256-f875-4c10-a53e-f9e24c80f1e8 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "a393d263-97a8-4103-a9b4-866b5d6fc435" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.975s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:34:49 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:34:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'roliNTUq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:34:49 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:34:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:34:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:34:49 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:34:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:34:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:34:49 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:34:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:49 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1c6a84-e5e5-4122-9592-6e78f319c908]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:34:49 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:34:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:49 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2cee84-bd49-4f81-ab78-c793317abb3f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb] added
Oct 25 21:34:49 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:34:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f61f5c-21e9-48cf-9f0f-845d83082b69]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c07aa88-0a7f-40d3-bf86-c67e93069fbc]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v roliNTUq {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v roliNTUq" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[307c3ec6-c2b1-4810-a16f-2485204aed6f]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'roliNTUq'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[52dc3421-58ac-46b5-8b61-248c1907aa32]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6cd7d7-a4fd-4a5a-8a61-47c1ee97e4ad]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdb03b38-d5df-4b6d-bec1-efbe30dc72a0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0cd10-9603-4f02-9056-60b644c7f964 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:34:50 user nova-compute[74189]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)
Oct 25 21:34:50 user nova-compute[74189]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:34:50 user nova-compute[74189]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdb03b38-d5df-4b6d-bec1-efbe30dc72a0 (non-flash)
Oct 25 21:34:50 user nova-compute[74189]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0cd10-9603-4f02-9056-60b644c7f964 (non-flash)
Oct 25 21:34:50 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:34:50 user nova-compute[74189]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)
Oct 25 21:34:50 user nova-compute[74189]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:34:50 user nova-compute[74189]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdb03b38-d5df-4b6d-bec1-efbe30dc72a0 (non-flash)
Oct 25 21:34:50 user nova-compute[74189]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0cd10-9603-4f02-9056-60b644c7f964 (non-flash)
Oct 25 21:34:50 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f781a90b-b1b0-4819-8d08-354be2a50d95]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb, portal: 172.16.0.220,3260]
Oct 25 21:34:50 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb, portal: 172.16.0.220,3260] successful.
Oct 25 21:34:50 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[035013a6-94ad-4c4a-930f-dd1fa4c301c8]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db3743b-2962-40b1-9197-532af1b7db41]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdb03b38-d5df-4b6d-bec1-efbe30dc72a0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0cd10-9603-4f02-9056-60b644c7f964 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:34:50 user nova-compute[74189]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)
Oct 25 21:34:50 user nova-compute[74189]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:34:50 user nova-compute[74189]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdb03b38-d5df-4b6d-bec1-efbe30dc72a0 (non-flash)
Oct 25 21:34:50 user nova-compute[74189]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0cd10-9603-4f02-9056-60b644c7f964 (non-flash)
Oct 25 21:34:50 user nova-compute[74189]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb (non-flash)
Oct 25 21:34:50 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:34:50 user nova-compute[74189]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)
Oct 25 21:34:50 user nova-compute[74189]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:34:50 user nova-compute[74189]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdb03b38-d5df-4b6d-bec1-efbe30dc72a0 (non-flash)
Oct 25 21:34:50 user nova-compute[74189]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0cd10-9603-4f02-9056-60b644c7f964 (non-flash)
Oct 25 21:34:50 user nova-compute[74189]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb (non-flash)
Oct 25 21:34:50 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] HCTL ('37', '-', '-', 0) found on session 45 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[487cfa0b-79fd-45b1-8e57-4f89e4d48c0c]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Searching for a device in session 45 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'roliNTUq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG nova.compute.manager [req-95ff2ae1-97a5-4b3f-a124-60f75a8abb54 req-f523d7aa-e5ba-447e-866a-6cb88ca43452 service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Received event network-changed-b460e41a-4e06-48e4-80b4-b551c718126e {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG nova.compute.manager [req-95ff2ae1-97a5-4b3f-a124-60f75a8abb54 req-f523d7aa-e5ba-447e-866a-6cb88ca43452 service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Refreshing instance network info cache due to event network-changed-b460e41a-4e06-48e4-80b4-b551c718126e. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-95ff2ae1-97a5-4b3f-a124-60f75a8abb54 req-f523d7aa-e5ba-447e-866a-6cb88ca43452 service nova] Acquiring lock "refresh_cache-f1f19ee2-291f-4cc2-a7d9-db1874691e8e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-95ff2ae1-97a5-4b3f-a124-60f75a8abb54 req-f523d7aa-e5ba-447e-866a-6cb88ca43452 service nova] Acquired lock "refresh_cache-f1f19ee2-291f-4cc2-a7d9-db1874691e8e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:34:50 user nova-compute[74189]: DEBUG nova.network.neutron [req-95ff2ae1-97a5-4b3f-a124-60f75a8abb54 req-f523d7aa-e5ba-447e-866a-6cb88ca43452 service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Refreshing network info cache for port b460e41a-4e06-48e4-80b4-b551c718126e {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:34:51 user nova-compute[74189]: DEBUG nova.network.neutron [req-95ff2ae1-97a5-4b3f-a124-60f75a8abb54 req-f523d7aa-e5ba-447e-866a-6cb88ca43452 service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Updated VIF entry in instance network info cache for port b460e41a-4e06-48e4-80b4-b551c718126e. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:34:51 user nova-compute[74189]: DEBUG nova.network.neutron [req-95ff2ae1-97a5-4b3f-a124-60f75a8abb54 req-f523d7aa-e5ba-447e-866a-6cb88ca43452 service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Updating instance_info_cache with network_info: [{"id": "b460e41a-4e06-48e4-80b4-b551c718126e", "address": "fa:16:3e:4c:f4:6b", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb460e41a-4e", "ovs_interfaceid": "b460e41a-4e06-48e4-80b4-b551c718126e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:34:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-95ff2ae1-97a5-4b3f-a124-60f75a8abb54 req-f523d7aa-e5ba-447e-866a-6cb88ca43452 service nova] Releasing lock "refresh_cache-f1f19ee2-291f-4cc2-a7d9-db1874691e8e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:34:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:34:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] <== connect_volume: return (1423ms) {'type': 'block', 'scsi_wwn': '26436343065336535', 'path': '/dev/sdf'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:34:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436343065336535', 'path': '/dev/sdf'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:34:51 user nova-compute[74189]: DEBUG nova.objects.instance [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lazy-loading 'flavor' on Instance uuid 0da9f3bb-fbf4-4f9a-929f-0d223101b29e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:34:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 21:34:51 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:34:51 user nova-compute[74189]:   <source dev="/dev/sdf"/>
Oct 25 21:34:51 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:34:51 user nova-compute[74189]:   <serial>fde9143a-cf40-4e9c-8655-8bf020517feb</serial>
Oct 25 21:34:51 user nova-compute[74189]: </disk>
Oct 25 21:34:51 user nova-compute[74189]:  {{(pid=74189) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 21:34:51 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:34:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:34:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:34:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] No VIF found with MAC fa:16:3e:1b:34:34, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:34:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-30a3804f-8f4e-48d3-8172-1a80b72483c7 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.134s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:34:53 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-88b5b626-bcb1-4546-a8b5-0dbf10022584 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:34:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-88b5b626-bcb1-4546-a8b5-0dbf10022584 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:34:57 user nova-compute[74189]: INFO nova.compute.manager [None req-88b5b626-bcb1-4546-a8b5-0dbf10022584 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Shelving
Oct 25 21:34:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:58 user nova-compute[74189]: DEBUG nova.compute.manager [req-0dca42e8-0311-4cfd-97f4-33b7ef4da8c0 req-3d960e4c-90e9-4ff7-9ba8-2b2dde2156ec service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Received event network-vif-unplugged-b460e41a-4e06-48e4-80b4-b551c718126e {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:34:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0dca42e8-0311-4cfd-97f4-33b7ef4da8c0 req-3d960e4c-90e9-4ff7-9ba8-2b2dde2156ec service nova] Acquiring lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:34:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0dca42e8-0311-4cfd-97f4-33b7ef4da8c0 req-3d960e4c-90e9-4ff7-9ba8-2b2dde2156ec service nova] Lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:34:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0dca42e8-0311-4cfd-97f4-33b7ef4da8c0 req-3d960e4c-90e9-4ff7-9ba8-2b2dde2156ec service nova] Lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:34:58 user nova-compute[74189]: DEBUG nova.compute.manager [req-0dca42e8-0311-4cfd-97f4-33b7ef4da8c0 req-3d960e4c-90e9-4ff7-9ba8-2b2dde2156ec service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] No waiting events found dispatching network-vif-unplugged-b460e41a-4e06-48e4-80b4-b551c718126e {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:34:58 user nova-compute[74189]: WARNING nova.compute.manager [req-0dca42e8-0311-4cfd-97f4-33b7ef4da8c0 req-3d960e4c-90e9-4ff7-9ba8-2b2dde2156ec service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Received unexpected event network-vif-unplugged-b460e41a-4e06-48e4-80b4-b551c718126e for instance with vm_state active and task_state shelving.
Oct 25 21:34:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:34:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:34:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:58 user nova-compute[74189]: DEBUG nova.objects.instance [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lazy-loading 'flavor' on Instance uuid 0da9f3bb-fbf4-4f9a-929f-0d223101b29e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:34:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:34:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:34:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:34:58 user nova-compute[74189]: INFO nova.compute.manager [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Attaching volume 725b43dd-27d6-40b6-9bf8-7449eb55698c to /dev/vdc
Oct 25 21:34:58 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Instance destroyed successfully.
Oct 25 21:34:58 user nova-compute[74189]: DEBUG os_brick.utils [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:34:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb40390-d31b-4dd4-8bf1-21aae23dae73]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3709985-67a0-4a41-bed8-6025a618f5db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:34:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e02039e-fd05-48a1-bd57-b81f45935d53]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a378bdc-8c93-4a5e-ac1f-075dce50b331]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:34:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:34:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:58 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-88b5b626-bcb1-4546-a8b5-0dbf10022584 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Beginning cold snapshot process
Oct 25 21:34:58 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:34:58 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:34:58 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0f1b87-7767-4172-8168-78439a570892]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:34:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:34:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:34:58 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:34:58 user nova-compute[74189]: DEBUG os_brick.utils [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:34:58 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Updating existing volume attachment record: 72e9668a-622b-4d0b-b8b4-ef07515d29c5 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:34:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:34:59 user nova-compute[74189]: DEBUG nova.privsep.utils [None req-88b5b626-bcb1-4546-a8b5-0dbf10022584 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74189) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 21:34:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-88b5b626-bcb1-4546-a8b5-0dbf10022584 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk /opt/stack/data/nova/instances/snapshots/tmpdj5mexmc/526937d2f8a0429693e72e2fc6f4b06f {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:34:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-cb3caf86-30f3-4134-b4c0-11f1bbc943b3 req-acdb7a7e-ce9f-46ea-8f30-1c71feed9e6e service nova] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Received event network-changed-43319393-6b0f-4945-965c-54d74152d41e {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:34:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-cb3caf86-30f3-4134-b4c0-11f1bbc943b3 req-acdb7a7e-ce9f-46ea-8f30-1c71feed9e6e service nova] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Refreshing instance network info cache due to event network-changed-43319393-6b0f-4945-965c-54d74152d41e. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:34:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-cb3caf86-30f3-4134-b4c0-11f1bbc943b3 req-acdb7a7e-ce9f-46ea-8f30-1c71feed9e6e service nova] Acquiring lock "refresh_cache-6d7cbba0-f920-424a-a204-0a935471afa0" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:34:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-cb3caf86-30f3-4134-b4c0-11f1bbc943b3 req-acdb7a7e-ce9f-46ea-8f30-1c71feed9e6e service nova] Acquired lock "refresh_cache-6d7cbba0-f920-424a-a204-0a935471afa0" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:34:59 user nova-compute[74189]: DEBUG nova.network.neutron [req-cb3caf86-30f3-4134-b4c0-11f1bbc943b3 req-acdb7a7e-ce9f-46ea-8f30-1c71feed9e6e service nova] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Refreshing network info cache for port 43319393-6b0f-4945-965c-54d74152d41e {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:35:00 user nova-compute[74189]: DEBUG nova.network.neutron [req-cb3caf86-30f3-4134-b4c0-11f1bbc943b3 req-acdb7a7e-ce9f-46ea-8f30-1c71feed9e6e service nova] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Updated VIF entry in instance network info cache for port 43319393-6b0f-4945-965c-54d74152d41e. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:35:00 user nova-compute[74189]: DEBUG nova.network.neutron [req-cb3caf86-30f3-4134-b4c0-11f1bbc943b3 req-acdb7a7e-ce9f-46ea-8f30-1c71feed9e6e service nova] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Updating instance_info_cache with network_info: [{"id": "43319393-6b0f-4945-965c-54d74152d41e", "address": "fa:16:3e:d9:e3:8c", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43319393-6b", "ovs_interfaceid": "43319393-6b0f-4945-965c-54d74152d41e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:35:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-cb3caf86-30f3-4134-b4c0-11f1bbc943b3 req-acdb7a7e-ce9f-46ea-8f30-1c71feed9e6e service nova] Releasing lock "refresh_cache-6d7cbba0-f920-424a-a204-0a935471afa0" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:35:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-88b5b626-bcb1-4546-a8b5-0dbf10022584 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk /opt/stack/data/nova/instances/snapshots/tmpdj5mexmc/526937d2f8a0429693e72e2fc6f4b06f" returned: 0 in 1.099s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:00 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-88b5b626-bcb1-4546-a8b5-0dbf10022584 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Snapshot extracted, beginning image upload
Oct 25 21:35:00 user nova-compute[74189]: DEBUG nova.compute.manager [req-0f700de6-4316-437c-a71f-e826afb8059d req-260d170e-f259-4456-b984-39c5f304d299 service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Received event network-vif-plugged-b460e41a-4e06-48e4-80b4-b551c718126e {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:35:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0f700de6-4316-437c-a71f-e826afb8059d req-260d170e-f259-4456-b984-39c5f304d299 service nova] Acquiring lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0f700de6-4316-437c-a71f-e826afb8059d req-260d170e-f259-4456-b984-39c5f304d299 service nova] Lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0f700de6-4316-437c-a71f-e826afb8059d req-260d170e-f259-4456-b984-39c5f304d299 service nova] Lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:00 user nova-compute[74189]: DEBUG nova.compute.manager [req-0f700de6-4316-437c-a71f-e826afb8059d req-260d170e-f259-4456-b984-39c5f304d299 service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] No waiting events found dispatching network-vif-plugged-b460e41a-4e06-48e4-80b4-b551c718126e {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:35:00 user nova-compute[74189]: WARNING nova.compute.manager [req-0f700de6-4316-437c-a71f-e826afb8059d req-260d170e-f259-4456-b984-39c5f304d299 service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Received unexpected event network-vif-plugged-b460e41a-4e06-48e4-80b4-b551c718126e for instance with vm_state active and task_state shelving_image_pending_upload.
Oct 25 21:35:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "6d7cbba0-f920-424a-a204-0a935471afa0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "6d7cbba0-f920-424a-a204-0a935471afa0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "6d7cbba0-f920-424a-a204-0a935471afa0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "6d7cbba0-f920-424a-a204-0a935471afa0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "6d7cbba0-f920-424a-a204-0a935471afa0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:00 user nova-compute[74189]: INFO nova.compute.manager [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Terminating instance
Oct 25 21:35:00 user nova-compute[74189]: DEBUG nova.compute.manager [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:35:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:01 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Instance destroyed successfully.
Oct 25 21:35:01 user nova-compute[74189]: DEBUG nova.objects.instance [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lazy-loading 'resources' on Instance uuid 6d7cbba0-f920-424a-a204-0a935471afa0 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:33:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1328267637',display_name='tempest-TestVolumeBootPattern-server-1328267637',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1328267637',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbWjlurUdlTqM38TJIvyWArBvgtPS5ByZ7GvbbNhterPxeMByoQxHeDSj3q/FAwbfZCzxGnbhX1L/9RQ/CSBOb1BJ9rZaqesREBo++7UKa99YIwO5kH0uL2CiEzhHllXw==',key_name='tempest-TestVolumeBootPattern-16841960',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:33:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e893e8f3f58e4e15920d313b6391682c',ramdisk_id='',reservation_id='r-v198xzw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1934687878',owner_user_name='tempest-TestVolumeBootPattern-1934687878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:33:32Z,user_data=None,user_id='77a27a7ebb4a458097c901871c378bc8',uuid=6d7cbba0-f920-424a-a204-0a935471afa0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43319393-6b0f-4945-965c-54d74152d41e", "address": "fa:16:3e:d9:e3:8c", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43319393-6b", "ovs_interfaceid": "43319393-6b0f-4945-965c-54d74152d41e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converting VIF {"id": "43319393-6b0f-4945-965c-54d74152d41e", "address": "fa:16:3e:d9:e3:8c", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43319393-6b", "ovs_interfaceid": "43319393-6b0f-4945-965c-54d74152d41e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:e3:8c,bridge_name='br-int',has_traffic_filtering=True,id=43319393-6b0f-4945-965c-54d74152d41e,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43319393-6b') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG os_vif [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:e3:8c,bridge_name='br-int',has_traffic_filtering=True,id=43319393-6b0f-4945-965c-54d74152d41e,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43319393-6b') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43319393-6b, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ad9f8ade-7ff7-41a1-90b3-19920ceec832) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:01 user nova-compute[74189]: INFO os_vif [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:e3:8c,bridge_name='br-int',has_traffic_filtering=True,id=43319393-6b0f-4945-965c-54d74152d41e,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43319393-6b')
Oct 25 21:35:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oXdtAbSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:35:01 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:35:01 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0316222-8395-4b18-a620-0b30b56fb7fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:35:01 user nova-compute[74189]: No targets found.
Oct 25 21:35:01 user nova-compute[74189]: iSNS:
Oct 25 21:35:01 user nova-compute[74189]: No targets found.
Oct 25 21:35:01 user nova-compute[74189]: STATIC:
Oct 25 21:35:01 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb
Oct 25 21:35:01 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:35:01 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:35:01 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d
Oct 25 21:35:01 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:35:01 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:35:01 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:35:01 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:35:01 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:35:01 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98
Oct 25 21:35:01 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:35:01 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:35:01 user nova-compute[74189]: FIRMWARE:
Oct 25 21:35:01 user nova-compute[74189]: No targets found.
Oct 25 21:35:01 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:35:01 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:35:01 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6620d092-874e-4e70-958e-4f50b2b9f954]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca7c65d-266e-4809-94f7-e5ba94809e83]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:35:01 user nova-compute[74189]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)
Oct 25 21:35:01 user nova-compute[74189]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:35:01 user nova-compute[74189]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb (non-flash)
Oct 25 21:35:01 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:35:01 user nova-compute[74189]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)
Oct 25 21:35:01 user nova-compute[74189]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:35:01 user nova-compute[74189]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb (non-flash)
Oct 25 21:35:01 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3041551b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d'): ({'sdc'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Removing single pathed devices sdc {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.075s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2973551-67e9-4e0f-bc79-bba6c0cd4398]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.081s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d94e4e3-9b42-4741-9275-77989f31c1db]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Flushing IO for device /dev/sdc {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f26541-9644-46bb-af01-a82d3889a076]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG nova.compute.manager [req-07c142c3-923b-496f-8381-7f6bab65fe82 req-2bad5106-8f3c-427a-9fc0-4d4ca0297456 service nova] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Received event network-vif-unplugged-43319393-6b0f-4945-965c-54d74152d41e {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-07c142c3-923b-496f-8381-7f6bab65fe82 req-2bad5106-8f3c-427a-9fc0-4d4ca0297456 service nova] Acquiring lock "6d7cbba0-f920-424a-a204-0a935471afa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-07c142c3-923b-496f-8381-7f6bab65fe82 req-2bad5106-8f3c-427a-9fc0-4d4ca0297456 service nova] Lock "6d7cbba0-f920-424a-a204-0a935471afa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-07c142c3-923b-496f-8381-7f6bab65fe82 req-2bad5106-8f3c-427a-9fc0-4d4ca0297456 service nova] Lock "6d7cbba0-f920-424a-a204-0a935471afa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG nova.compute.manager [req-07c142c3-923b-496f-8381-7f6bab65fe82 req-2bad5106-8f3c-427a-9fc0-4d4ca0297456 service nova] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] No waiting events found dispatching network-vif-unplugged-43319393-6b0f-4945-965c-54d74152d41e {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG nova.compute.manager [req-07c142c3-923b-496f-8381-7f6bab65fe82 req-2bad5106-8f3c-427a-9fc0-4d4ca0297456 service nova] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Received event network-vif-unplugged-43319393-6b0f-4945-965c-54d74152d41e for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG nova.compute.manager [req-07c142c3-923b-496f-8381-7f6bab65fe82 req-2bad5106-8f3c-427a-9fc0-4d4ca0297456 service nova] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Received event network-vif-plugged-43319393-6b0f-4945-965c-54d74152d41e {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-07c142c3-923b-496f-8381-7f6bab65fe82 req-2bad5106-8f3c-427a-9fc0-4d4ca0297456 service nova] Acquiring lock "6d7cbba0-f920-424a-a204-0a935471afa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-07c142c3-923b-496f-8381-7f6bab65fe82 req-2bad5106-8f3c-427a-9fc0-4d4ca0297456 service nova] Lock "6d7cbba0-f920-424a-a204-0a935471afa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-07c142c3-923b-496f-8381-7f6bab65fe82 req-2bad5106-8f3c-427a-9fc0-4d4ca0297456 service nova] Lock "6d7cbba0-f920-424a-a204-0a935471afa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG nova.compute.manager [req-07c142c3-923b-496f-8381-7f6bab65fe82 req-2bad5106-8f3c-427a-9fc0-4d4ca0297456 service nova] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] No waiting events found dispatching network-vif-plugged-43319393-6b0f-4945-965c-54d74152d41e {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:35:01 user nova-compute[74189]: WARNING nova.compute.manager [req-07c142c3-923b-496f-8381-7f6bab65fe82 req-2bad5106-8f3c-427a-9fc0-4d4ca0297456 service nova] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Received unexpected event network-vif-plugged-43319393-6b0f-4945-965c-54d74152d41e for instance with vm_state active and task_state deleting.
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.175s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a9330d-3fce-4d61-8ab9-dbb10bff61af]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] SCSI volumes sdc have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23337663031383738', '/dev/disk/by-id/scsi-1SCST_BIO10d90630-37f018783ff52f3c', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_10d90630') {{(pid=85079) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcb07b6-bd91-43af-9c77-e06aa1e70969]: (4, None) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9dcd16-a9dc-48a2-8837-54d2ca4b4b1e]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7b1583-566a-44ea-82fb-248e9fe8c3cd]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d, portal: 172.16.0.220,3260]
Oct 25 21:35:01 user nova-compute[74189]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d, portal: 172.16.0.220,3260] successful.
Oct 25 21:35:01 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ceeec7-2a51-48fa-beef-bcf561eda01f]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.633s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] <== disconnect_volume: return (635ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:35:01 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Deleting instance files /opt/stack/data/nova/instances/6d7cbba0-f920-424a-a204-0a935471afa0_del
Oct 25 21:35:01 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Deletion of /opt/stack/data/nova/instances/6d7cbba0-f920-424a-a204-0a935471afa0_del complete
Oct 25 21:35:01 user nova-compute[74189]: INFO nova.compute.manager [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Took 1.54 seconds to destroy the instance on the hypervisor.
Oct 25 21:35:01 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:35:01 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:35:02 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:35:02 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Took 0.96 seconds to deallocate network for instance.
Oct 25 21:35:03 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-88b5b626-bcb1-4546-a8b5-0dbf10022584 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Snapshot image upload complete
Oct 25 21:35:03 user nova-compute[74189]: DEBUG nova.compute.manager [None req-88b5b626-bcb1-4546-a8b5-0dbf10022584 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:35:03 user nova-compute[74189]: INFO nova.compute.manager [None req-88b5b626-bcb1-4546-a8b5-0dbf10022584 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Shelve offloading
Oct 25 21:35:03 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Instance destroyed successfully.
Oct 25 21:35:03 user nova-compute[74189]: DEBUG nova.compute.manager [None req-88b5b626-bcb1-4546-a8b5-0dbf10022584 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:35:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-88b5b626-bcb1-4546-a8b5-0dbf10022584 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "refresh_cache-f1f19ee2-291f-4cc2-a7d9-db1874691e8e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:35:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-88b5b626-bcb1-4546-a8b5-0dbf10022584 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquired lock "refresh_cache-f1f19ee2-291f-4cc2-a7d9-db1874691e8e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:35:03 user nova-compute[74189]: DEBUG nova.network.neutron [None req-88b5b626-bcb1-4546-a8b5-0dbf10022584 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:35:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-47baf7b1-a4ec-44b2-825d-e7f286e0f9a1 req-b8607ef1-ec78-4fb6-8439-4840b0c85968 service nova] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Received event network-vif-deleted-43319393-6b0f-4945-965c-54d74152d41e {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:35:03 user nova-compute[74189]: DEBUG nova.network.neutron [None req-88b5b626-bcb1-4546-a8b5-0dbf10022584 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Updating instance_info_cache with network_info: [{"id": "b460e41a-4e06-48e4-80b4-b551c718126e", "address": "fa:16:3e:4c:f4:6b", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb460e41a-4e", "ovs_interfaceid": "b460e41a-4e06-48e4-80b4-b551c718126e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:35:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-88b5b626-bcb1-4546-a8b5-0dbf10022584 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Releasing lock "refresh_cache-f1f19ee2-291f-4cc2-a7d9-db1874691e8e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:35:03 user nova-compute[74189]: INFO nova.compute.manager [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 6d7cbba0-f920-424a-a204-0a935471afa0] Took 0.99 seconds to detach 1 volumes for instance.
Oct 25 21:35:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:04 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:35:04 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:35:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:04 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Deleted allocations for instance 6d7cbba0-f920-424a-a204-0a935471afa0
Oct 25 21:35:04 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Instance destroyed successfully.
Oct 25 21:35:04 user nova-compute[74189]: DEBUG nova.objects.instance [None req-88b5b626-bcb1-4546-a8b5-0dbf10022584 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lazy-loading 'resources' on Instance uuid f1f19ee2-291f-4cc2-a7d9-db1874691e8e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:35:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-88b5b626-bcb1-4546-a8b5-0dbf10022584 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-904043964',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-904043964',id=36,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDW8eZT8GP9FUTvkiTAgfGM4YmLWdp9/wvP9KJIr8BZ+VLv1ILm27EcVk7KzOgSldLDctcon+WPQZKUJOQ92ZAvyIXAKSBaSECwOXFFIt1GsdvKN8JqtBdn79vB0QfIe+w==',key_name='tempest-keypair-1324843434',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:33:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e45f8868c6a04e31ad1617ee6e9438a2',ramdisk_id='',reservation_id='r-sk1uqinq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-846255404',owner_user_name='tempest-AttachVolumeShelveTestJSON-846255404-project-member',shelved_at='2023-10-25T21:35:03.303705',shelved_host='user',shelved_image_id='8317448d-94de-4ac2-8512-df056dac6ec2'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:35:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6fb9b5c36f049c1af4ae44e11267264',uuid=f1f19ee2-291f-4cc2-a7d9-db1874691e8e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "b460e41a-4e06-48e4-80b4-b551c718126e", "address": "fa:16:3e:4c:f4:6b", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb460e41a-4e", "ovs_interfaceid": "b460e41a-4e06-48e4-80b4-b551c718126e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:35:04 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-88b5b626-bcb1-4546-a8b5-0dbf10022584 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Converting VIF {"id": "b460e41a-4e06-48e4-80b4-b551c718126e", "address": "fa:16:3e:4c:f4:6b", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb460e41a-4e", "ovs_interfaceid": "b460e41a-4e06-48e4-80b4-b551c718126e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:35:04 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-88b5b626-bcb1-4546-a8b5-0dbf10022584 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:6b,bridge_name='br-int',has_traffic_filtering=True,id=b460e41a-4e06-48e4-80b4-b551c718126e,network=Network(09d8bdf6-f255-479c-aa38-55d468abf1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb460e41a-4e') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:35:04 user nova-compute[74189]: DEBUG os_vif [None req-88b5b626-bcb1-4546-a8b5-0dbf10022584 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:6b,bridge_name='br-int',has_traffic_filtering=True,id=b460e41a-4e06-48e4-80b4-b551c718126e,network=Network(09d8bdf6-f255-479c-aa38-55d468abf1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb460e41a-4e') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:35:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb460e41a-4e, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:35:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:35:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c5e9750f-dbd7-4863-acba-5d3434aab179) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:35:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:35:04 user nova-compute[74189]: INFO os_vif [None req-88b5b626-bcb1-4546-a8b5-0dbf10022584 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:6b,bridge_name='br-int',has_traffic_filtering=True,id=b460e41a-4e06-48e4-80b4-b551c718126e,network=Network(09d8bdf6-f255-479c-aa38-55d468abf1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb460e41a-4e')
Oct 25 21:35:04 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-88b5b626-bcb1-4546-a8b5-0dbf10022584 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Deleting instance files /opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e_del
Oct 25 21:35:04 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-88b5b626-bcb1-4546-a8b5-0dbf10022584 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Deletion of /opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e_del complete
Oct 25 21:35:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-63d9d3e8-0d09-4413-bfd0-37ae940c4ef6 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "6d7cbba0-f920-424a-a204-0a935471afa0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.090s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:04 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-88b5b626-bcb1-4546-a8b5-0dbf10022584 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Deleted allocations for instance f1f19ee2-291f-4cc2-a7d9-db1874691e8e
Oct 25 21:35:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-88b5b626-bcb1-4546-a8b5-0dbf10022584 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-88b5b626-bcb1-4546-a8b5-0dbf10022584 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:04 user nova-compute[74189]: DEBUG nova.objects.instance [None req-88b5b626-bcb1-4546-a8b5-0dbf10022584 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lazy-loading 'numa_topology' on Instance uuid f1f19ee2-291f-4cc2-a7d9-db1874691e8e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:35:04 user nova-compute[74189]: DEBUG nova.objects.base [None req-88b5b626-bcb1-4546-a8b5-0dbf10022584 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Object Instance<f1f19ee2-291f-4cc2-a7d9-db1874691e8e> lazy-loaded attributes: resources,numa_topology {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:35:04 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-88b5b626-bcb1-4546-a8b5-0dbf10022584 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:35:04 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-88b5b626-bcb1-4546-a8b5-0dbf10022584 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:35:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-88b5b626-bcb1-4546-a8b5-0dbf10022584 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-88b5b626-bcb1-4546-a8b5-0dbf10022584 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.988s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:09 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:09 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:10 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:35:11 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:35:11 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:35:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-af1d7b3c-9950-4b74-8f15-b31011ccfa24" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:35:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-af1d7b3c-9950-4b74-8f15-b31011ccfa24" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:35:12 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:35:12 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Updating instance_info_cache with network_info: [{"id": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "address": "fa:16:3e:03:8e:2f", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4cdb73-9d", "ovs_interfaceid": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:35:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-af1d7b3c-9950-4b74-8f15-b31011ccfa24" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:35:12 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:35:13 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:35:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:13 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:35:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a393d263-97a8-4103-a9b4-866b5d6fc435/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a393d263-97a8-4103-a9b4-866b5d6fc435/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a393d263-97a8-4103-a9b4-866b5d6fc435/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:35:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a393d263-97a8-4103-a9b4-866b5d6fc435/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0da9f3bb-fbf4-4f9a-929f-0d223101b29e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0da9f3bb-fbf4-4f9a-929f-0d223101b29e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0da9f3bb-fbf4-4f9a-929f-0d223101b29e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0da9f3bb-fbf4-4f9a-929f-0d223101b29e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:35:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f61139d-d075-41d7-bd04-cc977ec87578/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f61139d-d075-41d7-bd04-cc977ec87578/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f61139d-d075-41d7-bd04-cc977ec87578/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-74755240-b25b-4fa9-8c4a-8d3ae8e74ea6 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "a393d263-97a8-4103-a9b4-866b5d6fc435" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-74755240-b25b-4fa9-8c4a-8d3ae8e74ea6 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "a393d263-97a8-4103-a9b4-866b5d6fc435" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-74755240-b25b-4fa9-8c4a-8d3ae8e74ea6 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "a393d263-97a8-4103-a9b4-866b5d6fc435-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-74755240-b25b-4fa9-8c4a-8d3ae8e74ea6 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "a393d263-97a8-4103-a9b4-866b5d6fc435-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-74755240-b25b-4fa9-8c4a-8d3ae8e74ea6 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "a393d263-97a8-4103-a9b4-866b5d6fc435-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:16 user nova-compute[74189]: INFO nova.compute.manager [None req-74755240-b25b-4fa9-8c4a-8d3ae8e74ea6 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Terminating instance
Oct 25 21:35:16 user nova-compute[74189]: DEBUG nova.compute.manager [None req-74755240-b25b-4fa9-8c4a-8d3ae8e74ea6 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:35:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f61139d-d075-41d7-bd04-cc977ec87578/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:16 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:35:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:16 user nova-compute[74189]: DEBUG nova.compute.manager [req-66c24782-3d92-4671-a1d5-54922dfb3bd4 req-c2c1403b-381a-4652-9dcc-3430977a3fa4 service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Received event network-vif-unplugged-22b40255-2ff7-4639-8c10-0959ac5f5917 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:35:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-66c24782-3d92-4671-a1d5-54922dfb3bd4 req-c2c1403b-381a-4652-9dcc-3430977a3fa4 service nova] Acquiring lock "a393d263-97a8-4103-a9b4-866b5d6fc435-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-66c24782-3d92-4671-a1d5-54922dfb3bd4 req-c2c1403b-381a-4652-9dcc-3430977a3fa4 service nova] Lock "a393d263-97a8-4103-a9b4-866b5d6fc435-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-66c24782-3d92-4671-a1d5-54922dfb3bd4 req-c2c1403b-381a-4652-9dcc-3430977a3fa4 service nova] Lock "a393d263-97a8-4103-a9b4-866b5d6fc435-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:16 user nova-compute[74189]: DEBUG nova.compute.manager [req-66c24782-3d92-4671-a1d5-54922dfb3bd4 req-c2c1403b-381a-4652-9dcc-3430977a3fa4 service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] No waiting events found dispatching network-vif-unplugged-22b40255-2ff7-4639-8c10-0959ac5f5917 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:35:16 user nova-compute[74189]: DEBUG nova.compute.manager [req-66c24782-3d92-4671-a1d5-54922dfb3bd4 req-c2c1403b-381a-4652-9dcc-3430977a3fa4 service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Received event network-vif-unplugged-22b40255-2ff7-4639-8c10-0959ac5f5917 for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:35:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:17 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Instance destroyed successfully.
Oct 25 21:35:17 user nova-compute[74189]: DEBUG nova.objects.instance [None req-74755240-b25b-4fa9-8c4a-8d3ae8e74ea6 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lazy-loading 'resources' on Instance uuid a393d263-97a8-4103-a9b4-866b5d6fc435 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-74755240-b25b-4fa9-8c4a-8d3ae8e74ea6 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:32:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-717191026',display_name='tempest-AttachVolumeNegativeTest-server-717191026',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-717191026',id=34,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaZBQVPTVIl2ipvGJpaWqLEGx1boENHN7YXzPrs+0udCCKTslQOy+jjZ9V6SajU2MGVKy4Ms5DnWxfgfANdB91ltMLp8UPK14+gEAcO1McCRa23cMb0uQqtf99fPNLzhg==',key_name='tempest-keypair-680322332',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:32:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a555d708aa644d586d5edad7db837b4',ramdisk_id='',reservation_id='r-bgsv698b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-979681322',owner_user_name='tempest-AttachVolumeNegativeTest-979681322-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:32:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2f19a398fd9486fbef04eebad62a0cb',uuid=a393d263-97a8-4103-a9b4-866b5d6fc435,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22b40255-2ff7-4639-8c10-0959ac5f5917", "address": "fa:16:3e:26:05:ef", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b40255-2f", "ovs_interfaceid": "22b40255-2ff7-4639-8c10-0959ac5f5917", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-74755240-b25b-4fa9-8c4a-8d3ae8e74ea6 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Converting VIF {"id": "22b40255-2ff7-4639-8c10-0959ac5f5917", "address": "fa:16:3e:26:05:ef", "network": {"id": "5029031b-e67b-4f60-bc17-781cbdc88b18", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1876230491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a555d708aa644d586d5edad7db837b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b40255-2f", "ovs_interfaceid": "22b40255-2ff7-4639-8c10-0959ac5f5917", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-74755240-b25b-4fa9-8c4a-8d3ae8e74ea6 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:05:ef,bridge_name='br-int',has_traffic_filtering=True,id=22b40255-2ff7-4639-8c10-0959ac5f5917,network=Network(5029031b-e67b-4f60-bc17-781cbdc88b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b40255-2f') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG os_vif [None req-74755240-b25b-4fa9-8c4a-8d3ae8e74ea6 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:05:ef,bridge_name='br-int',has_traffic_filtering=True,id=22b40255-2ff7-4639-8c10-0959ac5f5917,network=Network(5029031b-e67b-4f60-bc17-781cbdc88b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b40255-2f') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22b40255-2f, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6927507a-a8ad-477f-ac3f-bda25076cd3f) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:17 user nova-compute[74189]: INFO os_vif [None req-74755240-b25b-4fa9-8c4a-8d3ae8e74ea6 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:05:ef,bridge_name='br-int',has_traffic_filtering=True,id=22b40255-2ff7-4639-8c10-0959ac5f5917,network=Network(5029031b-e67b-4f60-bc17-781cbdc88b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b40255-2f')
Oct 25 21:35:17 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-74755240-b25b-4fa9-8c4a-8d3ae8e74ea6 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Deleting instance files /opt/stack/data/nova/instances/a393d263-97a8-4103-a9b4-866b5d6fc435_del
Oct 25 21:35:17 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-74755240-b25b-4fa9-8c4a-8d3ae8e74ea6 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Deletion of /opt/stack/data/nova/instances/a393d263-97a8-4103-a9b4-866b5d6fc435_del complete
Oct 25 21:35:17 user nova-compute[74189]: INFO nova.compute.manager [None req-74755240-b25b-4fa9-8c4a-8d3ae8e74ea6 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Took 1.60 seconds to destroy the instance on the hypervisor.
Oct 25 21:35:17 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-74755240-b25b-4fa9-8c4a-8d3ae8e74ea6 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:35:17 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:35:17 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:35:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=7627MB free_disk=24.88835906982422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZyvlrfRo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:35:17 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:35:17 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:35:17 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:35:17 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:35:17 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:35:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e92ead8-b6ca-410f-bc68-4fd3a9bcb25a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:35:17 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ca7a86-c4f4-437b-ade8-fc0efed78e08]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c] added
Oct 25 21:35:17 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4ba661-811b-4238-89d9-17cafb56de02]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance d7c3a99a-ab38-4e88-896d-94ae51a09a48 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance af1d7b3c-9950-4b74-8f15-b31011ccfa24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 932fe8ac-fdde-45c6-aa32-9bf866f19a4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3da14c0a-31a8-4fe3-bd5a-49378680af50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance a393d263-97a8-4103-a9b4-866b5d6fc435 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 0da9f3bb-fbf4-4f9a-929f-0d223101b29e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 8f61139d-d075-41d7-bd04-cc977ec87578 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 1926c2ce-9643-4d00-9f54-a6747e71875b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[877d8c0c-d47b-49ef-9a4a-a652fde724f5]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:35:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZyvlrfRo {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZyvlrfRo" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b957fb-353c-4272-85ec-1a809366d787]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZyvlrfRo'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a70f75-6f27-45c8-8d12-5e08dff72f74]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[77318b96-4928-4f11-a560-79be7d05146f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:35:18 user nova-compute[74189]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:35:18 user nova-compute[74189]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb (non-flash)
Oct 25 21:35:18 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:35:18 user nova-compute[74189]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:35:18 user nova-compute[74189]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb (non-flash)
Oct 25 21:35:18 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ca3600-38c2-49f2-90c6-51b0475cdd98]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c, portal: 172.16.0.220,3260]
Oct 25 21:35:18 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c, portal: 172.16.0.220,3260] successful.
Oct 25 21:35:18 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[87be6c70-6116-48a5-8746-b9fd960e6479]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e437c6-ab04-4879-842f-e80810807fed]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:35:18 user nova-compute[74189]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:35:18 user nova-compute[74189]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb (non-flash)
Oct 25 21:35:18 user nova-compute[74189]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c (non-flash)
Oct 25 21:35:18 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:35:18 user nova-compute[74189]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:35:18 user nova-compute[74189]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb (non-flash)
Oct 25 21:35:18 user nova-compute[74189]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c (non-flash)
Oct 25 21:35:18 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6714b30-3ac5-402b-9333-2451eccf5833]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZyvlrfRo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.490s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG nova.compute.manager [req-08d7689c-67e0-41fd-a4c7-558de1b856b9 req-d040f042-5c40-466d-87b6-d10e83b62030 service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Received event network-vif-plugged-22b40255-2ff7-4639-8c10-0959ac5f5917 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-08d7689c-67e0-41fd-a4c7-558de1b856b9 req-d040f042-5c40-466d-87b6-d10e83b62030 service nova] Acquiring lock "a393d263-97a8-4103-a9b4-866b5d6fc435-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-08d7689c-67e0-41fd-a4c7-558de1b856b9 req-d040f042-5c40-466d-87b6-d10e83b62030 service nova] Lock "a393d263-97a8-4103-a9b4-866b5d6fc435-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-08d7689c-67e0-41fd-a4c7-558de1b856b9 req-d040f042-5c40-466d-87b6-d10e83b62030 service nova] Lock "a393d263-97a8-4103-a9b4-866b5d6fc435-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG nova.compute.manager [req-08d7689c-67e0-41fd-a4c7-558de1b856b9 req-d040f042-5c40-466d-87b6-d10e83b62030 service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] No waiting events found dispatching network-vif-plugged-22b40255-2ff7-4639-8c10-0959ac5f5917 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:35:18 user nova-compute[74189]: WARNING nova.compute.manager [req-08d7689c-67e0-41fd-a4c7-558de1b856b9 req-d040f042-5c40-466d-87b6-d10e83b62030 service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Received unexpected event network-vif-plugged-22b40255-2ff7-4639-8c10-0959ac5f5917 for instance with vm_state active and task_state deleting.
Oct 25 21:35:18 user nova-compute[74189]: DEBUG nova.compute.manager [req-08d7689c-67e0-41fd-a4c7-558de1b856b9 req-d040f042-5c40-466d-87b6-d10e83b62030 service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Received event network-vif-plugged-22b40255-2ff7-4639-8c10-0959ac5f5917 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-08d7689c-67e0-41fd-a4c7-558de1b856b9 req-d040f042-5c40-466d-87b6-d10e83b62030 service nova] Acquiring lock "a393d263-97a8-4103-a9b4-866b5d6fc435-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-08d7689c-67e0-41fd-a4c7-558de1b856b9 req-d040f042-5c40-466d-87b6-d10e83b62030 service nova] Lock "a393d263-97a8-4103-a9b4-866b5d6fc435-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-08d7689c-67e0-41fd-a4c7-558de1b856b9 req-d040f042-5c40-466d-87b6-d10e83b62030 service nova] Lock "a393d263-97a8-4103-a9b4-866b5d6fc435-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG nova.compute.manager [req-08d7689c-67e0-41fd-a4c7-558de1b856b9 req-d040f042-5c40-466d-87b6-d10e83b62030 service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] No waiting events found dispatching network-vif-plugged-22b40255-2ff7-4639-8c10-0959ac5f5917 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:35:18 user nova-compute[74189]: WARNING nova.compute.manager [req-08d7689c-67e0-41fd-a4c7-558de1b856b9 req-d040f042-5c40-466d-87b6-d10e83b62030 service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Received unexpected event network-vif-plugged-22b40255-2ff7-4639-8c10-0959ac5f5917 for instance with vm_state active and task_state deleting.
Oct 25 21:35:18 user nova-compute[74189]: DEBUG nova.compute.manager [req-08d7689c-67e0-41fd-a4c7-558de1b856b9 req-d040f042-5c40-466d-87b6-d10e83b62030 service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Received event network-vif-plugged-22b40255-2ff7-4639-8c10-0959ac5f5917 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-08d7689c-67e0-41fd-a4c7-558de1b856b9 req-d040f042-5c40-466d-87b6-d10e83b62030 service nova] Acquiring lock "a393d263-97a8-4103-a9b4-866b5d6fc435-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-08d7689c-67e0-41fd-a4c7-558de1b856b9 req-d040f042-5c40-466d-87b6-d10e83b62030 service nova] Lock "a393d263-97a8-4103-a9b4-866b5d6fc435-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-08d7689c-67e0-41fd-a4c7-558de1b856b9 req-d040f042-5c40-466d-87b6-d10e83b62030 service nova] Lock "a393d263-97a8-4103-a9b4-866b5d6fc435-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG nova.compute.manager [req-08d7689c-67e0-41fd-a4c7-558de1b856b9 req-d040f042-5c40-466d-87b6-d10e83b62030 service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] No waiting events found dispatching network-vif-plugged-22b40255-2ff7-4639-8c10-0959ac5f5917 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:35:18 user nova-compute[74189]: WARNING nova.compute.manager [req-08d7689c-67e0-41fd-a4c7-558de1b856b9 req-d040f042-5c40-466d-87b6-d10e83b62030 service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Received unexpected event network-vif-plugged-22b40255-2ff7-4639-8c10-0959ac5f5917 for instance with vm_state active and task_state deleting.
Oct 25 21:35:18 user nova-compute[74189]: DEBUG nova.compute.manager [req-08d7689c-67e0-41fd-a4c7-558de1b856b9 req-d040f042-5c40-466d-87b6-d10e83b62030 service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Received event network-vif-unplugged-22b40255-2ff7-4639-8c10-0959ac5f5917 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-08d7689c-67e0-41fd-a4c7-558de1b856b9 req-d040f042-5c40-466d-87b6-d10e83b62030 service nova] Acquiring lock "a393d263-97a8-4103-a9b4-866b5d6fc435-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-08d7689c-67e0-41fd-a4c7-558de1b856b9 req-d040f042-5c40-466d-87b6-d10e83b62030 service nova] Lock "a393d263-97a8-4103-a9b4-866b5d6fc435-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-08d7689c-67e0-41fd-a4c7-558de1b856b9 req-d040f042-5c40-466d-87b6-d10e83b62030 service nova] Lock "a393d263-97a8-4103-a9b4-866b5d6fc435-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG nova.compute.manager [req-08d7689c-67e0-41fd-a4c7-558de1b856b9 req-d040f042-5c40-466d-87b6-d10e83b62030 service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] No waiting events found dispatching network-vif-unplugged-22b40255-2ff7-4639-8c10-0959ac5f5917 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG nova.compute.manager [req-08d7689c-67e0-41fd-a4c7-558de1b856b9 req-d040f042-5c40-466d-87b6-d10e83b62030 service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Received event network-vif-unplugged-22b40255-2ff7-4639-8c10-0959ac5f5917 for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG nova.compute.manager [req-08d7689c-67e0-41fd-a4c7-558de1b856b9 req-d040f042-5c40-466d-87b6-d10e83b62030 service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Received event network-vif-plugged-22b40255-2ff7-4639-8c10-0959ac5f5917 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-08d7689c-67e0-41fd-a4c7-558de1b856b9 req-d040f042-5c40-466d-87b6-d10e83b62030 service nova] Acquiring lock "a393d263-97a8-4103-a9b4-866b5d6fc435-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-08d7689c-67e0-41fd-a4c7-558de1b856b9 req-d040f042-5c40-466d-87b6-d10e83b62030 service nova] Lock "a393d263-97a8-4103-a9b4-866b5d6fc435-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-08d7689c-67e0-41fd-a4c7-558de1b856b9 req-d040f042-5c40-466d-87b6-d10e83b62030 service nova] Lock "a393d263-97a8-4103-a9b4-866b5d6fc435-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG nova.compute.manager [req-08d7689c-67e0-41fd-a4c7-558de1b856b9 req-d040f042-5c40-466d-87b6-d10e83b62030 service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] No waiting events found dispatching network-vif-plugged-22b40255-2ff7-4639-8c10-0959ac5f5917 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:35:18 user nova-compute[74189]: WARNING nova.compute.manager [req-08d7689c-67e0-41fd-a4c7-558de1b856b9 req-d040f042-5c40-466d-87b6-d10e83b62030 service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Received unexpected event network-vif-plugged-22b40255-2ff7-4639-8c10-0959ac5f5917 for instance with vm_state active and task_state deleting.
Oct 25 21:35:18 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:35:18 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Took 0.91 seconds to deallocate network for instance.
Oct 25 21:35:18 user nova-compute[74189]: DEBUG nova.compute.manager [req-3eabb846-b9cc-4e31-b8d1-acaaa076606b req-94e10910-8dae-44d0-9f05-f1471e8ca491 service nova] [instance: a393d263-97a8-4103-a9b4-866b5d6fc435] Received event network-vif-deleted-22b40255-2ff7-4639-8c10-0959ac5f5917 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-74755240-b25b-4fa9-8c4a-8d3ae8e74ea6 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-74755240-b25b-4fa9-8c4a-8d3ae8e74ea6 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:19 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-74755240-b25b-4fa9-8c4a-8d3ae8e74ea6 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:35:19 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-74755240-b25b-4fa9-8c4a-8d3ae8e74ea6 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:35:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-74755240-b25b-4fa9-8c4a-8d3ae8e74ea6 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:19 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-74755240-b25b-4fa9-8c4a-8d3ae8e74ea6 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Deleted allocations for instance a393d263-97a8-4103-a9b4-866b5d6fc435
Oct 25 21:35:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-74755240-b25b-4fa9-8c4a-8d3ae8e74ea6 tempest-AttachVolumeNegativeTest-979681322 tempest-AttachVolumeNegativeTest-979681322-project-member] Lock "a393d263-97a8-4103-a9b4-866b5d6fc435" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.990s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:35:19 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23034636436353332', 'path': '/dev/sdc'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:35:19 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034636436353332', 'path': '/dev/sdc'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:35:19 user nova-compute[74189]: DEBUG nova.objects.instance [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lazy-loading 'flavor' on Instance uuid 0da9f3bb-fbf4-4f9a-929f-0d223101b29e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:35:19 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 21:35:19 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:35:19 user nova-compute[74189]:   <source dev="/dev/sdc"/>
Oct 25 21:35:19 user nova-compute[74189]:   <target dev="vdc" bus="virtio"/>
Oct 25 21:35:19 user nova-compute[74189]:   <serial>725b43dd-27d6-40b6-9bf8-7449eb55698c</serial>
Oct 25 21:35:19 user nova-compute[74189]: </disk>
Oct 25 21:35:19 user nova-compute[74189]:  {{(pid=74189) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 21:35:19 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:35:19 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:35:19 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:35:19 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:35:19 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:35:19 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:35:19 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:35:19 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:35:19 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:35:19 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] No VIF found with MAC fa:16:3e:1b:34:34, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:35:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-71bd7609-dedb-441b-9232-dd9d58e3b012 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.100s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:20 user nova-compute[74189]: INFO nova.compute.manager [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Detaching volume fde9143a-cf40-4e9c-8655-8bf020517feb
Oct 25 21:35:20 user nova-compute[74189]: INFO nova.virt.block_device [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Attempting to driver detach volume fde9143a-cf40-4e9c-8655-8bf020517feb from mountpoint /dev/vdb
Oct 25 21:35:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Attempting to detach device vdb from instance 0da9f3bb-fbf4-4f9a-929f-0d223101b29e from the persistent domain config. {{(pid=74189) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 21:35:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:35:20 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:35:20 user nova-compute[74189]:   <source dev="/dev/sdf"/>
Oct 25 21:35:20 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:35:20 user nova-compute[74189]:   <serial>fde9143a-cf40-4e9c-8655-8bf020517feb</serial>
Oct 25 21:35:20 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:35:20 user nova-compute[74189]: </disk>
Oct 25 21:35:20 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:35:20 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Successfully detached device vdb from instance 0da9f3bb-fbf4-4f9a-929f-0d223101b29e from the persistent domain config.
Oct 25 21:35:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0da9f3bb-fbf4-4f9a-929f-0d223101b29e from the live domain config. {{(pid=74189) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 21:35:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:35:20 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:35:20 user nova-compute[74189]:   <source dev="/dev/sdf"/>
Oct 25 21:35:20 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:35:20 user nova-compute[74189]:   <serial>fde9143a-cf40-4e9c-8655-8bf020517feb</serial>
Oct 25 21:35:20 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:35:20 user nova-compute[74189]: </disk>
Oct 25 21:35:20 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:35:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0da9f3bb-fbf4-4f9a-929f-0d223101b29e {{(pid=74189) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 21:35:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:22 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:35:23 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:35:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "8f61139d-d075-41d7-bd04-cc977ec87578" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "8f61139d-d075-41d7-bd04-cc977ec87578" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:25 user nova-compute[74189]: DEBUG nova.objects.instance [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lazy-loading 'flavor' on Instance uuid 8f61139d-d075-41d7-bd04-cc977ec87578 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:35:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "8f61139d-d075-41d7-bd04-cc977ec87578" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "8f61139d-d075-41d7-bd04-cc977ec87578" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "8f61139d-d075-41d7-bd04-cc977ec87578" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:25 user nova-compute[74189]: INFO nova.compute.manager [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Attaching volume 55bca833-cab5-4c4e-9ca0-dbffaa36867c to /dev/vdb
Oct 25 21:35:25 user nova-compute[74189]: DEBUG os_brick.utils [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:35:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b9a2d2-ca91-455b-b3fa-5c6121f60e49]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1aef3e8-4c82-420e-bb04-ece4d5e50e43]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba326152-5e2e-4ebb-a53a-0d22af65f630]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b60993a-8f42-4de8-a2f4-85a5d44f584f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:35:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:35:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:35:25 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:35:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[52df065c-c0cd-4ecb-b3a0-9512a155c0cd]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:35:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:35:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:35:25 user nova-compute[74189]: DEBUG os_brick.utils [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:35:25 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Updating existing volume attachment record: cc1983ef-fb5e-411f-a686-da50e48f6d09 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:35:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:31 user nova-compute[74189]: INFO nova.compute.manager [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Terminating instance
Oct 25 21:35:31 user nova-compute[74189]: DEBUG nova.compute.manager [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:35:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:31 user nova-compute[74189]: DEBUG nova.compute.manager [req-760a0591-c2fc-44ff-9941-89793a146063 req-8b984664-8d8d-49af-9919-6e929f340d18 service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Received event network-vif-unplugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:35:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-760a0591-c2fc-44ff-9941-89793a146063 req-8b984664-8d8d-49af-9919-6e929f340d18 service nova] Acquiring lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-760a0591-c2fc-44ff-9941-89793a146063 req-8b984664-8d8d-49af-9919-6e929f340d18 service nova] Lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-760a0591-c2fc-44ff-9941-89793a146063 req-8b984664-8d8d-49af-9919-6e929f340d18 service nova] Lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:31 user nova-compute[74189]: DEBUG nova.compute.manager [req-760a0591-c2fc-44ff-9941-89793a146063 req-8b984664-8d8d-49af-9919-6e929f340d18 service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] No waiting events found dispatching network-vif-unplugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:35:31 user nova-compute[74189]: DEBUG nova.compute.manager [req-760a0591-c2fc-44ff-9941-89793a146063 req-8b984664-8d8d-49af-9919-6e929f340d18 service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Received event network-vif-unplugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:35:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:32 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Instance destroyed successfully.
Oct 25 21:35:32 user nova-compute[74189]: DEBUG nova.objects.instance [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lazy-loading 'resources' on Instance uuid af1d7b3c-9950-4b74-8f15-b31011ccfa24 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:18:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1510065369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1510065369',id=11,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:20:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='acbb4f93936848a8949477ad124bf98e',ramdisk_id='',reservation_id='r-prbdlvvi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-571481303',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:22:40Z,user_data=None,user_id='fc377c1beaab443683a6d776f2f734ff',uuid=af1d7b3c-9950-4b74-8f15-b31011ccfa24,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "address": "fa:16:3e:03:8e:2f", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4cdb73-9d", "ovs_interfaceid": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Converting VIF {"id": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "address": "fa:16:3e:03:8e:2f", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4cdb73-9d", "ovs_interfaceid": "8f4cdb73-9d83-4bde-82a4-7198b06b904b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:8e:2f,bridge_name='br-int',has_traffic_filtering=True,id=8f4cdb73-9d83-4bde-82a4-7198b06b904b,network=Network(f202171f-dfd8-4a19-9321-788318413ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f4cdb73-9d') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG os_vif [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:8e:2f,bridge_name='br-int',has_traffic_filtering=True,id=8f4cdb73-9d83-4bde-82a4-7198b06b904b,network=Network(f202171f-dfd8-4a19-9321-788318413ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f4cdb73-9d') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f4cdb73-9d, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6d22c6c-bcdc-4668-873e-553125274143) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:35:32 user nova-compute[74189]: INFO os_vif [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:8e:2f,bridge_name='br-int',has_traffic_filtering=True,id=8f4cdb73-9d83-4bde-82a4-7198b06b904b,network=Network(f202171f-dfd8-4a19-9321-788318413ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f4cdb73-9d')
Oct 25 21:35:32 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tUkwnqOm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:35:32 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:35:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef5fa99-87d7-409a-ba46-d6647e2147a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:35:32 user nova-compute[74189]: No targets found.
Oct 25 21:35:32 user nova-compute[74189]: iSNS:
Oct 25 21:35:32 user nova-compute[74189]: No targets found.
Oct 25 21:35:32 user nova-compute[74189]: STATIC:
Oct 25 21:35:32 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb
Oct 25 21:35:32 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:35:32 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:35:32 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c
Oct 25 21:35:32 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:35:32 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:35:32 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90
Oct 25 21:35:32 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:35:32 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:35:32 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98
Oct 25 21:35:32 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:35:32 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:35:32 user nova-compute[74189]: FIRMWARE:
Oct 25 21:35:32 user nova-compute[74189]: No targets found.
Oct 25 21:35:32 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:35:32 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:35:32 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f2f107-8151-45d5-af97-fcff8fb52c1f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7995ce4-16f9-40c0-a4c3-6ca2b70cd5bb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:35:32 user nova-compute[74189]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:35:32 user nova-compute[74189]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb (non-flash)
Oct 25 21:35:32 user nova-compute[74189]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c (non-flash)
Oct 25 21:35:32 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 (non-flash)
Oct 25 21:35:32 user nova-compute[74189]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:35:32 user nova-compute[74189]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb (non-flash)
Oct 25 21:35:32 user nova-compute[74189]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c (non-flash)
Oct 25 21:35:32 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2e4218790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90'): ({'sdb'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Removing single pathed devices sdb {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0598af-b47e-445e-a934-7ea825357be0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[34072836-1849-4d56-befc-b361eb6bedbf]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Flushing IO for device /dev/sdb {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[54362540-9336-4539-8cbe-25f9f30e54ca]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7552b1-e8e6-46f6-902d-6ad71111f8f0]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] SCSI volumes sdb have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b1d759-3e2a-4e58-a22f-21a7ed41c51b]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9578ec0a-916f-40e0-97e8-ac170b91b99b]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90, portal: 172.16.0.220,3260]
Oct 25 21:35:32 user nova-compute[74189]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90, portal: 172.16.0.220,3260] successful.
Oct 25 21:35:32 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f820341-4749-4ef8-8947-7512bc272c90 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[732290b3-3ea3-4541-ac5d-220763a245b8]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] <== disconnect_volume: return (307ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:35:32 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Deleting instance files /opt/stack/data/nova/instances/af1d7b3c-9950-4b74-8f15-b31011ccfa24_del
Oct 25 21:35:32 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Deletion of /opt/stack/data/nova/instances/af1d7b3c-9950-4b74-8f15-b31011ccfa24_del complete
Oct 25 21:35:32 user nova-compute[74189]: INFO nova.compute.manager [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Took 1.21 seconds to destroy the instance on the hypervisor.
Oct 25 21:35:32 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:35:32 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:35:33 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Took 0.46 seconds to deallocate network for instance.
Oct 25 21:35:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-2c04514a-a36c-4200-9cc9-032c1b250e65 req-1ac2bb6c-41aa-42c1-8a53-e37ed65d817d service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Received event network-vif-plugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:35:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2c04514a-a36c-4200-9cc9-032c1b250e65 req-1ac2bb6c-41aa-42c1-8a53-e37ed65d817d service nova] Acquiring lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2c04514a-a36c-4200-9cc9-032c1b250e65 req-1ac2bb6c-41aa-42c1-8a53-e37ed65d817d service nova] Lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-2c04514a-a36c-4200-9cc9-032c1b250e65 req-1ac2bb6c-41aa-42c1-8a53-e37ed65d817d service nova] Lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-2c04514a-a36c-4200-9cc9-032c1b250e65 req-1ac2bb6c-41aa-42c1-8a53-e37ed65d817d service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] No waiting events found dispatching network-vif-plugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:35:33 user nova-compute[74189]: WARNING nova.compute.manager [req-2c04514a-a36c-4200-9cc9-032c1b250e65 req-1ac2bb6c-41aa-42c1-8a53-e37ed65d817d service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Received unexpected event network-vif-plugged-8f4cdb73-9d83-4bde-82a4-7198b06b904b for instance with vm_state active and task_state deleting.
Oct 25 21:35:33 user nova-compute[74189]: DEBUG nova.compute.manager [req-2c04514a-a36c-4200-9cc9-032c1b250e65 req-1ac2bb6c-41aa-42c1-8a53-e37ed65d817d service nova] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Received event network-vif-deleted-8f4cdb73-9d83-4bde-82a4-7198b06b904b {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:35:33 user nova-compute[74189]: INFO nova.compute.manager [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: af1d7b3c-9950-4b74-8f15-b31011ccfa24] Took 0.83 seconds to detach 1 volumes for instance.
Oct 25 21:35:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:34 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:35:34 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:35:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.261s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:34 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Deleted allocations for instance af1d7b3c-9950-4b74-8f15-b31011ccfa24
Oct 25 21:35:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-43ad1c46-f0e6-4ddd-a5ba-3edbfbf78ee0 tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "af1d7b3c-9950-4b74-8f15-b31011ccfa24" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.944s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:37 user nova-compute[74189]: DEBUG nova.compute.manager [req-b35aa187-5b6b-4184-aaab-7ad8a7e8cc70 req-b25c002e-961d-413a-a10f-7017b2ffbe3d service nova] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Received event network-changed-8eb6e9e2-60c6-463d-8525-b768933a94df {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:35:37 user nova-compute[74189]: DEBUG nova.compute.manager [req-b35aa187-5b6b-4184-aaab-7ad8a7e8cc70 req-b25c002e-961d-413a-a10f-7017b2ffbe3d service nova] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Refreshing instance network info cache due to event network-changed-8eb6e9e2-60c6-463d-8525-b768933a94df. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:35:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b35aa187-5b6b-4184-aaab-7ad8a7e8cc70 req-b25c002e-961d-413a-a10f-7017b2ffbe3d service nova] Acquiring lock "refresh_cache-932fe8ac-fdde-45c6-aa32-9bf866f19a4e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:35:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b35aa187-5b6b-4184-aaab-7ad8a7e8cc70 req-b25c002e-961d-413a-a10f-7017b2ffbe3d service nova] Acquired lock "refresh_cache-932fe8ac-fdde-45c6-aa32-9bf866f19a4e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:35:37 user nova-compute[74189]: DEBUG nova.network.neutron [req-b35aa187-5b6b-4184-aaab-7ad8a7e8cc70 req-b25c002e-961d-413a-a10f-7017b2ffbe3d service nova] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Refreshing network info cache for port 8eb6e9e2-60c6-463d-8525-b768933a94df {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:35:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:37 user nova-compute[74189]: DEBUG nova.network.neutron [req-b35aa187-5b6b-4184-aaab-7ad8a7e8cc70 req-b25c002e-961d-413a-a10f-7017b2ffbe3d service nova] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Updated VIF entry in instance network info cache for port 8eb6e9e2-60c6-463d-8525-b768933a94df. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:35:37 user nova-compute[74189]: DEBUG nova.network.neutron [req-b35aa187-5b6b-4184-aaab-7ad8a7e8cc70 req-b25c002e-961d-413a-a10f-7017b2ffbe3d service nova] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Updating instance_info_cache with network_info: [{"id": "8eb6e9e2-60c6-463d-8525-b768933a94df", "address": "fa:16:3e:e8:de:d0", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb6e9e2-60", "ovs_interfaceid": "8eb6e9e2-60c6-463d-8525-b768933a94df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:35:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b35aa187-5b6b-4184-aaab-7ad8a7e8cc70 req-b25c002e-961d-413a-a10f-7017b2ffbe3d service nova] Releasing lock "refresh_cache-932fe8ac-fdde-45c6-aa32-9bf866f19a4e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:35:38 user nova-compute[74189]: DEBUG nova.compute.manager [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Stashing vm_state: active {{(pid=74189) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 25 21:35:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:38 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:35:38 user nova-compute[74189]: INFO nova.compute.claims [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Claim successful on node user
Oct 25 21:35:38 user nova-compute[74189]: INFO nova.compute.resource_tracker [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Updating resource usage from migration ebb9e7f8-510b-4cd4-93f8-acaf513b3ddf
Oct 25 21:35:38 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:35:38 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:35:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.327s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:38 user nova-compute[74189]: INFO nova.compute.manager [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Migrating
Oct 25 21:35:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "refresh_cache-1926c2ce-9643-4d00-9f54-a6747e71875b" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:35:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquired lock "refresh_cache-1926c2ce-9643-4d00-9f54-a6747e71875b" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:35:39 user nova-compute[74189]: DEBUG nova.network.neutron [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:35:39 user nova-compute[74189]: DEBUG nova.compute.manager [req-bf268a36-5751-4dac-b8ff-c3d1eb54b8fe req-66077690-7f12-4be9-8c48-3c256a81682e service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Received event network-changed-5d26f4c0-286d-4528-95fc-2d881f739fd2 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:35:39 user nova-compute[74189]: DEBUG nova.compute.manager [req-bf268a36-5751-4dac-b8ff-c3d1eb54b8fe req-66077690-7f12-4be9-8c48-3c256a81682e service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Refreshing instance network info cache due to event network-changed-5d26f4c0-286d-4528-95fc-2d881f739fd2. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:35:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bf268a36-5751-4dac-b8ff-c3d1eb54b8fe req-66077690-7f12-4be9-8c48-3c256a81682e service nova] Acquiring lock "refresh_cache-1926c2ce-9643-4d00-9f54-a6747e71875b" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:35:39 user nova-compute[74189]: DEBUG nova.network.neutron [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Updating instance_info_cache with network_info: [{"id": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "address": "fa:16:3e:6e:2f:0e", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d26f4c0-28", "ovs_interfaceid": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:35:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Releasing lock "refresh_cache-1926c2ce-9643-4d00-9f54-a6747e71875b" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:35:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bf268a36-5751-4dac-b8ff-c3d1eb54b8fe req-66077690-7f12-4be9-8c48-3c256a81682e service nova] Acquired lock "refresh_cache-1926c2ce-9643-4d00-9f54-a6747e71875b" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:35:39 user nova-compute[74189]: DEBUG nova.network.neutron [req-bf268a36-5751-4dac-b8ff-c3d1eb54b8fe req-66077690-7f12-4be9-8c48-3c256a81682e service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Refreshing network info cache for port 5d26f4c0-286d-4528-95fc-2d881f739fd2 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:35:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Starting migrate_disk_and_power_off {{(pid=74189) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 25 21:35:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG nova.compute.manager [req-39ea2f53-d272-4db6-a2be-8fd275676a2f req-cdf5229e-47e5-447a-bf18-dd60b26f8a60 service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Received event network-vif-unplugged-5d26f4c0-286d-4528-95fc-2d881f739fd2 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-39ea2f53-d272-4db6-a2be-8fd275676a2f req-cdf5229e-47e5-447a-bf18-dd60b26f8a60 service nova] Acquiring lock "1926c2ce-9643-4d00-9f54-a6747e71875b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-39ea2f53-d272-4db6-a2be-8fd275676a2f req-cdf5229e-47e5-447a-bf18-dd60b26f8a60 service nova] Lock "1926c2ce-9643-4d00-9f54-a6747e71875b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-39ea2f53-d272-4db6-a2be-8fd275676a2f req-cdf5229e-47e5-447a-bf18-dd60b26f8a60 service nova] Lock "1926c2ce-9643-4d00-9f54-a6747e71875b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG nova.compute.manager [req-39ea2f53-d272-4db6-a2be-8fd275676a2f req-cdf5229e-47e5-447a-bf18-dd60b26f8a60 service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] No waiting events found dispatching network-vif-unplugged-5d26f4c0-286d-4528-95fc-2d881f739fd2 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:35:40 user nova-compute[74189]: WARNING nova.compute.manager [req-39ea2f53-d272-4db6-a2be-8fd275676a2f req-cdf5229e-47e5-447a-bf18-dd60b26f8a60 service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Received unexpected event network-vif-unplugged-5d26f4c0-286d-4528-95fc-2d881f739fd2 for instance with vm_state active and task_state resize_migrating.
Oct 25 21:35:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG nova.network.neutron [req-bf268a36-5751-4dac-b8ff-c3d1eb54b8fe req-66077690-7f12-4be9-8c48-3c256a81682e service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Updated VIF entry in instance network info cache for port 5d26f4c0-286d-4528-95fc-2d881f739fd2. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG nova.network.neutron [req-bf268a36-5751-4dac-b8ff-c3d1eb54b8fe req-66077690-7f12-4be9-8c48-3c256a81682e service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Updating instance_info_cache with network_info: [{"id": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "address": "fa:16:3e:6e:2f:0e", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d26f4c0-28", "ovs_interfaceid": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bf268a36-5751-4dac-b8ff-c3d1eb54b8fe req-66077690-7f12-4be9-8c48-3c256a81682e service nova] Releasing lock "refresh_cache-1926c2ce-9643-4d00-9f54-a6747e71875b" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:35:40 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Instance destroyed successfully.
Oct 25 21:35:40 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:33:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1901274081',display_name='tempest-ServerActionsTestOtherA-server-1901274081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1901274081',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2S7seSL6H542o42+kjhdFVCcVB3vmP0zFQehKH4IjkXrBgeXgKPGixJeOzeDKKnbCU86Dz8L3oU7gAYCj2cW/f6u+7OuTUBmRTwo8tpApDh9NwCKVzKxF9Lu0jaZZAvw==',key_name='tempest-keypair-2141227250',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:34:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4815aedea48841188ed8797a0eb51925',ramdisk_id='',reservation_id='r-984gu0e6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1355855048',owner_user_name='tempest-ServerActionsTestOtherA-1355855048-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:35:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b34817b1868f40a38a32a51d0e970d51',uuid=1926c2ce-9643-4d00-9f54-a6747e71875b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "address": "fa:16:3e:6e:2f:0e", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-94415228-network", "vif_mac": "fa:16:3e:6e:2f:0e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d26f4c0-28", "ovs_interfaceid": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Converting VIF {"id": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "address": "fa:16:3e:6e:2f:0e", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-94415228-network", "vif_mac": "fa:16:3e:6e:2f:0e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d26f4c0-28", "ovs_interfaceid": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:2f:0e,bridge_name='br-int',has_traffic_filtering=True,id=5d26f4c0-286d-4528-95fc-2d881f739fd2,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d26f4c0-28') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG os_vif [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:2f:0e,bridge_name='br-int',has_traffic_filtering=True,id=5d26f4c0-286d-4528-95fc-2d881f739fd2,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d26f4c0-28') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d26f4c0-28, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d2890000-931e-484f-ba7c-9e5dfdbfd282) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:40 user nova-compute[74189]: INFO os_vif [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:2f:0e,bridge_name='br-int',has_traffic_filtering=True,id=5d26f4c0-286d-4528-95fc-2d881f739fd2,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d26f4c0-28')
Oct 25 21:35:40 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsJSLGjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:35:40 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:35:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5247945d-1c78-4d65-b765-6a17e2ecf798]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:35:40 user nova-compute[74189]: No targets found.
Oct 25 21:35:40 user nova-compute[74189]: iSNS:
Oct 25 21:35:40 user nova-compute[74189]: No targets found.
Oct 25 21:35:40 user nova-compute[74189]: STATIC:
Oct 25 21:35:40 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb
Oct 25 21:35:40 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:35:40 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:35:40 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c
Oct 25 21:35:40 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:35:40 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:35:40 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98
Oct 25 21:35:40 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:35:40 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:35:40 user nova-compute[74189]: FIRMWARE:
Oct 25 21:35:40 user nova-compute[74189]: No targets found.
Oct 25 21:35:40 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:35:40 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:35:40 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c889ca8e-48c8-4899-817c-ee3d36d720d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd83860-33e3-4028-b503-c960fdff2239]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:35:40 user nova-compute[74189]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb (non-flash)
Oct 25 21:35:40 user nova-compute[74189]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c (non-flash)
Oct 25 21:35:40 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:35:40 user nova-compute[74189]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb (non-flash)
Oct 25 21:35:40 user nova-compute[74189]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c (non-flash)
Oct 25 21:35:40 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe30436dab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98'): ({'sdd'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Removing single pathed devices sdd {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e2bfcd-756d-41ad-b96f-29ad544fb132]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b56e034-ca4a-442f-8326-2473be05dee2]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Flushing IO for device /dev/sdd {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bff243-1b0d-48e6-be6d-8143b884f814]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba7b78f-8678-4ec9-b870-01306892c57a]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] SCSI volumes sdd have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f33da10-8016-41d6-98e8-78c6f6df32d8]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[441234c7-0ecc-475f-a222-78a15a57c3e0]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98, portal: 172.16.0.220,3260]
Oct 25 21:35:40 user nova-compute[74189]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98, portal: 172.16.0.220,3260] successful.
Oct 25 21:35:40 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea17e284-5e81-4442-a5cd-66b262d58e3d]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] <== disconnect_volume: return (289ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:35:40 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:35:41 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0da9f3bb-fbf4-4f9a-929f-0d223101b29e is timed out.
Oct 25 21:35:41 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Successfully detached device vdb from instance 0da9f3bb-fbf4-4f9a-929f-0d223101b29e from the live domain config.
Oct 25 21:35:41 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'roliNTUq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:35:41 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:35:41 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd314c8-dd85-4562-b5fb-d60a8a578cf2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:35:41 user nova-compute[74189]: No targets found.
Oct 25 21:35:41 user nova-compute[74189]: iSNS:
Oct 25 21:35:41 user nova-compute[74189]: No targets found.
Oct 25 21:35:41 user nova-compute[74189]: STATIC:
Oct 25 21:35:41 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb
Oct 25 21:35:41 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:35:41 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:35:41 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c
Oct 25 21:35:41 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:35:41 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:35:41 user nova-compute[74189]: FIRMWARE:
Oct 25 21:35:41 user nova-compute[74189]: No targets found.
Oct 25 21:35:41 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:35:41 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:35:41 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d180ce-88a7-40db-8d22-14252e8464dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb78ca6-1e34-4e01-b26f-3b5259ae6cdd]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb (non-flash)
Oct 25 21:35:41 user nova-compute[74189]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c (non-flash)
Oct 25 21:35:41 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb (non-flash)
Oct 25 21:35:41 user nova-compute[74189]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c (non-flash)
Oct 25 21:35:41 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2e421b640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb'): ({'sdf'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Removing single pathed devices sdf {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1577fe30-3f0e-4326-861f-5fb4c63cc224]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da20cf0-590a-46eb-9cdc-6066f624a64a]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Flushing IO for device /dev/sdf {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c5dfa4-fe38-41f4-9205-f63f0a929692]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.062s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e6b6bf-7678-4ede-825c-4fefa3929758]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] SCSI volumes sdf have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[996dc81b-9aad-456f-9881-fba8dd4c7173]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c605828-00da-4c68-8d5c-382a23e25c16]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb, portal: 172.16.0.220,3260]
Oct 25 21:35:41 user nova-compute[74189]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb, portal: 172.16.0.220,3260] successful.
Oct 25 21:35:41 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fde9143a-cf40-4e9c-8655-8bf020517feb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e76050f-314f-40f3-aa34-d4d07a57c46a]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] <== disconnect_volume: return (310ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG nova.network.neutron [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Port 5d26f4c0-286d-4528-95fc-2d881f739fd2 binding to destination host user is already ACTIVE {{(pid=74189) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "1926c2ce-9643-4d00-9f54-a6747e71875b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "1926c2ce-9643-4d00-9f54-a6747e71875b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "1926c2ce-9643-4d00-9f54-a6747e71875b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:42 user nova-compute[74189]: DEBUG nova.compute.manager [req-e27a2adf-11eb-47fe-88c0-b0196c69d36f req-f40c3aa6-739a-4685-bfc3-7310c59e59f4 service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Received event network-vif-plugged-5d26f4c0-286d-4528-95fc-2d881f739fd2 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:35:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e27a2adf-11eb-47fe-88c0-b0196c69d36f req-f40c3aa6-739a-4685-bfc3-7310c59e59f4 service nova] Acquiring lock "1926c2ce-9643-4d00-9f54-a6747e71875b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e27a2adf-11eb-47fe-88c0-b0196c69d36f req-f40c3aa6-739a-4685-bfc3-7310c59e59f4 service nova] Lock "1926c2ce-9643-4d00-9f54-a6747e71875b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e27a2adf-11eb-47fe-88c0-b0196c69d36f req-f40c3aa6-739a-4685-bfc3-7310c59e59f4 service nova] Lock "1926c2ce-9643-4d00-9f54-a6747e71875b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:42 user nova-compute[74189]: DEBUG nova.compute.manager [req-e27a2adf-11eb-47fe-88c0-b0196c69d36f req-f40c3aa6-739a-4685-bfc3-7310c59e59f4 service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] No waiting events found dispatching network-vif-plugged-5d26f4c0-286d-4528-95fc-2d881f739fd2 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:35:42 user nova-compute[74189]: WARNING nova.compute.manager [req-e27a2adf-11eb-47fe-88c0-b0196c69d36f req-f40c3aa6-739a-4685-bfc3-7310c59e59f4 service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Received unexpected event network-vif-plugged-5d26f4c0-286d-4528-95fc-2d881f739fd2 for instance with vm_state active and task_state resize_migrated.
Oct 25 21:35:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "refresh_cache-1926c2ce-9643-4d00-9f54-a6747e71875b" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:35:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquired lock "refresh_cache-1926c2ce-9643-4d00-9f54-a6747e71875b" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:35:42 user nova-compute[74189]: DEBUG nova.network.neutron [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:35:42 user nova-compute[74189]: DEBUG nova.objects.instance [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lazy-loading 'flavor' on Instance uuid 0da9f3bb-fbf4-4f9a-929f-0d223101b29e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:35:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3841caec-44c6-4901-b871-19fd229e8701 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.748s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:42 user nova-compute[74189]: DEBUG nova.network.neutron [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Updating instance_info_cache with network_info: [{"id": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "address": "fa:16:3e:6e:2f:0e", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d26f4c0-28", "ovs_interfaceid": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:35:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Releasing lock "refresh_cache-1926c2ce-9643-4d00-9f54-a6747e71875b" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:35:42 user nova-compute[74189]: DEBUG os_brick.utils [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:35:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:42 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4efb0c-0793-4991-8c92-89a52626d3bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:42 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58c9ec9-460c-47cb-b739-06327e65d297]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:42 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee589e5-2aa7-43cb-b0e3-0ec3e1998cfa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:42 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[68887660-19ea-46d8-a7bc-f805b41a7db6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:35:42 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:35:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:35:42 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:35:42 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e614f2d-a8df-4ebf-a7c3-3fb1d77795f2]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:42 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:35:42 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:35:42 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:35:42 user nova-compute[74189]: DEBUG os_brick.utils [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:35:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:43 user nova-compute[74189]: INFO nova.compute.manager [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Detaching volume 725b43dd-27d6-40b6-9bf8-7449eb55698c
Oct 25 21:35:43 user nova-compute[74189]: INFO nova.virt.block_device [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Attempting to driver detach volume 725b43dd-27d6-40b6-9bf8-7449eb55698c from mountpoint /dev/vdc
Oct 25 21:35:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Attempting to detach device vdc from instance 0da9f3bb-fbf4-4f9a-929f-0d223101b29e from the persistent domain config. {{(pid=74189) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 21:35:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:35:43 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:35:43 user nova-compute[74189]:   <source dev="/dev/sdc"/>
Oct 25 21:35:43 user nova-compute[74189]:   <target dev="vdc" bus="virtio"/>
Oct 25 21:35:43 user nova-compute[74189]:   <serial>725b43dd-27d6-40b6-9bf8-7449eb55698c</serial>
Oct 25 21:35:43 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 25 21:35:43 user nova-compute[74189]: </disk>
Oct 25 21:35:43 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:35:43 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Successfully detached device vdc from instance 0da9f3bb-fbf4-4f9a-929f-0d223101b29e from the persistent domain config.
Oct 25 21:35:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0da9f3bb-fbf4-4f9a-929f-0d223101b29e from the live domain config. {{(pid=74189) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 21:35:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:35:43 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:35:43 user nova-compute[74189]:   <source dev="/dev/sdc"/>
Oct 25 21:35:43 user nova-compute[74189]:   <target dev="vdc" bus="virtio"/>
Oct 25 21:35:43 user nova-compute[74189]:   <serial>725b43dd-27d6-40b6-9bf8-7449eb55698c</serial>
Oct 25 21:35:43 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 25 21:35:43 user nova-compute[74189]: </disk>
Oct 25 21:35:43 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:35:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0da9f3bb-fbf4-4f9a-929f-0d223101b29e {{(pid=74189) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQsvZGNl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:35:45 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:35:45 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:35:45 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:35:45 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:35:45 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:35:45 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c3c5c0-c053-45a1-ad73-2e460e26944a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:35:45 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4c0a9e-ba87-47c7-bebe-5c61054a7dfe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c] added
Oct 25 21:35:45 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c78f7f6-862f-4122-809e-9c60b4217f8b]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f693a0bc-4474-4af6-bbbc-39cd536fceb1]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kQsvZGNl {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kQsvZGNl" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d4b340-ef9e-46aa-9099-16b1e2d892aa]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kQsvZGNl'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[352c457c-1858-4b70-9181-3e9a3b0b9994]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2167a31-2a83-4e1b-a055-a2c16d6107fa]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c (non-flash)
Oct 25 21:35:45 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c (non-flash)
Oct 25 21:35:45 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[329b3e4c-1102-4e5b-a864-cd68f2f16ad8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c, portal: 172.16.0.220,3260]
Oct 25 21:35:45 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c, portal: 172.16.0.220,3260] successful.
Oct 25 21:35:45 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.058s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5381c81a-c15a-4a84-baf6-77cbdbbe72f6]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad67c0a-cf6b-4e6c-93ca-150b6a5e62b3]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c (non-flash)
Oct 25 21:35:45 user nova-compute[74189]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c (non-flash)
Oct 25 21:35:45 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c (non-flash)
Oct 25 21:35:45 user nova-compute[74189]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c (non-flash)
Oct 25 21:35:45 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0558945f-796b-4de0-b7c6-9b3dcebeb18d]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:35:45 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQsvZGNl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:35:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:35:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23537643066636661', 'path': '/dev/sdb'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:35:46 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537643066636661', 'path': '/dev/sdb'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:35:46 user nova-compute[74189]: DEBUG nova.objects.instance [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lazy-loading 'flavor' on Instance uuid 8f61139d-d075-41d7-bd04-cc977ec87578 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:35:46 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 21:35:46 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:35:46 user nova-compute[74189]:   <source dev="/dev/sdb"/>
Oct 25 21:35:46 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:35:46 user nova-compute[74189]:   <serial>55bca833-cab5-4c4e-9ca0-dbffaa36867c</serial>
Oct 25 21:35:46 user nova-compute[74189]: </disk>
Oct 25 21:35:46 user nova-compute[74189]:  {{(pid=74189) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 21:35:46 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:35:46 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:35:46 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] No VIF found with MAC fa:16:3e:f8:7c:39, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:35:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-80dc1749-46fd-4b2e-8c6f-33653dc5bc57 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "8f61139d-d075-41d7-bd04-cc977ec87578" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.578s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:49 user nova-compute[74189]: DEBUG nova.compute.manager [req-40c45334-c2d0-4f85-a276-9bbb5768797f req-0e5cbe8c-ebae-4fe0-876a-63100fa07831 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Received event network-changed-83f7d737-3cbc-4a68-8f5f-da99acae2d42 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:35:49 user nova-compute[74189]: DEBUG nova.compute.manager [req-40c45334-c2d0-4f85-a276-9bbb5768797f req-0e5cbe8c-ebae-4fe0-876a-63100fa07831 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Refreshing instance network info cache due to event network-changed-83f7d737-3cbc-4a68-8f5f-da99acae2d42. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:35:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-40c45334-c2d0-4f85-a276-9bbb5768797f req-0e5cbe8c-ebae-4fe0-876a-63100fa07831 service nova] Acquiring lock "refresh_cache-8f61139d-d075-41d7-bd04-cc977ec87578" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:35:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-40c45334-c2d0-4f85-a276-9bbb5768797f req-0e5cbe8c-ebae-4fe0-876a-63100fa07831 service nova] Acquired lock "refresh_cache-8f61139d-d075-41d7-bd04-cc977ec87578" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:35:49 user nova-compute[74189]: DEBUG nova.network.neutron [req-40c45334-c2d0-4f85-a276-9bbb5768797f req-0e5cbe8c-ebae-4fe0-876a-63100fa07831 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Refreshing network info cache for port 83f7d737-3cbc-4a68-8f5f-da99acae2d42 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:35:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:50 user nova-compute[74189]: DEBUG nova.network.neutron [req-40c45334-c2d0-4f85-a276-9bbb5768797f req-0e5cbe8c-ebae-4fe0-876a-63100fa07831 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Updated VIF entry in instance network info cache for port 83f7d737-3cbc-4a68-8f5f-da99acae2d42. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:35:50 user nova-compute[74189]: DEBUG nova.network.neutron [req-40c45334-c2d0-4f85-a276-9bbb5768797f req-0e5cbe8c-ebae-4fe0-876a-63100fa07831 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Updating instance_info_cache with network_info: [{"id": "83f7d737-3cbc-4a68-8f5f-da99acae2d42", "address": "fa:16:3e:f8:7c:39", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f7d737-3c", "ovs_interfaceid": "83f7d737-3cbc-4a68-8f5f-da99acae2d42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:35:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-40c45334-c2d0-4f85-a276-9bbb5768797f req-0e5cbe8c-ebae-4fe0-876a-63100fa07831 service nova] Releasing lock "refresh_cache-8f61139d-d075-41d7-bd04-cc977ec87578" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:35:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "dcb582a2-5198-44aa-bbe8-48978975e9eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "dcb582a2-5198-44aa-bbe8-48978975e9eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:52 user nova-compute[74189]: DEBUG nova.compute.manager [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:35:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:52 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:35:52 user nova-compute[74189]: INFO nova.compute.claims [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Claim successful on node user
Oct 25 21:35:52 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:35:52 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:35:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:52 user nova-compute[74189]: DEBUG nova.compute.manager [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:35:52 user nova-compute[74189]: DEBUG nova.compute.manager [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:35:52 user nova-compute[74189]: DEBUG nova.network.neutron [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:35:52 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:35:52 user nova-compute[74189]: DEBUG nova.compute.manager [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:35:53 user nova-compute[74189]: DEBUG nova.policy [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '77a27a7ebb4a458097c901871c378bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e893e8f3f58e4e15920d313b6391682c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:35:53 user nova-compute[74189]: INFO nova.virt.block_device [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Booting with volume 8c22cfde-db3c-4c83-994c-46925b21920d at /dev/vda
Oct 25 21:35:53 user nova-compute[74189]: DEBUG nova.compute.manager [req-c7b52c51-f846-461b-9ebd-7d6abebab5c5 req-a99b0917-2031-43e1-8565-46cd901fb3b6 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Received event network-changed-83f7d737-3cbc-4a68-8f5f-da99acae2d42 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:35:53 user nova-compute[74189]: DEBUG nova.compute.manager [req-c7b52c51-f846-461b-9ebd-7d6abebab5c5 req-a99b0917-2031-43e1-8565-46cd901fb3b6 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Refreshing instance network info cache due to event network-changed-83f7d737-3cbc-4a68-8f5f-da99acae2d42. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:35:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c7b52c51-f846-461b-9ebd-7d6abebab5c5 req-a99b0917-2031-43e1-8565-46cd901fb3b6 service nova] Acquiring lock "refresh_cache-8f61139d-d075-41d7-bd04-cc977ec87578" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:35:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c7b52c51-f846-461b-9ebd-7d6abebab5c5 req-a99b0917-2031-43e1-8565-46cd901fb3b6 service nova] Acquired lock "refresh_cache-8f61139d-d075-41d7-bd04-cc977ec87578" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:35:53 user nova-compute[74189]: DEBUG nova.network.neutron [req-c7b52c51-f846-461b-9ebd-7d6abebab5c5 req-a99b0917-2031-43e1-8565-46cd901fb3b6 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Refreshing network info cache for port 83f7d737-3cbc-4a68-8f5f-da99acae2d42 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:35:53 user nova-compute[74189]: DEBUG os_brick.utils [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:35:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:53 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6fa2f6-e806-4f7f-b6a6-bd580bad2588]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:53 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8fddfe-6a97-4059-8910-33f41bf34e25]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:35:53 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b77f9b-f0c8-4db3-bfd0-528395f54670]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:53 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[76386b8c-2f8c-4f5e-90dc-db75d9499f74]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:35:53 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:35:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:35:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:35:53 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:35:53 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0a5c83-d254-4bfc-949a-c1a4454d6137]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:35:53 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:35:53 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:35:53 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:35:53 user nova-compute[74189]: DEBUG os_brick.utils [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:35:53 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Updating existing volume attachment record: 4dfe27ac-a39f-4139-a27c-ef16fcf2f582 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:35:53 user nova-compute[74189]: DEBUG nova.network.neutron [req-c7b52c51-f846-461b-9ebd-7d6abebab5c5 req-a99b0917-2031-43e1-8565-46cd901fb3b6 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Updated VIF entry in instance network info cache for port 83f7d737-3cbc-4a68-8f5f-da99acae2d42. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:35:53 user nova-compute[74189]: DEBUG nova.network.neutron [req-c7b52c51-f846-461b-9ebd-7d6abebab5c5 req-a99b0917-2031-43e1-8565-46cd901fb3b6 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Updating instance_info_cache with network_info: [{"id": "83f7d737-3cbc-4a68-8f5f-da99acae2d42", "address": "fa:16:3e:f8:7c:39", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f7d737-3c", "ovs_interfaceid": "83f7d737-3cbc-4a68-8f5f-da99acae2d42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:35:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c7b52c51-f846-461b-9ebd-7d6abebab5c5 req-a99b0917-2031-43e1-8565-46cd901fb3b6 service nova] Releasing lock "refresh_cache-8f61139d-d075-41d7-bd04-cc977ec87578" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:35:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-68a3b604-c858-4f04-abe0-2754e9ce70ad tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "8f61139d-d075-41d7-bd04-cc977ec87578" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-68a3b604-c858-4f04-abe0-2754e9ce70ad tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "8f61139d-d075-41d7-bd04-cc977ec87578" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:53 user nova-compute[74189]: INFO nova.compute.manager [None req-68a3b604-c858-4f04-abe0-2754e9ce70ad tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Rebooting instance
Oct 25 21:35:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-68a3b604-c858-4f04-abe0-2754e9ce70ad tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "refresh_cache-8f61139d-d075-41d7-bd04-cc977ec87578" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:35:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-68a3b604-c858-4f04-abe0-2754e9ce70ad tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquired lock "refresh_cache-8f61139d-d075-41d7-bd04-cc977ec87578" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:35:53 user nova-compute[74189]: DEBUG nova.network.neutron [None req-68a3b604-c858-4f04-abe0-2754e9ce70ad tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:35:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:54 user nova-compute[74189]: DEBUG nova.network.neutron [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Successfully created port: 0b83b195-15ba-461f-87f1-465a6a1066ce {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:35:54 user nova-compute[74189]: DEBUG nova.network.neutron [None req-68a3b604-c858-4f04-abe0-2754e9ce70ad tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Updating instance_info_cache with network_info: [{"id": "83f7d737-3cbc-4a68-8f5f-da99acae2d42", "address": "fa:16:3e:f8:7c:39", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f7d737-3c", "ovs_interfaceid": "83f7d737-3cbc-4a68-8f5f-da99acae2d42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:35:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-68a3b604-c858-4f04-abe0-2754e9ce70ad tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Releasing lock "refresh_cache-8f61139d-d075-41d7-bd04-cc977ec87578" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:35:54 user nova-compute[74189]: DEBUG nova.compute.manager [None req-68a3b604-c858-4f04-abe0-2754e9ce70ad tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:35:54 user nova-compute[74189]: DEBUG nova.network.neutron [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Successfully updated port: 0b83b195-15ba-461f-87f1-465a6a1066ce {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:35:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "refresh_cache-dcb582a2-5198-44aa-bbe8-48978975e9eb" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:35:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquired lock "refresh_cache-dcb582a2-5198-44aa-bbe8-48978975e9eb" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:35:54 user nova-compute[74189]: DEBUG nova.network.neutron [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:35:55 user nova-compute[74189]: DEBUG nova.compute.manager [req-0d56eac1-9b6d-4233-b058-2fb877ae7a76 req-407478b9-8018-496d-8bff-38470647eadb service nova] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Received event network-changed-0b83b195-15ba-461f-87f1-465a6a1066ce {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:35:55 user nova-compute[74189]: DEBUG nova.compute.manager [req-0d56eac1-9b6d-4233-b058-2fb877ae7a76 req-407478b9-8018-496d-8bff-38470647eadb service nova] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Refreshing instance network info cache due to event network-changed-0b83b195-15ba-461f-87f1-465a6a1066ce. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:35:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0d56eac1-9b6d-4233-b058-2fb877ae7a76 req-407478b9-8018-496d-8bff-38470647eadb service nova] Acquiring lock "refresh_cache-dcb582a2-5198-44aa-bbe8-48978975e9eb" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:35:55 user nova-compute[74189]: DEBUG nova.network.neutron [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:35:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:55 user nova-compute[74189]: DEBUG nova.network.neutron [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Updating instance_info_cache with network_info: [{"id": "0b83b195-15ba-461f-87f1-465a6a1066ce", "address": "fa:16:3e:34:0f:94", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b83b195-15", "ovs_interfaceid": "0b83b195-15ba-461f-87f1-465a6a1066ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:35:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Releasing lock "refresh_cache-dcb582a2-5198-44aa-bbe8-48978975e9eb" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:35:55 user nova-compute[74189]: DEBUG nova.compute.manager [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Instance network_info: |[{"id": "0b83b195-15ba-461f-87f1-465a6a1066ce", "address": "fa:16:3e:34:0f:94", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b83b195-15", "ovs_interfaceid": "0b83b195-15ba-461f-87f1-465a6a1066ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:35:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0d56eac1-9b6d-4233-b058-2fb877ae7a76 req-407478b9-8018-496d-8bff-38470647eadb service nova] Acquired lock "refresh_cache-dcb582a2-5198-44aa-bbe8-48978975e9eb" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:35:55 user nova-compute[74189]: DEBUG nova.network.neutron [req-0d56eac1-9b6d-4233-b058-2fb877ae7a76 req-407478b9-8018-496d-8bff-38470647eadb service nova] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Refreshing network info cache for port 0b83b195-15ba-461f-87f1-465a6a1066ce {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:35:55 user nova-compute[74189]: DEBUG nova.network.neutron [req-0d56eac1-9b6d-4233-b058-2fb877ae7a76 req-407478b9-8018-496d-8bff-38470647eadb service nova] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Updated VIF entry in instance network info cache for port 0b83b195-15ba-461f-87f1-465a6a1066ce. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:35:55 user nova-compute[74189]: DEBUG nova.network.neutron [req-0d56eac1-9b6d-4233-b058-2fb877ae7a76 req-407478b9-8018-496d-8bff-38470647eadb service nova] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Updating instance_info_cache with network_info: [{"id": "0b83b195-15ba-461f-87f1-465a6a1066ce", "address": "fa:16:3e:34:0f:94", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b83b195-15", "ovs_interfaceid": "0b83b195-15ba-461f-87f1-465a6a1066ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:35:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0d56eac1-9b6d-4233-b058-2fb877ae7a76 req-407478b9-8018-496d-8bff-38470647eadb service nova] Releasing lock "refresh_cache-dcb582a2-5198-44aa-bbe8-48978975e9eb" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:35:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:56 user nova-compute[74189]: DEBUG nova.compute.manager [req-a50eda55-bafd-43f9-8430-02bcb45f274b req-13c54544-c75d-4927-b79f-25135713e1b3 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Received event network-vif-unplugged-83f7d737-3cbc-4a68-8f5f-da99acae2d42 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:35:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a50eda55-bafd-43f9-8430-02bcb45f274b req-13c54544-c75d-4927-b79f-25135713e1b3 service nova] Acquiring lock "8f61139d-d075-41d7-bd04-cc977ec87578-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a50eda55-bafd-43f9-8430-02bcb45f274b req-13c54544-c75d-4927-b79f-25135713e1b3 service nova] Lock "8f61139d-d075-41d7-bd04-cc977ec87578-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a50eda55-bafd-43f9-8430-02bcb45f274b req-13c54544-c75d-4927-b79f-25135713e1b3 service nova] Lock "8f61139d-d075-41d7-bd04-cc977ec87578-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:56 user nova-compute[74189]: DEBUG nova.compute.manager [req-a50eda55-bafd-43f9-8430-02bcb45f274b req-13c54544-c75d-4927-b79f-25135713e1b3 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] No waiting events found dispatching network-vif-unplugged-83f7d737-3cbc-4a68-8f5f-da99acae2d42 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:35:56 user nova-compute[74189]: WARNING nova.compute.manager [req-a50eda55-bafd-43f9-8430-02bcb45f274b req-13c54544-c75d-4927-b79f-25135713e1b3 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Received unexpected event network-vif-unplugged-83f7d737-3cbc-4a68-8f5f-da99acae2d42 for instance with vm_state active and task_state reboot_started.
Oct 25 21:35:57 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-68a3b604-c858-4f04-abe0-2754e9ce70ad tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Instance shutdown successfully.
Oct 25 21:35:58 user nova-compute[74189]: INFO nova.compute.manager [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Rescuing
Oct 25 21:35:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "refresh_cache-3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:35:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquired lock "refresh_cache-3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:35:58 user nova-compute[74189]: DEBUG nova.network.neutron [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:35:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:58 user nova-compute[74189]: DEBUG nova.compute.manager [req-e3124042-f88f-49bb-b442-9773666f248a req-e466660a-2240-4178-9b91-7158322e4853 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Received event network-vif-plugged-83f7d737-3cbc-4a68-8f5f-da99acae2d42 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:35:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e3124042-f88f-49bb-b442-9773666f248a req-e466660a-2240-4178-9b91-7158322e4853 service nova] Acquiring lock "8f61139d-d075-41d7-bd04-cc977ec87578-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e3124042-f88f-49bb-b442-9773666f248a req-e466660a-2240-4178-9b91-7158322e4853 service nova] Lock "8f61139d-d075-41d7-bd04-cc977ec87578-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e3124042-f88f-49bb-b442-9773666f248a req-e466660a-2240-4178-9b91-7158322e4853 service nova] Lock "8f61139d-d075-41d7-bd04-cc977ec87578-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:58 user nova-compute[74189]: DEBUG nova.compute.manager [req-e3124042-f88f-49bb-b442-9773666f248a req-e466660a-2240-4178-9b91-7158322e4853 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] No waiting events found dispatching network-vif-plugged-83f7d737-3cbc-4a68-8f5f-da99acae2d42 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:35:58 user nova-compute[74189]: WARNING nova.compute.manager [req-e3124042-f88f-49bb-b442-9773666f248a req-e466660a-2240-4178-9b91-7158322e4853 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Received unexpected event network-vif-plugged-83f7d737-3cbc-4a68-8f5f-da99acae2d42 for instance with vm_state active and task_state reboot_started.
Oct 25 21:35:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:59 user nova-compute[74189]: DEBUG nova.network.neutron [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Updating instance_info_cache with network_info: [{"id": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "address": "fa:16:3e:5d:2c:57", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d0e911-b6", "ovs_interfaceid": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:35:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Releasing lock "refresh_cache-3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:35:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-c9663e8b-1faa-4e22-b2a0-bcda4e900751 req-c98169b6-522b-40e0-a0af-5ee10c7c4c91 service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Received event network-vif-unplugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:35:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c9663e8b-1faa-4e22-b2a0-bcda4e900751 req-c98169b6-522b-40e0-a0af-5ee10c7c4c91 service nova] Acquiring lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c9663e8b-1faa-4e22-b2a0-bcda4e900751 req-c98169b6-522b-40e0-a0af-5ee10c7c4c91 service nova] Lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c9663e8b-1faa-4e22-b2a0-bcda4e900751 req-c98169b6-522b-40e0-a0af-5ee10c7c4c91 service nova] Lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-c9663e8b-1faa-4e22-b2a0-bcda4e900751 req-c98169b6-522b-40e0-a0af-5ee10c7c4c91 service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] No waiting events found dispatching network-vif-unplugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:35:59 user nova-compute[74189]: WARNING nova.compute.manager [req-c9663e8b-1faa-4e22-b2a0-bcda4e900751 req-c98169b6-522b-40e0-a0af-5ee10c7c4c91 service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Received unexpected event network-vif-unplugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf for instance with vm_state active and task_state rescuing.
Oct 25 21:35:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:35:59 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Instance destroyed successfully.
Oct 25 21:35:59 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Attempting rescue
Oct 25 21:35:59 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74189) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 25 21:35:59 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Instance directory exists: not creating {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 21:35:59 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Creating image(s)
Oct 25 21:35:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "/opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:35:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "/opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:35:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "/opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:35:59 user nova-compute[74189]: DEBUG nova.objects.instance [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.201s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk.rescue {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk.rescue" returned: 0 in 0.050s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.objects.instance [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lazy-loading 'migration_context' on Instance uuid 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.objects.base [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Object Instance<3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Start _get_guest_xml network_info=[{"id": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "address": "fa:16:3e:5d:2c:57", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "vif_mac": "fa:16:3e:5d:2c:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d0e911-b6", "ovs_interfaceid": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.objects.instance [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lazy-loading 'resources' on Instance uuid 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.objects.base [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Object Instance<3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.objects.instance [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lazy-loading 'numa_topology' on Instance uuid 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.objects.base [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Object Instance<3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:36:00 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:36:00 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.objects.instance [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.objects.base [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Object Instance<3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:31:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1844515886',display_name='tempest-ServerRescueNegativeTestJSON-server-1844515886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1844515886',id=32,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:31:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3df03fc18fc3467db76e336c6de78c92',ramdisk_id='',reservation_id='r-7eqktzfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-383982506',owner_user_name='tempest-ServerRescueNegativeTestJSON-383982506-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:31:21Z,user_data=None,user_id='155c948b95c64c9083da984cdf6af494',uuid=3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "address": "fa:16:3e:5d:2c:57", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "vif_mac": "fa:16:3e:5d:2c:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d0e911-b6", "ovs_interfaceid": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Converting VIF {"id": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "address": "fa:16:3e:5d:2c:57", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "vif_mac": "fa:16:3e:5d:2c:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d0e911-b6", "ovs_interfaceid": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:2c:57,bridge_name='br-int',has_traffic_filtering=True,id=67d0e911-b6fd-44a7-ad9c-8b204562a0bf,network=Network(b496a106-2367-44dc-a788-bcd22ec98feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d0e911-b6') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.objects.instance [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lazy-loading 'pci_devices' on Instance uuid 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.objects.base [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Object Instance<3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:36:00 user nova-compute[74189]:   <uuid>3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef</uuid>
Oct 25 21:36:00 user nova-compute[74189]:   <name>instance-00000020</name>
Oct 25 21:36:00 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:36:00 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:36:00 user nova-compute[74189]:   <metadata>
Oct 25 21:36:00 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:36:00 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:36:00 user nova-compute[74189]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1844515886</nova:name>
Oct 25 21:36:00 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:36:00</nova:creationTime>
Oct 25 21:36:00 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:36:00 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:36:00 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:36:00 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:36:00 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:36:00 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:36:00 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:36:00 user nova-compute[74189]:       <nova:owner>
Oct 25 21:36:00 user nova-compute[74189]:         <nova:user uuid="155c948b95c64c9083da984cdf6af494">tempest-ServerRescueNegativeTestJSON-383982506-project-member</nova:user>
Oct 25 21:36:00 user nova-compute[74189]:         <nova:project uuid="3df03fc18fc3467db76e336c6de78c92">tempest-ServerRescueNegativeTestJSON-383982506</nova:project>
Oct 25 21:36:00 user nova-compute[74189]:       </nova:owner>
Oct 25 21:36:00 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:36:00 user nova-compute[74189]:       <nova:ports>
Oct 25 21:36:00 user nova-compute[74189]:         <nova:port uuid="67d0e911-b6fd-44a7-ad9c-8b204562a0bf">
Oct 25 21:36:00 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 25 21:36:00 user nova-compute[74189]:         </nova:port>
Oct 25 21:36:00 user nova-compute[74189]:       </nova:ports>
Oct 25 21:36:00 user nova-compute[74189]:     </nova:instance>
Oct 25 21:36:00 user nova-compute[74189]:   </metadata>
Oct 25 21:36:00 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:36:00 user nova-compute[74189]:     <system>
Oct 25 21:36:00 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:36:00 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:36:00 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:36:00 user nova-compute[74189]:       <entry name="serial">3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef</entry>
Oct 25 21:36:00 user nova-compute[74189]:       <entry name="uuid">3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef</entry>
Oct 25 21:36:00 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:36:00 user nova-compute[74189]:     </system>
Oct 25 21:36:00 user nova-compute[74189]:   </sysinfo>
Oct 25 21:36:00 user nova-compute[74189]:   <os>
Oct 25 21:36:00 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:36:00 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:36:00 user nova-compute[74189]:   </os>
Oct 25 21:36:00 user nova-compute[74189]:   <features>
Oct 25 21:36:00 user nova-compute[74189]:     <acpi/>
Oct 25 21:36:00 user nova-compute[74189]:     <apic/>
Oct 25 21:36:00 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:36:00 user nova-compute[74189]:   </features>
Oct 25 21:36:00 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:36:00 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:36:00 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:36:00 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:36:00 user nova-compute[74189]:   </clock>
Oct 25 21:36:00 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:36:00 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:36:00 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:36:00 user nova-compute[74189]:   </cpu>
Oct 25 21:36:00 user nova-compute[74189]:   <devices>
Oct 25 21:36:00 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:36:00 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:36:00 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk.rescue"/>
Oct 25 21:36:00 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:36:00 user nova-compute[74189]:     </disk>
Oct 25 21:36:00 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:36:00 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:36:00 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk"/>
Oct 25 21:36:00 user nova-compute[74189]:       <target dev="vdb" bus="virtio"/>
Oct 25 21:36:00 user nova-compute[74189]:     </disk>
Oct 25 21:36:00 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:36:00 user nova-compute[74189]:       <mac address="fa:16:3e:5d:2c:57"/>
Oct 25 21:36:00 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:36:00 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:36:00 user nova-compute[74189]:       <target dev="tap67d0e911-b6"/>
Oct 25 21:36:00 user nova-compute[74189]:     </interface>
Oct 25 21:36:00 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:36:00 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/console.log" append="off"/>
Oct 25 21:36:00 user nova-compute[74189]:     </serial>
Oct 25 21:36:00 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:36:00 user nova-compute[74189]:     <video>
Oct 25 21:36:00 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:36:00 user nova-compute[74189]:     </video>
Oct 25 21:36:00 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:36:00 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:36:00 user nova-compute[74189]:     </rng>
Oct 25 21:36:00 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:36:00 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:36:00 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:36:00 user nova-compute[74189]:     </memballoon>
Oct 25 21:36:00 user nova-compute[74189]:   </devices>
Oct 25 21:36:00 user nova-compute[74189]: </domain>
Oct 25 21:36:00 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:36:00 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Instance destroyed successfully.
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:36:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] No VIF found with MAC fa:16:3e:5d:2c:57, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:36:01 user nova-compute[74189]: DEBUG nova.compute.manager [req-dbab433f-b34b-41d1-b9eb-499af10e4c83 req-d419c006-d7fe-46cc-a4d6-d633ea02d75c service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Received event network-vif-plugged-83f7d737-3cbc-4a68-8f5f-da99acae2d42 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:36:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-dbab433f-b34b-41d1-b9eb-499af10e4c83 req-d419c006-d7fe-46cc-a4d6-d633ea02d75c service nova] Acquiring lock "8f61139d-d075-41d7-bd04-cc977ec87578-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:36:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-dbab433f-b34b-41d1-b9eb-499af10e4c83 req-d419c006-d7fe-46cc-a4d6-d633ea02d75c service nova] Lock "8f61139d-d075-41d7-bd04-cc977ec87578-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:36:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-dbab433f-b34b-41d1-b9eb-499af10e4c83 req-d419c006-d7fe-46cc-a4d6-d633ea02d75c service nova] Lock "8f61139d-d075-41d7-bd04-cc977ec87578-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:36:01 user nova-compute[74189]: DEBUG nova.compute.manager [req-dbab433f-b34b-41d1-b9eb-499af10e4c83 req-d419c006-d7fe-46cc-a4d6-d633ea02d75c service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] No waiting events found dispatching network-vif-plugged-83f7d737-3cbc-4a68-8f5f-da99acae2d42 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:36:01 user nova-compute[74189]: WARNING nova.compute.manager [req-dbab433f-b34b-41d1-b9eb-499af10e4c83 req-d419c006-d7fe-46cc-a4d6-d633ea02d75c service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Received unexpected event network-vif-plugged-83f7d737-3cbc-4a68-8f5f-da99acae2d42 for instance with vm_state active and task_state reboot_started.
Oct 25 21:36:01 user nova-compute[74189]: DEBUG nova.compute.manager [req-dbab433f-b34b-41d1-b9eb-499af10e4c83 req-d419c006-d7fe-46cc-a4d6-d633ea02d75c service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Received event network-vif-plugged-83f7d737-3cbc-4a68-8f5f-da99acae2d42 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:36:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-dbab433f-b34b-41d1-b9eb-499af10e4c83 req-d419c006-d7fe-46cc-a4d6-d633ea02d75c service nova] Acquiring lock "8f61139d-d075-41d7-bd04-cc977ec87578-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:36:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-dbab433f-b34b-41d1-b9eb-499af10e4c83 req-d419c006-d7fe-46cc-a4d6-d633ea02d75c service nova] Lock "8f61139d-d075-41d7-bd04-cc977ec87578-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:36:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-dbab433f-b34b-41d1-b9eb-499af10e4c83 req-d419c006-d7fe-46cc-a4d6-d633ea02d75c service nova] Lock "8f61139d-d075-41d7-bd04-cc977ec87578-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:36:01 user nova-compute[74189]: DEBUG nova.compute.manager [req-dbab433f-b34b-41d1-b9eb-499af10e4c83 req-d419c006-d7fe-46cc-a4d6-d633ea02d75c service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] No waiting events found dispatching network-vif-plugged-83f7d737-3cbc-4a68-8f5f-da99acae2d42 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:36:01 user nova-compute[74189]: WARNING nova.compute.manager [req-dbab433f-b34b-41d1-b9eb-499af10e4c83 req-d419c006-d7fe-46cc-a4d6-d633ea02d75c service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Received unexpected event network-vif-plugged-83f7d737-3cbc-4a68-8f5f-da99acae2d42 for instance with vm_state active and task_state reboot_started.
Oct 25 21:36:01 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Instance running successfully.
Oct 25 21:36:01 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-68a3b604-c858-4f04-abe0-2754e9ce70ad tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Instance soft rebooted successfully.
Oct 25 21:36:01 user nova-compute[74189]: DEBUG nova.compute.manager [None req-68a3b604-c858-4f04-abe0-2754e9ce70ad tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:36:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-68a3b604-c858-4f04-abe0-2754e9ce70ad tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "8f61139d-d075-41d7-bd04-cc977ec87578" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.644s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:36:01 user nova-compute[74189]: DEBUG nova.compute.manager [req-4433c1b7-65bb-4f8f-b9f2-a784ca0bf7d0 req-f5697c47-bb64-403f-b877-57876af9ac90 service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Received event network-vif-plugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:36:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4433c1b7-65bb-4f8f-b9f2-a784ca0bf7d0 req-f5697c47-bb64-403f-b877-57876af9ac90 service nova] Acquiring lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:36:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4433c1b7-65bb-4f8f-b9f2-a784ca0bf7d0 req-f5697c47-bb64-403f-b877-57876af9ac90 service nova] Lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:36:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4433c1b7-65bb-4f8f-b9f2-a784ca0bf7d0 req-f5697c47-bb64-403f-b877-57876af9ac90 service nova] Lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:36:01 user nova-compute[74189]: DEBUG nova.compute.manager [req-4433c1b7-65bb-4f8f-b9f2-a784ca0bf7d0 req-f5697c47-bb64-403f-b877-57876af9ac90 service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] No waiting events found dispatching network-vif-plugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:36:01 user nova-compute[74189]: WARNING nova.compute.manager [req-4433c1b7-65bb-4f8f-b9f2-a784ca0bf7d0 req-f5697c47-bb64-403f-b877-57876af9ac90 service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Received unexpected event network-vif-plugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf for instance with vm_state active and task_state rescuing.
Oct 25 21:36:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Starting finish_migration {{(pid=74189) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Instance directory exists: not creating {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 21:36:03 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Creating image(s)
Oct 25 21:36:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Did not create local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Ensure instance console log exists: /opt/stack/data/nova/instances/1926c2ce-9643-4d00-9f54-a6747e71875b/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Start _get_guest_xml network_info=[{"id": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "address": "fa:16:3e:6e:2f:0e", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-94415228-network", "vif_mac": "fa:16:3e:6e:2f:0e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d26f4c0-28", "ovs_interfaceid": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsJSLGjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '1926c2ce-9643-4d00-9f54-a6747e71875b', 'attached_at': '2023-10-25T21:36:03.000000', 'detached_at': '', 'volume_id': '4eb01afd-1b09-48a3-ab75-9326700c7e98', 'serial': '4eb01afd-1b09-48a3-ab75-9326700c7e98'}, 'attachment_id': '79aa7696-2e08-4300-81a6-58ee705d4d47', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:36:03 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:36:03 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:36:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsJSLGjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:36:03 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:36:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:36:03 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:36:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:36:03 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c90f7c5-f279-4e46-a860-1ba34b79de86]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:36:03 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bff605-096a-4743-80dd-7f192dd2ff03]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98] added
Oct 25 21:36:03 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb81f8b6-80ac-4207-a4b8-ef4ac7d12556]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[228e8dcb-43e9-4c44-aa97-e22150c607a0]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EsJSLGjP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EsJSLGjP" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[395de250-08db-4969-b530-1d7ccf6059d8]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EsJSLGjP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9587a276-5561-4940-b033-3287bc1163a0]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccb4197-46fb-46ab-89a7-ba52630ad32a]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c (non-flash)
Oct 25 21:36:03 user nova-compute[74189]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c (non-flash)
Oct 25 21:36:03 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c (non-flash)
Oct 25 21:36:03 user nova-compute[74189]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c (non-flash)
Oct 25 21:36:03 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-a506e7a1-af57-4442-a07b-aa90858f2f5d req-367d595a-3ed1-4fe3-a64b-2b25c6e97bcd service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Received event network-vif-plugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a506e7a1-af57-4442-a07b-aa90858f2f5d req-367d595a-3ed1-4fe3-a64b-2b25c6e97bcd service nova] Acquiring lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a506e7a1-af57-4442-a07b-aa90858f2f5d req-367d595a-3ed1-4fe3-a64b-2b25c6e97bcd service nova] Lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a506e7a1-af57-4442-a07b-aa90858f2f5d req-367d595a-3ed1-4fe3-a64b-2b25c6e97bcd service nova] Lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-a506e7a1-af57-4442-a07b-aa90858f2f5d req-367d595a-3ed1-4fe3-a64b-2b25c6e97bcd service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] No waiting events found dispatching network-vif-plugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:36:03 user nova-compute[74189]: WARNING nova.compute.manager [req-a506e7a1-af57-4442-a07b-aa90858f2f5d req-367d595a-3ed1-4fe3-a64b-2b25c6e97bcd service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Received unexpected event network-vif-plugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf for instance with vm_state active and task_state rescuing.
Oct 25 21:36:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-a506e7a1-af57-4442-a07b-aa90858f2f5d req-367d595a-3ed1-4fe3-a64b-2b25c6e97bcd service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Received event network-vif-plugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a506e7a1-af57-4442-a07b-aa90858f2f5d req-367d595a-3ed1-4fe3-a64b-2b25c6e97bcd service nova] Acquiring lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a506e7a1-af57-4442-a07b-aa90858f2f5d req-367d595a-3ed1-4fe3-a64b-2b25c6e97bcd service nova] Lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a506e7a1-af57-4442-a07b-aa90858f2f5d req-367d595a-3ed1-4fe3-a64b-2b25c6e97bcd service nova] Lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG nova.compute.manager [req-a506e7a1-af57-4442-a07b-aa90858f2f5d req-367d595a-3ed1-4fe3-a64b-2b25c6e97bcd service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] No waiting events found dispatching network-vif-plugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:36:03 user nova-compute[74189]: WARNING nova.compute.manager [req-a506e7a1-af57-4442-a07b-aa90858f2f5d req-367d595a-3ed1-4fe3-a64b-2b25c6e97bcd service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Received unexpected event network-vif-plugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf for instance with vm_state active and task_state rescuing.
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c850db7d-925b-44b0-8807-19641211b3e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98, portal: 172.16.0.220,3260]
Oct 25 21:36:03 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98, portal: 172.16.0.220,3260] successful.
Oct 25 21:36:03 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee53474-75bb-4efc-9c4a-69f86756f408]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9497dfe-5e1a-4c78-bdd0-8ca387198d9a]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c (non-flash)
Oct 25 21:36:03 user nova-compute[74189]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c (non-flash)
Oct 25 21:36:03 user nova-compute[74189]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:36:03 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c (non-flash)
Oct 25 21:36:03 user nova-compute[74189]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c (non-flash)
Oct 25 21:36:03 user nova-compute[74189]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:36:03 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[800f29f8-dc21-46b0-abda-6c5d475b5e2e]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: None {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:36:03 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 0da9f3bb-fbf4-4f9a-929f-0d223101b29e is timed out.
Oct 25 21:36:03 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Successfully detached device vdc from instance 0da9f3bb-fbf4-4f9a-929f-0d223101b29e from the live domain config.
Oct 25 21:36:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:36:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZyvlrfRo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:36:03 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:36:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG nova.compute.manager [None req-e674c6bf-bd61-409a-84a9-86e4ad59a037 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsJSLGjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26161313362333438', 'path': '/dev/sdd'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161313362333438', 'path': '/dev/sdd'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.819s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:33:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1901274081',display_name='tempest-ServerActionsTestOtherA-server-1901274081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1901274081',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2S7seSL6H542o42+kjhdFVCcVB3vmP0zFQehKH4IjkXrBgeXgKPGixJeOzeDKKnbCU86Dz8L3oU7gAYCj2cW/f6u+7OuTUBmRTwo8tpApDh9NwCKVzKxF9Lu0jaZZAvw==',key_name='tempest-keypair-2141227250',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:34:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4815aedea48841188ed8797a0eb51925',ramdisk_id='',reservation_id='r-984gu0e6',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1355855048',owner_user_name='tempest-ServerActionsTestOtherA-1355855048-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:35:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b34817b1868f40a38a32a51d0e970d51',uuid=1926c2ce-9643-4d00-9f54-a6747e71875b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "address": "fa:16:3e:6e:2f:0e", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-94415228-network", "vif_mac": "fa:16:3e:6e:2f:0e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d26f4c0-28", "ovs_interfaceid": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Converting VIF {"id": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "address": "fa:16:3e:6e:2f:0e", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-94415228-network", "vif_mac": "fa:16:3e:6e:2f:0e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d26f4c0-28", "ovs_interfaceid": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2f:0e,bridge_name='br-int',has_traffic_filtering=True,id=5d26f4c0-286d-4528-95fc-2d881f739fd2,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d26f4c0-28') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:36:04 user nova-compute[74189]:   <uuid>1926c2ce-9643-4d00-9f54-a6747e71875b</uuid>
Oct 25 21:36:04 user nova-compute[74189]:   <name>instance-00000027</name>
Oct 25 21:36:04 user nova-compute[74189]:   <memory>2097152</memory>
Oct 25 21:36:04 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:36:04 user nova-compute[74189]:   <metadata>
Oct 25 21:36:04 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:36:04 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:36:04 user nova-compute[74189]:       <nova:name>tempest-ServerActionsTestOtherA-server-1901274081</nova:name>
Oct 25 21:36:04 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:36:03</nova:creationTime>
Oct 25 21:36:04 user nova-compute[74189]:       <nova:flavor name="m1.small">
Oct 25 21:36:04 user nova-compute[74189]:         <nova:memory>2048</nova:memory>
Oct 25 21:36:04 user nova-compute[74189]:         <nova:disk>20</nova:disk>
Oct 25 21:36:04 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:36:04 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:36:04 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:36:04 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:36:04 user nova-compute[74189]:       <nova:owner>
Oct 25 21:36:04 user nova-compute[74189]:         <nova:user uuid="b34817b1868f40a38a32a51d0e970d51">tempest-ServerActionsTestOtherA-1355855048-project-member</nova:user>
Oct 25 21:36:04 user nova-compute[74189]:         <nova:project uuid="4815aedea48841188ed8797a0eb51925">tempest-ServerActionsTestOtherA-1355855048</nova:project>
Oct 25 21:36:04 user nova-compute[74189]:       </nova:owner>
Oct 25 21:36:04 user nova-compute[74189]:       <nova:ports>
Oct 25 21:36:04 user nova-compute[74189]:         <nova:port uuid="5d26f4c0-286d-4528-95fc-2d881f739fd2">
Oct 25 21:36:04 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 25 21:36:04 user nova-compute[74189]:         </nova:port>
Oct 25 21:36:04 user nova-compute[74189]:       </nova:ports>
Oct 25 21:36:04 user nova-compute[74189]:     </nova:instance>
Oct 25 21:36:04 user nova-compute[74189]:   </metadata>
Oct 25 21:36:04 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:36:04 user nova-compute[74189]:     <system>
Oct 25 21:36:04 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:36:04 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:36:04 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:36:04 user nova-compute[74189]:       <entry name="serial">1926c2ce-9643-4d00-9f54-a6747e71875b</entry>
Oct 25 21:36:04 user nova-compute[74189]:       <entry name="uuid">1926c2ce-9643-4d00-9f54-a6747e71875b</entry>
Oct 25 21:36:04 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:36:04 user nova-compute[74189]:     </system>
Oct 25 21:36:04 user nova-compute[74189]:   </sysinfo>
Oct 25 21:36:04 user nova-compute[74189]:   <os>
Oct 25 21:36:04 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:36:04 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:36:04 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:36:04 user nova-compute[74189]:   </os>
Oct 25 21:36:04 user nova-compute[74189]:   <features>
Oct 25 21:36:04 user nova-compute[74189]:     <acpi/>
Oct 25 21:36:04 user nova-compute[74189]:     <apic/>
Oct 25 21:36:04 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:36:04 user nova-compute[74189]:   </features>
Oct 25 21:36:04 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:36:04 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:36:04 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:36:04 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:36:04 user nova-compute[74189]:   </clock>
Oct 25 21:36:04 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:36:04 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:36:04 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:36:04 user nova-compute[74189]:   </cpu>
Oct 25 21:36:04 user nova-compute[74189]:   <devices>
Oct 25 21:36:04 user nova-compute[74189]:     <disk type="block" device="disk">
Oct 25 21:36:04 user nova-compute[74189]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:36:04 user nova-compute[74189]:       <source dev="/dev/sdd"/>
Oct 25 21:36:04 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:36:04 user nova-compute[74189]:       <serial>4eb01afd-1b09-48a3-ab75-9326700c7e98</serial>
Oct 25 21:36:04 user nova-compute[74189]:     </disk>
Oct 25 21:36:04 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:36:04 user nova-compute[74189]:       <mac address="fa:16:3e:6e:2f:0e"/>
Oct 25 21:36:04 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:36:04 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:36:04 user nova-compute[74189]:       <target dev="tap5d26f4c0-28"/>
Oct 25 21:36:04 user nova-compute[74189]:     </interface>
Oct 25 21:36:04 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:36:04 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/1926c2ce-9643-4d00-9f54-a6747e71875b/console.log" append="off"/>
Oct 25 21:36:04 user nova-compute[74189]:     </serial>
Oct 25 21:36:04 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:36:04 user nova-compute[74189]:     <video>
Oct 25 21:36:04 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:36:04 user nova-compute[74189]:     </video>
Oct 25 21:36:04 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:36:04 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:36:04 user nova-compute[74189]:     </rng>
Oct 25 21:36:04 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:36:04 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:36:04 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:36:04 user nova-compute[74189]:     </memballoon>
Oct 25 21:36:04 user nova-compute[74189]:   </devices>
Oct 25 21:36:04 user nova-compute[74189]: </domain>
Oct 25 21:36:04 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:33:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1901274081',display_name='tempest-ServerActionsTestOtherA-server-1901274081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1901274081',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2S7seSL6H542o42+kjhdFVCcVB3vmP0zFQehKH4IjkXrBgeXgKPGixJeOzeDKKnbCU86Dz8L3oU7gAYCj2cW/f6u+7OuTUBmRTwo8tpApDh9NwCKVzKxF9Lu0jaZZAvw==',key_name='tempest-keypair-2141227250',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:34:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4815aedea48841188ed8797a0eb51925',ramdisk_id='',reservation_id='r-984gu0e6',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1355855048',owner_user_name='tempest-ServerActionsTestOtherA-1355855048-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:35:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b34817b1868f40a38a32a51d0e970d51',uuid=1926c2ce-9643-4d00-9f54-a6747e71875b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "address": "fa:16:3e:6e:2f:0e", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-94415228-network", "vif_mac": "fa:16:3e:6e:2f:0e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d26f4c0-28", "ovs_interfaceid": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Converting VIF {"id": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "address": "fa:16:3e:6e:2f:0e", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-94415228-network", "vif_mac": "fa:16:3e:6e:2f:0e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d26f4c0-28", "ovs_interfaceid": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2f:0e,bridge_name='br-int',has_traffic_filtering=True,id=5d26f4c0-286d-4528-95fc-2d881f739fd2,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d26f4c0-28') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG os_vif [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2f:0e,bridge_name='br-int',has_traffic_filtering=True,id=5d26f4c0-286d-4528-95fc-2d881f739fd2,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d26f4c0-28') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28723ec-9d7b-4578-bb83-f33b209bc604]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:36:04 user nova-compute[74189]: No targets found.
Oct 25 21:36:04 user nova-compute[74189]: iSNS:
Oct 25 21:36:04 user nova-compute[74189]: No targets found.
Oct 25 21:36:04 user nova-compute[74189]: STATIC:
Oct 25 21:36:04 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c
Oct 25 21:36:04 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:36:04 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:36:04 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c
Oct 25 21:36:04 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:36:04 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:36:04 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98
Oct 25 21:36:04 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:36:04 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:36:04 user nova-compute[74189]: FIRMWARE:
Oct 25 21:36:04 user nova-compute[74189]: No targets found.
Oct 25 21:36:04 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:36:04 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:36:04 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79c5c800-1d61-5e21-8235-498969c5f04d', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d26f4c0-28, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5d26f4c0-28, col_values=(('qos', UUID('38ec57c4-706c-44b4-a648-5b19e29e2971')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5d26f4c0-28, col_values=(('external_ids', {'iface-id': '5d26f4c0-286d-4528-95fc-2d881f739fd2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:2f:0e', 'vm-uuid': '1926c2ce-9643-4d00-9f54-a6747e71875b'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c9c88f-d2f7-40ff-9065-4f9dbd9566cc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:04 user nova-compute[74189]: INFO os_vif [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2f:0e,bridge_name='br-int',has_traffic_filtering=True,id=5d26f4c0-286d-4528-95fc-2d881f739fd2,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d26f4c0-28')
Oct 25 21:36:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5274dae2-d2a2-4864-99c1-0485d6bbead7]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c (non-flash)
Oct 25 21:36:04 user nova-compute[74189]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c (non-flash)
Oct 25 21:36:04 user nova-compute[74189]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:36:04 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c (non-flash)
Oct 25 21:36:04 user nova-compute[74189]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c (non-flash)
Oct 25 21:36:04 user nova-compute[74189]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:36:04 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe304269ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c'): ({'sdc'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Removing single pathed devices sdc {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95c524d-f795-4e6f-9835-347ebb8754cb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] No VIF found with MAC fa:16:3e:6e:2f:0e, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[039c8365-77f4-482b-bace-837b954df11f]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Flushing IO for device /dev/sdc {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5f77fc-74d7-47af-94fe-ae65b77f3e54]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:36:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:05 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ce96d9-5dc4-4aad-944c-515a2de66004]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:36:05 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:36:05 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] SCSI volumes sdc have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:36:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:36:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:05 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2008e11d-0532-4960-bdbb-7188c519b0ed]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:36:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:36:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:05 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe306af-0ffd-4606-a889-1f7d4e0e4e74]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:36:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c, portal: 172.16.0.220,3260]
Oct 25 21:36:05 user nova-compute[74189]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c, portal: 172.16.0.220,3260] successful.
Oct 25 21:36:05 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:36:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:725b43dd-27d6-40b6-9bf8-7449eb55698c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:05 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9a2cde-e95b-453b-b43a-254c7ed5037f]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:36:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:36:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:36:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] <== disconnect_volume: return (1217ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:36:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:36:06 user nova-compute[74189]: DEBUG nova.objects.instance [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lazy-loading 'flavor' on Instance uuid 0da9f3bb-fbf4-4f9a-929f-0d223101b29e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:36:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9e5e97bb-9624-483c-868d-f1d916f500e6 tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.861s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:36:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:06 user nova-compute[74189]: DEBUG nova.compute.manager [req-7414cde8-1a14-4a2e-9670-10ce74369a48 req-d6e2b454-3a1d-40f0-949b-8a6d557359c8 service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Received event network-vif-plugged-5d26f4c0-286d-4528-95fc-2d881f739fd2 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:36:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7414cde8-1a14-4a2e-9670-10ce74369a48 req-d6e2b454-3a1d-40f0-949b-8a6d557359c8 service nova] Acquiring lock "1926c2ce-9643-4d00-9f54-a6747e71875b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:36:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7414cde8-1a14-4a2e-9670-10ce74369a48 req-d6e2b454-3a1d-40f0-949b-8a6d557359c8 service nova] Lock "1926c2ce-9643-4d00-9f54-a6747e71875b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:36:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7414cde8-1a14-4a2e-9670-10ce74369a48 req-d6e2b454-3a1d-40f0-949b-8a6d557359c8 service nova] Lock "1926c2ce-9643-4d00-9f54-a6747e71875b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:36:06 user nova-compute[74189]: DEBUG nova.compute.manager [req-7414cde8-1a14-4a2e-9670-10ce74369a48 req-d6e2b454-3a1d-40f0-949b-8a6d557359c8 service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] No waiting events found dispatching network-vif-plugged-5d26f4c0-286d-4528-95fc-2d881f739fd2 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:36:06 user nova-compute[74189]: WARNING nova.compute.manager [req-7414cde8-1a14-4a2e-9670-10ce74369a48 req-d6e2b454-3a1d-40f0-949b-8a6d557359c8 service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Received unexpected event network-vif-plugged-5d26f4c0-286d-4528-95fc-2d881f739fd2 for instance with vm_state active and task_state resize_finish.
Oct 25 21:36:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-48e956d8-d4d0-4ec8-bea4-32834d54dcab tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:36:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-48e956d8-d4d0-4ec8-bea4-32834d54dcab tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:36:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-48e956d8-d4d0-4ec8-bea4-32834d54dcab tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:36:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-48e956d8-d4d0-4ec8-bea4-32834d54dcab tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:36:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-48e956d8-d4d0-4ec8-bea4-32834d54dcab tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:36:07 user nova-compute[74189]: INFO nova.compute.manager [None req-48e956d8-d4d0-4ec8-bea4-32834d54dcab tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Terminating instance
Oct 25 21:36:07 user nova-compute[74189]: DEBUG nova.compute.manager [None req-48e956d8-d4d0-4ec8-bea4-32834d54dcab tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:36:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:08 user nova-compute[74189]: DEBUG nova.compute.manager [req-80c64abf-edca-4eb1-bc49-c0ebe968e3df req-a83f65e5-5d8a-4142-bb24-9a2b79dabc7f service nova] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Received event network-vif-unplugged-51ff1ff4-83d4-4393-81e2-750670c4af18 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:36:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-80c64abf-edca-4eb1-bc49-c0ebe968e3df req-a83f65e5-5d8a-4142-bb24-9a2b79dabc7f service nova] Acquiring lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:36:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-80c64abf-edca-4eb1-bc49-c0ebe968e3df req-a83f65e5-5d8a-4142-bb24-9a2b79dabc7f service nova] Lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:36:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-80c64abf-edca-4eb1-bc49-c0ebe968e3df req-a83f65e5-5d8a-4142-bb24-9a2b79dabc7f service nova] Lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:36:08 user nova-compute[74189]: DEBUG nova.compute.manager [req-80c64abf-edca-4eb1-bc49-c0ebe968e3df req-a83f65e5-5d8a-4142-bb24-9a2b79dabc7f service nova] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] No waiting events found dispatching network-vif-unplugged-51ff1ff4-83d4-4393-81e2-750670c4af18 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:36:08 user nova-compute[74189]: DEBUG nova.compute.manager [req-80c64abf-edca-4eb1-bc49-c0ebe968e3df req-a83f65e5-5d8a-4142-bb24-9a2b79dabc7f service nova] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Received event network-vif-unplugged-51ff1ff4-83d4-4393-81e2-750670c4af18 for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:36:08 user nova-compute[74189]: DEBUG nova.compute.manager [req-b806e472-1633-4a7c-bbfb-78759462de18 req-ed4d1f31-288c-4e10-807f-362817b9c79e service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Received event network-vif-plugged-5d26f4c0-286d-4528-95fc-2d881f739fd2 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:36:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b806e472-1633-4a7c-bbfb-78759462de18 req-ed4d1f31-288c-4e10-807f-362817b9c79e service nova] Acquiring lock "1926c2ce-9643-4d00-9f54-a6747e71875b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:36:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b806e472-1633-4a7c-bbfb-78759462de18 req-ed4d1f31-288c-4e10-807f-362817b9c79e service nova] Lock "1926c2ce-9643-4d00-9f54-a6747e71875b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:36:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b806e472-1633-4a7c-bbfb-78759462de18 req-ed4d1f31-288c-4e10-807f-362817b9c79e service nova] Lock "1926c2ce-9643-4d00-9f54-a6747e71875b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:36:08 user nova-compute[74189]: DEBUG nova.compute.manager [req-b806e472-1633-4a7c-bbfb-78759462de18 req-ed4d1f31-288c-4e10-807f-362817b9c79e service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] No waiting events found dispatching network-vif-plugged-5d26f4c0-286d-4528-95fc-2d881f739fd2 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:36:08 user nova-compute[74189]: WARNING nova.compute.manager [req-b806e472-1633-4a7c-bbfb-78759462de18 req-ed4d1f31-288c-4e10-807f-362817b9c79e service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Received unexpected event network-vif-plugged-5d26f4c0-286d-4528-95fc-2d881f739fd2 for instance with vm_state active and task_state resize_finish.
Oct 25 21:36:08 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Instance destroyed successfully.
Oct 25 21:36:08 user nova-compute[74189]: DEBUG nova.objects.instance [None req-48e956d8-d4d0-4ec8-bea4-32834d54dcab tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lazy-loading 'resources' on Instance uuid 0da9f3bb-fbf4-4f9a-929f-0d223101b29e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:36:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-48e956d8-d4d0-4ec8-bea4-32834d54dcab tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:32:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1238988633',display_name='tempest-AttachVolumeTestJSON-server-1238988633',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1238988633',id=35,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvvThZVIBq0Qv91G5mDXh1sOqIjUqxTIaJWbDtFw/xZTDwb8rtrc8He+Vjks+8c64acBJo7uGay0WgpMIAXhaQcEPLqIn9lTRwM4MXkHxLMtD081o+/22xwOohMZAFX+Q==',key_name='tempest-keypair-1327357363',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:32:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1d0f1deb7f04244920dae579032b287',ramdisk_id='',reservation_id='r-23eib0r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1213560671',owner_user_name='tempest-AttachVolumeTestJSON-1213560671-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:32:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e55da2b7458469e844fad1fe95cb695',uuid=0da9f3bb-fbf4-4f9a-929f-0d223101b29e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51ff1ff4-83d4-4393-81e2-750670c4af18", "address": "fa:16:3e:1b:34:34", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ff1ff4-83", "ovs_interfaceid": "51ff1ff4-83d4-4393-81e2-750670c4af18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:36:08 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-48e956d8-d4d0-4ec8-bea4-32834d54dcab tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Converting VIF {"id": "51ff1ff4-83d4-4393-81e2-750670c4af18", "address": "fa:16:3e:1b:34:34", "network": {"id": "1d219ea7-a949-4c77-9cd1-79cc99d6ac42", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1062465944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1d0f1deb7f04244920dae579032b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ff1ff4-83", "ovs_interfaceid": "51ff1ff4-83d4-4393-81e2-750670c4af18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:36:08 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-48e956d8-d4d0-4ec8-bea4-32834d54dcab tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:34:34,bridge_name='br-int',has_traffic_filtering=True,id=51ff1ff4-83d4-4393-81e2-750670c4af18,network=Network(1d219ea7-a949-4c77-9cd1-79cc99d6ac42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ff1ff4-83') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:36:08 user nova-compute[74189]: DEBUG os_vif [None req-48e956d8-d4d0-4ec8-bea4-32834d54dcab tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:34:34,bridge_name='br-int',has_traffic_filtering=True,id=51ff1ff4-83d4-4393-81e2-750670c4af18,network=Network(1d219ea7-a949-4c77-9cd1-79cc99d6ac42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ff1ff4-83') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:36:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51ff1ff4-83, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:36:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:36:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4800c11-f53e-4556-827f-50edcdff2c2a) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:36:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:08 user nova-compute[74189]: INFO os_vif [None req-48e956d8-d4d0-4ec8-bea4-32834d54dcab tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:34:34,bridge_name='br-int',has_traffic_filtering=True,id=51ff1ff4-83d4-4393-81e2-750670c4af18,network=Network(1d219ea7-a949-4c77-9cd1-79cc99d6ac42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ff1ff4-83')
Oct 25 21:36:08 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-48e956d8-d4d0-4ec8-bea4-32834d54dcab tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Deleting instance files /opt/stack/data/nova/instances/0da9f3bb-fbf4-4f9a-929f-0d223101b29e_del
Oct 25 21:36:08 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-48e956d8-d4d0-4ec8-bea4-32834d54dcab tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Deletion of /opt/stack/data/nova/instances/0da9f3bb-fbf4-4f9a-929f-0d223101b29e_del complete
Oct 25 21:36:08 user nova-compute[74189]: INFO nova.compute.manager [None req-48e956d8-d4d0-4ec8-bea4-32834d54dcab tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Took 0.99 seconds to destroy the instance on the hypervisor.
Oct 25 21:36:08 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-48e956d8-d4d0-4ec8-bea4-32834d54dcab tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:36:08 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:36:08 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:36:08 user nova-compute[74189]: DEBUG nova.compute.manager [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:36:08 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Instance running successfully.
Oct 25 21:36:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Failed to set time: agent not configured {{(pid=74189) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 25 21:36:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-122202b2-8f41-4ae8-b0d4-a93e05ee22d2 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] finish_migration finished successfully. {{(pid=74189) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 25 21:36:09 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:10 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:36:10 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Took 1.33 seconds to deallocate network for instance.
Oct 25 21:36:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-48e956d8-d4d0-4ec8-bea4-32834d54dcab tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:36:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-48e956d8-d4d0-4ec8-bea4-32834d54dcab tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:36:10 user nova-compute[74189]: DEBUG nova.compute.manager [req-1afedf8c-f88c-4e34-b906-113c129e96c9 req-16ae5eca-c3cc-4709-b8c7-d29ada746f22 service nova] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Received event network-vif-plugged-51ff1ff4-83d4-4393-81e2-750670c4af18 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:36:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1afedf8c-f88c-4e34-b906-113c129e96c9 req-16ae5eca-c3cc-4709-b8c7-d29ada746f22 service nova] Acquiring lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:36:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1afedf8c-f88c-4e34-b906-113c129e96c9 req-16ae5eca-c3cc-4709-b8c7-d29ada746f22 service nova] Lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:36:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1afedf8c-f88c-4e34-b906-113c129e96c9 req-16ae5eca-c3cc-4709-b8c7-d29ada746f22 service nova] Lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:36:10 user nova-compute[74189]: DEBUG nova.compute.manager [req-1afedf8c-f88c-4e34-b906-113c129e96c9 req-16ae5eca-c3cc-4709-b8c7-d29ada746f22 service nova] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] No waiting events found dispatching network-vif-plugged-51ff1ff4-83d4-4393-81e2-750670c4af18 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:36:10 user nova-compute[74189]: WARNING nova.compute.manager [req-1afedf8c-f88c-4e34-b906-113c129e96c9 req-16ae5eca-c3cc-4709-b8c7-d29ada746f22 service nova] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Received unexpected event network-vif-plugged-51ff1ff4-83d4-4393-81e2-750670c4af18 for instance with vm_state deleted and task_state None.
Oct 25 21:36:10 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-48e956d8-d4d0-4ec8-bea4-32834d54dcab tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:36:10 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-48e956d8-d4d0-4ec8-bea4-32834d54dcab tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:36:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-48e956d8-d4d0-4ec8-bea4-32834d54dcab tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.451s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:36:10 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-48e956d8-d4d0-4ec8-bea4-32834d54dcab tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Deleted allocations for instance 0da9f3bb-fbf4-4f9a-929f-0d223101b29e
Oct 25 21:36:10 user nova-compute[74189]: DEBUG nova.compute.manager [req-cd980cd0-269f-4477-b473-5ee126d322f8 req-dc1609db-9969-4cc9-84d0-4221b9cea58a service nova] [instance: 0da9f3bb-fbf4-4f9a-929f-0d223101b29e] Received event network-vif-deleted-51ff1ff4-83d4-4393-81e2-750670c4af18 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:36:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-48e956d8-d4d0-4ec8-bea4-32834d54dcab tempest-AttachVolumeTestJSON-1213560671 tempest-AttachVolumeTestJSON-1213560671-project-member] Lock "0da9f3bb-fbf4-4f9a-929f-0d223101b29e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.999s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:36:11 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:36:11 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:36:11 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-932fe8ac-fdde-45c6-aa32-9bf866f19a4e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:36:11 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-932fe8ac-fdde-45c6-aa32-9bf866f19a4e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:36:11 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:36:12 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Updating instance_info_cache with network_info: [{"id": "8eb6e9e2-60c6-463d-8525-b768933a94df", "address": "fa:16:3e:e8:de:d0", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb6e9e2-60", "ovs_interfaceid": "8eb6e9e2-60c6-463d-8525-b768933a94df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:36:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-932fe8ac-fdde-45c6-aa32-9bf866f19a4e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:36:12 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:36:12 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:36:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:13 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:36:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:36:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:36:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:36:13 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:36:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:14 user nova-compute[74189]: DEBUG nova.compute.manager [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:36:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:36:14 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Creating image(s)
Oct 25 21:36:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Did not create local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 21:36:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Ensure instance console log exists: /opt/stack/data/nova/instances/dcb582a2-5198-44aa-bbe8-48978975e9eb/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:36:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:36:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:36:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:36:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Start _get_guest_xml network_info=[{"id": "0b83b195-15ba-461f-87f1-465a6a1066ce", "address": "fa:16:3e:34:0f:94", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b83b195-15", "ovs_interfaceid": "0b83b195-15ba-461f-87f1-465a6a1066ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oXdtAbSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dcb582a2-5198-44aa-bbe8-48978975e9eb', 'attached_at': '', 'detached_at': '', 'volume_id': '8c22cfde-db3c-4c83-994c-46925b21920d', 'serial': '8c22cfde-db3c-4c83-994c-46925b21920d'}, 'attachment_id': '4dfe27ac-a39f-4139-a27c-ef16fcf2f582', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:36:14 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:36:14 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:36:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:36:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:36:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:36:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:36:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:36:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:36:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:36:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:36:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:36:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:36:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:36:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:36:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:36:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:36:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:36:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oXdtAbSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:36:15 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:36:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:36:15 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:36:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:36:15 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08008a7-05a2-42ea-907b-679ffff9f36f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:36:15 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2845661a-71f1-4e52-b923-213710f25764]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d] added
Oct 25 21:36:15 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5817f0b8-519f-4220-ac3b-9a4137f28bf8]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[05aebc24-e68f-4080-bdaf-c98c814ba93f]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oXdtAbSH {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oXdtAbSH" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a760122-30ed-40c5-99c8-cc4fa5013c7f]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oXdtAbSH'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d67aa50-1ffd-4c60-abba-615aa96411bc]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c665a55-8351-453a-ad3e-5670443068d6]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c (non-flash)
Oct 25 21:36:15 user nova-compute[74189]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:36:15 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c (non-flash)
Oct 25 21:36:15 user nova-compute[74189]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:36:15 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d145a9f-82ef-41b3-89fc-199430ed81a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d, portal: 172.16.0.220,3260]
Oct 25 21:36:15 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d, portal: 172.16.0.220,3260] successful.
Oct 25 21:36:15 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05d8dd2-e17f-4b15-acf6-e705a3c15e76]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e185b521-dbe6-42cb-8abd-b16ee2c66720]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c (non-flash)
Oct 25 21:36:15 user nova-compute[74189]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:36:15 user nova-compute[74189]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)
Oct 25 21:36:15 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c (non-flash)
Oct 25 21:36:15 user nova-compute[74189]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:36:15 user nova-compute[74189]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)
Oct 25 21:36:15 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.397s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43c7edf-bdf3-495a-93ac-5f2b4e2b12f0]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oXdtAbSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f61139d-d075-41d7-bd04-cc977ec87578/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f61139d-d075-41d7-bd04-cc977ec87578/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f61139d-d075-41d7-bd04-cc977ec87578/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f61139d-d075-41d7-bd04-cc977ec87578/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.444s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] <== connect_volume: return (1449ms) {'type': 'block', 'scsi_wwn': '23337663031383738', 'path': '/dev/sdc'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337663031383738', 'path': '/dev/sdc'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:35:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1992719043',display_name='tempest-TestVolumeBootPattern-server-1992719043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1992719043',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbWjlurUdlTqM38TJIvyWArBvgtPS5ByZ7GvbbNhterPxeMByoQxHeDSj3q/FAwbfZCzxGnbhX1L/9RQ/CSBOb1BJ9rZaqesREBo++7UKa99YIwO5kH0uL2CiEzhHllXw==',key_name='tempest-TestVolumeBootPattern-16841960',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e893e8f3f58e4e15920d313b6391682c',ramdisk_id='',reservation_id='r-l6yc2bcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1934687878',owner_user_name='tempest-TestVolumeBootPattern-1934687878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:35:53Z,user_data=None,user_id='77a27a7ebb4a458097c901871c378bc8',uuid=dcb582a2-5198-44aa-bbe8-48978975e9eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b83b195-15ba-461f-87f1-465a6a1066ce", "address": "fa:16:3e:34:0f:94", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b83b195-15", "ovs_interfaceid": "0b83b195-15ba-461f-87f1-465a6a1066ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converting VIF {"id": "0b83b195-15ba-461f-87f1-465a6a1066ce", "address": "fa:16:3e:34:0f:94", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b83b195-15", "ovs_interfaceid": "0b83b195-15ba-461f-87f1-465a6a1066ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:0f:94,bridge_name='br-int',has_traffic_filtering=True,id=0b83b195-15ba-461f-87f1-465a6a1066ce,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b83b195-15') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG nova.objects.instance [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lazy-loading 'pci_devices' on Instance uuid dcb582a2-5198-44aa-bbe8-48978975e9eb {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:36:16 user nova-compute[74189]:   <uuid>dcb582a2-5198-44aa-bbe8-48978975e9eb</uuid>
Oct 25 21:36:16 user nova-compute[74189]:   <name>instance-00000028</name>
Oct 25 21:36:16 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:36:16 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:36:16 user nova-compute[74189]:   <metadata>
Oct 25 21:36:16 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:36:16 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:36:16 user nova-compute[74189]:       <nova:name>tempest-TestVolumeBootPattern-server-1992719043</nova:name>
Oct 25 21:36:16 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:36:14</nova:creationTime>
Oct 25 21:36:16 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:36:16 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:36:16 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:36:16 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:36:16 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:36:16 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:36:16 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:36:16 user nova-compute[74189]:       <nova:owner>
Oct 25 21:36:16 user nova-compute[74189]:         <nova:user uuid="77a27a7ebb4a458097c901871c378bc8">tempest-TestVolumeBootPattern-1934687878-project-member</nova:user>
Oct 25 21:36:16 user nova-compute[74189]:         <nova:project uuid="e893e8f3f58e4e15920d313b6391682c">tempest-TestVolumeBootPattern-1934687878</nova:project>
Oct 25 21:36:16 user nova-compute[74189]:       </nova:owner>
Oct 25 21:36:16 user nova-compute[74189]:       <nova:ports>
Oct 25 21:36:16 user nova-compute[74189]:         <nova:port uuid="0b83b195-15ba-461f-87f1-465a6a1066ce">
Oct 25 21:36:16 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 25 21:36:16 user nova-compute[74189]:         </nova:port>
Oct 25 21:36:16 user nova-compute[74189]:       </nova:ports>
Oct 25 21:36:16 user nova-compute[74189]:     </nova:instance>
Oct 25 21:36:16 user nova-compute[74189]:   </metadata>
Oct 25 21:36:16 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:36:16 user nova-compute[74189]:     <system>
Oct 25 21:36:16 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:36:16 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:36:16 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:36:16 user nova-compute[74189]:       <entry name="serial">dcb582a2-5198-44aa-bbe8-48978975e9eb</entry>
Oct 25 21:36:16 user nova-compute[74189]:       <entry name="uuid">dcb582a2-5198-44aa-bbe8-48978975e9eb</entry>
Oct 25 21:36:16 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:36:16 user nova-compute[74189]:     </system>
Oct 25 21:36:16 user nova-compute[74189]:   </sysinfo>
Oct 25 21:36:16 user nova-compute[74189]:   <os>
Oct 25 21:36:16 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:36:16 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:36:16 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:36:16 user nova-compute[74189]:   </os>
Oct 25 21:36:16 user nova-compute[74189]:   <features>
Oct 25 21:36:16 user nova-compute[74189]:     <acpi/>
Oct 25 21:36:16 user nova-compute[74189]:     <apic/>
Oct 25 21:36:16 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:36:16 user nova-compute[74189]:   </features>
Oct 25 21:36:16 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:36:16 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:36:16 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:36:16 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:36:16 user nova-compute[74189]:   </clock>
Oct 25 21:36:16 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:36:16 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:36:16 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:36:16 user nova-compute[74189]:   </cpu>
Oct 25 21:36:16 user nova-compute[74189]:   <devices>
Oct 25 21:36:16 user nova-compute[74189]:     <disk type="block" device="disk">
Oct 25 21:36:16 user nova-compute[74189]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:36:16 user nova-compute[74189]:       <source dev="/dev/sdc"/>
Oct 25 21:36:16 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:36:16 user nova-compute[74189]:       <serial>8c22cfde-db3c-4c83-994c-46925b21920d</serial>
Oct 25 21:36:16 user nova-compute[74189]:     </disk>
Oct 25 21:36:16 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:36:16 user nova-compute[74189]:       <mac address="fa:16:3e:34:0f:94"/>
Oct 25 21:36:16 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:36:16 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:36:16 user nova-compute[74189]:       <target dev="tap0b83b195-15"/>
Oct 25 21:36:16 user nova-compute[74189]:     </interface>
Oct 25 21:36:16 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:36:16 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/dcb582a2-5198-44aa-bbe8-48978975e9eb/console.log" append="off"/>
Oct 25 21:36:16 user nova-compute[74189]:     </serial>
Oct 25 21:36:16 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:36:16 user nova-compute[74189]:     <video>
Oct 25 21:36:16 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:36:16 user nova-compute[74189]:     </video>
Oct 25 21:36:16 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:36:16 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:36:16 user nova-compute[74189]:     </rng>
Oct 25 21:36:16 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:36:16 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:36:16 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:36:16 user nova-compute[74189]:     </memballoon>
Oct 25 21:36:16 user nova-compute[74189]:   </devices>
Oct 25 21:36:16 user nova-compute[74189]: </domain>
Oct 25 21:36:16 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:35:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1992719043',display_name='tempest-TestVolumeBootPattern-server-1992719043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1992719043',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbWjlurUdlTqM38TJIvyWArBvgtPS5ByZ7GvbbNhterPxeMByoQxHeDSj3q/FAwbfZCzxGnbhX1L/9RQ/CSBOb1BJ9rZaqesREBo++7UKa99YIwO5kH0uL2CiEzhHllXw==',key_name='tempest-TestVolumeBootPattern-16841960',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e893e8f3f58e4e15920d313b6391682c',ramdisk_id='',reservation_id='r-l6yc2bcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1934687878',owner_user_name='tempest-TestVolumeBootPattern-1934687878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:35:53Z,user_data=None,user_id='77a27a7ebb4a458097c901871c378bc8',uuid=dcb582a2-5198-44aa-bbe8-48978975e9eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b83b195-15ba-461f-87f1-465a6a1066ce", "address": "fa:16:3e:34:0f:94", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b83b195-15", "ovs_interfaceid": "0b83b195-15ba-461f-87f1-465a6a1066ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converting VIF {"id": "0b83b195-15ba-461f-87f1-465a6a1066ce", "address": "fa:16:3e:34:0f:94", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b83b195-15", "ovs_interfaceid": "0b83b195-15ba-461f-87f1-465a6a1066ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:0f:94,bridge_name='br-int',has_traffic_filtering=True,id=0b83b195-15ba-461f-87f1-465a6a1066ce,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b83b195-15') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG os_vif [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:0f:94,bridge_name='br-int',has_traffic_filtering=True,id=0b83b195-15ba-461f-87f1-465a6a1066ce,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b83b195-15') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b15a5f4b-4200-57bd-bd7b-877e9b892ec2', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b83b195-15, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b83b195-15, col_values=(('qos', UUID('ab93cb43-dbdd-4f08-8497-ea6d50fe1857')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b83b195-15, col_values=(('external_ids', {'iface-id': '0b83b195-15ba-461f-87f1-465a6a1066ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:0f:94', 'vm-uuid': 'dcb582a2-5198-44aa-bbe8-48978975e9eb'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:16 user nova-compute[74189]: INFO os_vif [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:0f:94,bridge_name='br-int',has_traffic_filtering=True,id=0b83b195-15ba-461f-87f1-465a6a1066ce,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b83b195-15')
Oct 25 21:36:16 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] No VIF found with MAC fa:16:3e:34:0f:94, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:16 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:36:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:20 user nova-compute[74189]: DEBUG nova.compute.manager [req-92eb9494-ab39-465a-9362-aadaf832b44f req-806e014e-e5d3-4937-9f5c-6daf5e3a415b service nova] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Received event network-vif-plugged-0b83b195-15ba-461f-87f1-465a6a1066ce {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:36:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-92eb9494-ab39-465a-9362-aadaf832b44f req-806e014e-e5d3-4937-9f5c-6daf5e3a415b service nova] Acquiring lock "dcb582a2-5198-44aa-bbe8-48978975e9eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:36:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-92eb9494-ab39-465a-9362-aadaf832b44f req-806e014e-e5d3-4937-9f5c-6daf5e3a415b service nova] Lock "dcb582a2-5198-44aa-bbe8-48978975e9eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:36:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-92eb9494-ab39-465a-9362-aadaf832b44f req-806e014e-e5d3-4937-9f5c-6daf5e3a415b service nova] Lock "dcb582a2-5198-44aa-bbe8-48978975e9eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:36:20 user nova-compute[74189]: DEBUG nova.compute.manager [req-92eb9494-ab39-465a-9362-aadaf832b44f req-806e014e-e5d3-4937-9f5c-6daf5e3a415b service nova] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] No waiting events found dispatching network-vif-plugged-0b83b195-15ba-461f-87f1-465a6a1066ce {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:36:20 user nova-compute[74189]: WARNING nova.compute.manager [req-92eb9494-ab39-465a-9362-aadaf832b44f req-806e014e-e5d3-4937-9f5c-6daf5e3a415b service nova] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Received unexpected event network-vif-plugged-0b83b195-15ba-461f-87f1-465a6a1066ce for instance with vm_state building and task_state spawning.
Oct 25 21:36:20 user nova-compute[74189]: DEBUG nova.compute.manager [req-9e192ced-6f8a-4dc3-9d62-2a92fe4dba2b req-697e23e5-364a-451c-8ccf-e0cda405c576 service nova] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Received event network-vif-plugged-0b83b195-15ba-461f-87f1-465a6a1066ce {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:36:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9e192ced-6f8a-4dc3-9d62-2a92fe4dba2b req-697e23e5-364a-451c-8ccf-e0cda405c576 service nova] Acquiring lock "dcb582a2-5198-44aa-bbe8-48978975e9eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:36:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9e192ced-6f8a-4dc3-9d62-2a92fe4dba2b req-697e23e5-364a-451c-8ccf-e0cda405c576 service nova] Lock "dcb582a2-5198-44aa-bbe8-48978975e9eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:36:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9e192ced-6f8a-4dc3-9d62-2a92fe4dba2b req-697e23e5-364a-451c-8ccf-e0cda405c576 service nova] Lock "dcb582a2-5198-44aa-bbe8-48978975e9eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:36:20 user nova-compute[74189]: DEBUG nova.compute.manager [req-9e192ced-6f8a-4dc3-9d62-2a92fe4dba2b req-697e23e5-364a-451c-8ccf-e0cda405c576 service nova] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] No waiting events found dispatching network-vif-plugged-0b83b195-15ba-461f-87f1-465a6a1066ce {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:36:20 user nova-compute[74189]: WARNING nova.compute.manager [req-9e192ced-6f8a-4dc3-9d62-2a92fe4dba2b req-697e23e5-364a-451c-8ccf-e0cda405c576 service nova] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Received unexpected event network-vif-plugged-0b83b195-15ba-461f-87f1-465a6a1066ce for instance with vm_state building and task_state spawning.
Oct 25 21:36:20 user nova-compute[74189]: DEBUG nova.compute.manager [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:36:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:36:20 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:36:20 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:36:20 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=8057MB free_disk=24.930255889892578GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:36:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:36:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:36:20 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Instance spawned successfully.
Oct 25 21:36:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:36:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:36:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:36:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:36:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:36:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:36:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:36:20 user nova-compute[74189]: INFO nova.compute.manager [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Took 5.89 seconds to spawn the instance on the hypervisor.
Oct 25 21:36:20 user nova-compute[74189]: DEBUG nova.compute.manager [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:36:20 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Applying migration context for instance 1926c2ce-9643-4d00-9f54-a6747e71875b as it has an incoming, in-progress migration ebb9e7f8-510b-4cd4-93f8-acaf513b3ddf. Migration status is finished {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 25 21:36:20 user nova-compute[74189]: INFO nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Updating resource usage from migration ebb9e7f8-510b-4cd4-93f8-acaf513b3ddf
Oct 25 21:36:20 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance d7c3a99a-ab38-4e88-896d-94ae51a09a48 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:36:20 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 932fe8ac-fdde-45c6-aa32-9bf866f19a4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:36:20 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:36:20 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3da14c0a-31a8-4fe3-bd5a-49378680af50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:36:20 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 8f61139d-d075-41d7-bd04-cc977ec87578 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:36:20 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Migration ebb9e7f8-510b-4cd4-93f8-acaf513b3ddf is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 25 21:36:20 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 1926c2ce-9643-4d00-9f54-a6747e71875b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:36:20 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance dcb582a2-5198-44aa-bbe8-48978975e9eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:36:20 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:36:20 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:36:20 user nova-compute[74189]: INFO nova.compute.manager [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Took 28.61 seconds to build instance.
Oct 25 21:36:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-1f1523bd-801e-4157-a776-25e42fa9c21c tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "dcb582a2-5198-44aa-bbe8-48978975e9eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.747s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:36:21 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:36:21 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:36:21 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:36:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.538s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:36:21 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:36:21 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74189) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 21:36:21 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:36:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ac9359f5-eb74-4eb9-9b80-b6c9fdd3b16e tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "d7c3a99a-ab38-4e88-896d-94ae51a09a48" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:36:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ac9359f5-eb74-4eb9-9b80-b6c9fdd3b16e tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "d7c3a99a-ab38-4e88-896d-94ae51a09a48" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:36:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ac9359f5-eb74-4eb9-9b80-b6c9fdd3b16e tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "d7c3a99a-ab38-4e88-896d-94ae51a09a48-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:36:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ac9359f5-eb74-4eb9-9b80-b6c9fdd3b16e tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "d7c3a99a-ab38-4e88-896d-94ae51a09a48-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:36:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ac9359f5-eb74-4eb9-9b80-b6c9fdd3b16e tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "d7c3a99a-ab38-4e88-896d-94ae51a09a48-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:36:22 user nova-compute[74189]: INFO nova.compute.manager [None req-ac9359f5-eb74-4eb9-9b80-b6c9fdd3b16e tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Terminating instance
Oct 25 21:36:22 user nova-compute[74189]: DEBUG nova.compute.manager [None req-ac9359f5-eb74-4eb9-9b80-b6c9fdd3b16e tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:36:22 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:36:22 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:36:22 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:36:22 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:36:22 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:36:22 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:36:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:22 user nova-compute[74189]: DEBUG nova.compute.manager [req-8e2255f5-0151-49ca-846b-aade35762380 req-0027de53-3832-49e7-8326-79c112ac85b4 service nova] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Received event network-vif-unplugged-44169902-69da-4fe1-8292-a23e0ff15fc7 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:36:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8e2255f5-0151-49ca-846b-aade35762380 req-0027de53-3832-49e7-8326-79c112ac85b4 service nova] Acquiring lock "d7c3a99a-ab38-4e88-896d-94ae51a09a48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:36:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8e2255f5-0151-49ca-846b-aade35762380 req-0027de53-3832-49e7-8326-79c112ac85b4 service nova] Lock "d7c3a99a-ab38-4e88-896d-94ae51a09a48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:36:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8e2255f5-0151-49ca-846b-aade35762380 req-0027de53-3832-49e7-8326-79c112ac85b4 service nova] Lock "d7c3a99a-ab38-4e88-896d-94ae51a09a48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:36:22 user nova-compute[74189]: DEBUG nova.compute.manager [req-8e2255f5-0151-49ca-846b-aade35762380 req-0027de53-3832-49e7-8326-79c112ac85b4 service nova] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] No waiting events found dispatching network-vif-unplugged-44169902-69da-4fe1-8292-a23e0ff15fc7 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:36:22 user nova-compute[74189]: DEBUG nova.compute.manager [req-8e2255f5-0151-49ca-846b-aade35762380 req-0027de53-3832-49e7-8326-79c112ac85b4 service nova] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Received event network-vif-unplugged-44169902-69da-4fe1-8292-a23e0ff15fc7 for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:36:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:23 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Instance destroyed successfully.
Oct 25 21:36:23 user nova-compute[74189]: DEBUG nova.objects.instance [None req-ac9359f5-eb74-4eb9-9b80-b6c9fdd3b16e tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lazy-loading 'resources' on Instance uuid d7c3a99a-ab38-4e88-896d-94ae51a09a48 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:36:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-ac9359f5-eb74-4eb9-9b80-b6c9fdd3b16e tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:15:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1400291475',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1400291475',id=2,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:15:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='acbb4f93936848a8949477ad124bf98e',ramdisk_id='',reservation_id='r-lh66jkbe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-571481303',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:17:00Z,user_data=None,user_id='fc377c1beaab443683a6d776f2f734ff',uuid=d7c3a99a-ab38-4e88-896d-94ae51a09a48,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44169902-69da-4fe1-8292-a23e0ff15fc7", "address": "fa:16:3e:b9:37:c6", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44169902-69", "ovs_interfaceid": "44169902-69da-4fe1-8292-a23e0ff15fc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:36:23 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-ac9359f5-eb74-4eb9-9b80-b6c9fdd3b16e tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Converting VIF {"id": "44169902-69da-4fe1-8292-a23e0ff15fc7", "address": "fa:16:3e:b9:37:c6", "network": {"id": "f202171f-dfd8-4a19-9321-788318413ae2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-884381536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acbb4f93936848a8949477ad124bf98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44169902-69", "ovs_interfaceid": "44169902-69da-4fe1-8292-a23e0ff15fc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:36:23 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-ac9359f5-eb74-4eb9-9b80-b6c9fdd3b16e tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:37:c6,bridge_name='br-int',has_traffic_filtering=True,id=44169902-69da-4fe1-8292-a23e0ff15fc7,network=Network(f202171f-dfd8-4a19-9321-788318413ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44169902-69') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:36:23 user nova-compute[74189]: DEBUG os_vif [None req-ac9359f5-eb74-4eb9-9b80-b6c9fdd3b16e tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:37:c6,bridge_name='br-int',has_traffic_filtering=True,id=44169902-69da-4fe1-8292-a23e0ff15fc7,network=Network(f202171f-dfd8-4a19-9321-788318413ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44169902-69') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:36:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44169902-69, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:36:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:36:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a0c6d81d-0414-44a1-b2c7-06e4043d92ef) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:36:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:23 user nova-compute[74189]: INFO os_vif [None req-ac9359f5-eb74-4eb9-9b80-b6c9fdd3b16e tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:37:c6,bridge_name='br-int',has_traffic_filtering=True,id=44169902-69da-4fe1-8292-a23e0ff15fc7,network=Network(f202171f-dfd8-4a19-9321-788318413ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44169902-69')
Oct 25 21:36:23 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-ac9359f5-eb74-4eb9-9b80-b6c9fdd3b16e tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Deleting instance files /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48_del
Oct 25 21:36:23 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-ac9359f5-eb74-4eb9-9b80-b6c9fdd3b16e tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Deletion of /opt/stack/data/nova/instances/d7c3a99a-ab38-4e88-896d-94ae51a09a48_del complete
Oct 25 21:36:23 user nova-compute[74189]: INFO nova.compute.manager [None req-ac9359f5-eb74-4eb9-9b80-b6c9fdd3b16e tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 25 21:36:23 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-ac9359f5-eb74-4eb9-9b80-b6c9fdd3b16e tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:36:23 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:36:23 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:36:23 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:36:23 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Took 0.62 seconds to deallocate network for instance.
Oct 25 21:36:23 user nova-compute[74189]: DEBUG nova.compute.manager [req-0b8dd80c-9974-4762-826a-12d7ec97406f req-1dbf3a4a-e3bf-47f7-9a8c-75d64715701a service nova] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Received event network-vif-deleted-44169902-69da-4fe1-8292-a23e0ff15fc7 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:36:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ac9359f5-eb74-4eb9-9b80-b6c9fdd3b16e tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:36:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ac9359f5-eb74-4eb9-9b80-b6c9fdd3b16e tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:36:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:24 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-ac9359f5-eb74-4eb9-9b80-b6c9fdd3b16e tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:36:24 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-ac9359f5-eb74-4eb9-9b80-b6c9fdd3b16e tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:36:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ac9359f5-eb74-4eb9-9b80-b6c9fdd3b16e tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:36:24 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-ac9359f5-eb74-4eb9-9b80-b6c9fdd3b16e tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Deleted allocations for instance d7c3a99a-ab38-4e88-896d-94ae51a09a48
Oct 25 21:36:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ac9359f5-eb74-4eb9-9b80-b6c9fdd3b16e tempest-ServerBootFromVolumeStableRescueTest-571481303 tempest-ServerBootFromVolumeStableRescueTest-571481303-project-member] Lock "d7c3a99a-ab38-4e88-896d-94ae51a09a48" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.145s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:36:24 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:36:24 user nova-compute[74189]: DEBUG nova.compute.manager [req-bd264d44-2c4b-4252-ada1-f48cd43e6140 req-d9d80a6e-d343-40a5-9763-b7bd94a2cf7b service nova] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Received event network-vif-plugged-44169902-69da-4fe1-8292-a23e0ff15fc7 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:36:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bd264d44-2c4b-4252-ada1-f48cd43e6140 req-d9d80a6e-d343-40a5-9763-b7bd94a2cf7b service nova] Acquiring lock "d7c3a99a-ab38-4e88-896d-94ae51a09a48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:36:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bd264d44-2c4b-4252-ada1-f48cd43e6140 req-d9d80a6e-d343-40a5-9763-b7bd94a2cf7b service nova] Lock "d7c3a99a-ab38-4e88-896d-94ae51a09a48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:36:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bd264d44-2c4b-4252-ada1-f48cd43e6140 req-d9d80a6e-d343-40a5-9763-b7bd94a2cf7b service nova] Lock "d7c3a99a-ab38-4e88-896d-94ae51a09a48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:36:24 user nova-compute[74189]: DEBUG nova.compute.manager [req-bd264d44-2c4b-4252-ada1-f48cd43e6140 req-d9d80a6e-d343-40a5-9763-b7bd94a2cf7b service nova] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] No waiting events found dispatching network-vif-plugged-44169902-69da-4fe1-8292-a23e0ff15fc7 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:36:24 user nova-compute[74189]: WARNING nova.compute.manager [req-bd264d44-2c4b-4252-ada1-f48cd43e6140 req-d9d80a6e-d343-40a5-9763-b7bd94a2cf7b service nova] [instance: d7c3a99a-ab38-4e88-896d-94ae51a09a48] Received unexpected event network-vif-plugged-44169902-69da-4fe1-8292-a23e0ff15fc7 for instance with vm_state deleted and task_state None.
Oct 25 21:36:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:28 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:36:28 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Cleaning up deleted instances {{(pid=74189) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 21:36:28 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] There are 0 instances to clean {{(pid=74189) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 21:36:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:36:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:36:50 user nova-compute[74189]: INFO nova.compute.manager [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Unshelving
Oct 25 21:36:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:36:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:36:51 user nova-compute[74189]: DEBUG nova.objects.instance [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lazy-loading 'pci_requests' on Instance uuid f1f19ee2-291f-4cc2-a7d9-db1874691e8e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:36:51 user nova-compute[74189]: DEBUG nova.objects.instance [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lazy-loading 'numa_topology' on Instance uuid f1f19ee2-291f-4cc2-a7d9-db1874691e8e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:36:51 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:36:51 user nova-compute[74189]: INFO nova.compute.claims [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Claim successful on node user
Oct 25 21:36:51 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:36:51 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:36:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:36:51 user nova-compute[74189]: INFO nova.network.neutron [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Updating port b460e41a-4e06-48e4-80b4-b551c718126e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 25 21:36:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "refresh_cache-f1f19ee2-291f-4cc2-a7d9-db1874691e8e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:36:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquired lock "refresh_cache-f1f19ee2-291f-4cc2-a7d9-db1874691e8e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:36:52 user nova-compute[74189]: DEBUG nova.network.neutron [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:36:52 user nova-compute[74189]: DEBUG nova.compute.manager [req-bea5d6f8-3428-4c6d-ab42-9c2897d88356 req-6b3fba61-0723-4262-a0ee-86db7da7df72 service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Received event network-changed-b460e41a-4e06-48e4-80b4-b551c718126e {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:36:52 user nova-compute[74189]: DEBUG nova.compute.manager [req-bea5d6f8-3428-4c6d-ab42-9c2897d88356 req-6b3fba61-0723-4262-a0ee-86db7da7df72 service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Refreshing instance network info cache due to event network-changed-b460e41a-4e06-48e4-80b4-b551c718126e. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:36:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bea5d6f8-3428-4c6d-ab42-9c2897d88356 req-6b3fba61-0723-4262-a0ee-86db7da7df72 service nova] Acquiring lock "refresh_cache-f1f19ee2-291f-4cc2-a7d9-db1874691e8e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:36:52 user nova-compute[74189]: DEBUG nova.network.neutron [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Updating instance_info_cache with network_info: [{"id": "b460e41a-4e06-48e4-80b4-b551c718126e", "address": "fa:16:3e:4c:f4:6b", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb460e41a-4e", "ovs_interfaceid": "b460e41a-4e06-48e4-80b4-b551c718126e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:36:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Releasing lock "refresh_cache-f1f19ee2-291f-4cc2-a7d9-db1874691e8e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:36:52 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:36:52 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Creating image(s)
Oct 25 21:36:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:36:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "/opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:36:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "/opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:36:52 user nova-compute[74189]: DEBUG nova.objects.instance [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lazy-loading 'trusted_certs' on Instance uuid f1f19ee2-291f-4cc2-a7d9-db1874691e8e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:36:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bea5d6f8-3428-4c6d-ab42-9c2897d88356 req-6b3fba61-0723-4262-a0ee-86db7da7df72 service nova] Acquired lock "refresh_cache-f1f19ee2-291f-4cc2-a7d9-db1874691e8e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:36:52 user nova-compute[74189]: DEBUG nova.network.neutron [req-bea5d6f8-3428-4c6d-ab42-9c2897d88356 req-6b3fba61-0723-4262-a0ee-86db7da7df72 service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Refreshing network info cache for port b460e41a-4e06-48e4-80b4-b551c718126e {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:36:52 user nova-compute[74189]: DEBUG nova.objects.base [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Object Instance<f1f19ee2-291f-4cc2-a7d9-db1874691e8e> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:36:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "1be6b9e830596db7af797ecca2475c0af85d8000" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:36:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "1be6b9e830596db7af797ecca2475c0af85d8000" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:36:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1be6b9e830596db7af797ecca2475c0af85d8000.part --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:53 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1be6b9e830596db7af797ecca2475c0af85d8000.part --force-share --output=json" returned: 0 in 0.170s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:53 user nova-compute[74189]: DEBUG nova.virt.images [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] 8317448d-94de-4ac2-8512-df056dac6ec2 was qcow2, converting to raw {{(pid=74189) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 21:36:53 user nova-compute[74189]: DEBUG nova.privsep.utils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74189) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 21:36:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1be6b9e830596db7af797ecca2475c0af85d8000.part /opt/stack/data/nova/instances/_base/1be6b9e830596db7af797ecca2475c0af85d8000.converted {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:53 user nova-compute[74189]: DEBUG nova.network.neutron [req-bea5d6f8-3428-4c6d-ab42-9c2897d88356 req-6b3fba61-0723-4262-a0ee-86db7da7df72 service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Updated VIF entry in instance network info cache for port b460e41a-4e06-48e4-80b4-b551c718126e. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:36:53 user nova-compute[74189]: DEBUG nova.network.neutron [req-bea5d6f8-3428-4c6d-ab42-9c2897d88356 req-6b3fba61-0723-4262-a0ee-86db7da7df72 service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Updating instance_info_cache with network_info: [{"id": "b460e41a-4e06-48e4-80b4-b551c718126e", "address": "fa:16:3e:4c:f4:6b", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb460e41a-4e", "ovs_interfaceid": "b460e41a-4e06-48e4-80b4-b551c718126e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:36:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bea5d6f8-3428-4c6d-ab42-9c2897d88356 req-6b3fba61-0723-4262-a0ee-86db7da7df72 service nova] Releasing lock "refresh_cache-f1f19ee2-291f-4cc2-a7d9-db1874691e8e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:36:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1be6b9e830596db7af797ecca2475c0af85d8000.part /opt/stack/data/nova/instances/_base/1be6b9e830596db7af797ecca2475c0af85d8000.converted" returned: 0 in 0.568s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1be6b9e830596db7af797ecca2475c0af85d8000.converted --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1be6b9e830596db7af797ecca2475c0af85d8000.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "1be6b9e830596db7af797ecca2475c0af85d8000" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.086s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:36:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1be6b9e830596db7af797ecca2475c0af85d8000 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1be6b9e830596db7af797ecca2475c0af85d8000 --force-share --output=json" returned: 0 in 0.179s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "1be6b9e830596db7af797ecca2475c0af85d8000" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:36:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "1be6b9e830596db7af797ecca2475c0af85d8000" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:36:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1be6b9e830596db7af797ecca2475c0af85d8000 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1be6b9e830596db7af797ecca2475c0af85d8000 --force-share --output=json" returned: 0 in 0.173s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1be6b9e830596db7af797ecca2475c0af85d8000,backing_fmt=raw /opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1be6b9e830596db7af797ecca2475c0af85d8000,backing_fmt=raw /opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk 1073741824" returned: 0 in 0.050s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "1be6b9e830596db7af797ecca2475c0af85d8000" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:36:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1be6b9e830596db7af797ecca2475c0af85d8000 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1be6b9e830596db7af797ecca2475c0af85d8000 --force-share --output=json" returned: 0 in 0.172s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:55 user nova-compute[74189]: DEBUG nova.objects.instance [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lazy-loading 'migration_context' on Instance uuid f1f19ee2-291f-4cc2-a7d9-db1874691e8e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:36:55 user nova-compute[74189]: DEBUG nova.objects.base [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Object Instance<f1f19ee2-291f-4cc2-a7d9-db1874691e8e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:36:55 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Rebasing disk image.
Oct 25 21:36:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.174s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 -F raw /opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 -F raw /opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk" returned: 0 in 2.534s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Ensure instance console log exists: /opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Start _get_guest_xml network_info=[{"id": "b460e41a-4e06-48e4-80b4-b551c718126e", "address": "fa:16:3e:4c:f4:6b", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb460e41a-4e", "ovs_interfaceid": "b460e41a-4e06-48e4-80b4-b551c718126e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='1cedb46cece5456407cf9b9c5bc8e795',container_format='bare',created_at=2023-10-25T21:34:58Z,direct_url=<?>,disk_format='qcow2',id=8317448d-94de-4ac2-8512-df056dac6ec2,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-904043964-shelved',owner='e45f8868c6a04e31ad1617ee6e9438a2',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-25T21:35:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:36:57 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:36:57 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:36:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='1cedb46cece5456407cf9b9c5bc8e795',container_format='bare',created_at=2023-10-25T21:34:58Z,direct_url=<?>,disk_format='qcow2',id=8317448d-94de-4ac2-8512-df056dac6ec2,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-904043964-shelved',owner='e45f8868c6a04e31ad1617ee6e9438a2',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-25T21:35:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG nova.objects.instance [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lazy-loading 'vcpu_model' on Instance uuid f1f19ee2-291f-4cc2-a7d9-db1874691e8e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG nova.objects.base [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Object Instance<f1f19ee2-291f-4cc2-a7d9-db1874691e8e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T21:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-904043964',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-904043964',id=36,image_ref='8317448d-94de-4ac2-8512-df056dac6ec2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1324843434',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:33:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e45f8868c6a04e31ad1617ee6e9438a2',ramdisk_id='',reservation_id='r-sk1uqinq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-846255404',owner_user_name='tempest-AttachVolumeShelveTestJSON-846255404-project-member',shelved_at='2023-10-25T21:35:03.303705',shelved_host='user',shelved_image_id='8317448d-94de-4ac2-8512-df056dac6ec2'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:36:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6fb9b5c36f049c1af4ae44e11267264',uuid=f1f19ee2-291f-4cc2-a7d9-db1874691e8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b460e41a-4e06-48e4-80b4-b551c718126e", "address": "fa:16:3e:4c:f4:6b", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb460e41a-4e", "ovs_interfaceid": "b460e41a-4e06-48e4-80b4-b551c718126e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Converting VIF {"id": "b460e41a-4e06-48e4-80b4-b551c718126e", "address": "fa:16:3e:4c:f4:6b", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb460e41a-4e", "ovs_interfaceid": "b460e41a-4e06-48e4-80b4-b551c718126e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:6b,bridge_name='br-int',has_traffic_filtering=True,id=b460e41a-4e06-48e4-80b4-b551c718126e,network=Network(09d8bdf6-f255-479c-aa38-55d468abf1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb460e41a-4e') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG nova.objects.instance [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lazy-loading 'pci_devices' on Instance uuid f1f19ee2-291f-4cc2-a7d9-db1874691e8e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG nova.objects.base [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Object Instance<f1f19ee2-291f-4cc2-a7d9-db1874691e8e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:36:57 user nova-compute[74189]:   <uuid>f1f19ee2-291f-4cc2-a7d9-db1874691e8e</uuid>
Oct 25 21:36:57 user nova-compute[74189]:   <name>instance-00000024</name>
Oct 25 21:36:57 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:36:57 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:36:57 user nova-compute[74189]:   <metadata>
Oct 25 21:36:57 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:36:57 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:36:57 user nova-compute[74189]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-904043964</nova:name>
Oct 25 21:36:57 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:36:57</nova:creationTime>
Oct 25 21:36:57 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:36:57 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:36:57 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:36:57 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:36:57 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:36:57 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:36:57 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:36:57 user nova-compute[74189]:       <nova:owner>
Oct 25 21:36:57 user nova-compute[74189]:         <nova:user uuid="e6fb9b5c36f049c1af4ae44e11267264">tempest-AttachVolumeShelveTestJSON-846255404-project-member</nova:user>
Oct 25 21:36:57 user nova-compute[74189]:         <nova:project uuid="e45f8868c6a04e31ad1617ee6e9438a2">tempest-AttachVolumeShelveTestJSON-846255404</nova:project>
Oct 25 21:36:57 user nova-compute[74189]:       </nova:owner>
Oct 25 21:36:57 user nova-compute[74189]:       <nova:root type="image" uuid="8317448d-94de-4ac2-8512-df056dac6ec2"/>
Oct 25 21:36:57 user nova-compute[74189]:       <nova:ports>
Oct 25 21:36:57 user nova-compute[74189]:         <nova:port uuid="b460e41a-4e06-48e4-80b4-b551c718126e">
Oct 25 21:36:57 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 25 21:36:57 user nova-compute[74189]:         </nova:port>
Oct 25 21:36:57 user nova-compute[74189]:       </nova:ports>
Oct 25 21:36:57 user nova-compute[74189]:     </nova:instance>
Oct 25 21:36:57 user nova-compute[74189]:   </metadata>
Oct 25 21:36:57 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:36:57 user nova-compute[74189]:     <system>
Oct 25 21:36:57 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:36:57 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:36:57 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:36:57 user nova-compute[74189]:       <entry name="serial">f1f19ee2-291f-4cc2-a7d9-db1874691e8e</entry>
Oct 25 21:36:57 user nova-compute[74189]:       <entry name="uuid">f1f19ee2-291f-4cc2-a7d9-db1874691e8e</entry>
Oct 25 21:36:57 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:36:57 user nova-compute[74189]:     </system>
Oct 25 21:36:57 user nova-compute[74189]:   </sysinfo>
Oct 25 21:36:57 user nova-compute[74189]:   <os>
Oct 25 21:36:57 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:36:57 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:36:57 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:36:57 user nova-compute[74189]:   </os>
Oct 25 21:36:57 user nova-compute[74189]:   <features>
Oct 25 21:36:57 user nova-compute[74189]:     <acpi/>
Oct 25 21:36:57 user nova-compute[74189]:     <apic/>
Oct 25 21:36:57 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:36:57 user nova-compute[74189]:   </features>
Oct 25 21:36:57 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:36:57 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:36:57 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:36:57 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:36:57 user nova-compute[74189]:   </clock>
Oct 25 21:36:57 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:36:57 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:36:57 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:36:57 user nova-compute[74189]:   </cpu>
Oct 25 21:36:57 user nova-compute[74189]:   <devices>
Oct 25 21:36:57 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:36:57 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:36:57 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk"/>
Oct 25 21:36:57 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:36:57 user nova-compute[74189]:     </disk>
Oct 25 21:36:57 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:36:57 user nova-compute[74189]:       <mac address="fa:16:3e:4c:f4:6b"/>
Oct 25 21:36:57 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:36:57 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:36:57 user nova-compute[74189]:       <target dev="tapb460e41a-4e"/>
Oct 25 21:36:57 user nova-compute[74189]:     </interface>
Oct 25 21:36:57 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:36:57 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/console.log" append="off"/>
Oct 25 21:36:57 user nova-compute[74189]:     </serial>
Oct 25 21:36:57 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:36:57 user nova-compute[74189]:     <video>
Oct 25 21:36:57 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:36:57 user nova-compute[74189]:     </video>
Oct 25 21:36:57 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:36:57 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:36:57 user nova-compute[74189]:     </rng>
Oct 25 21:36:57 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:36:57 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:36:57 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:36:57 user nova-compute[74189]:     </memballoon>
Oct 25 21:36:57 user nova-compute[74189]:   </devices>
Oct 25 21:36:57 user nova-compute[74189]: </domain>
Oct 25 21:36:57 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T21:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-904043964',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-904043964',id=36,image_ref='8317448d-94de-4ac2-8512-df056dac6ec2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1324843434',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:33:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e45f8868c6a04e31ad1617ee6e9438a2',ramdisk_id='',reservation_id='r-sk1uqinq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-846255404',owner_user_name='tempest-AttachVolumeShelveTestJSON-846255404-project-member',shelved_at='2023-10-25T21:35:03.303705',shelved_host='user',shelved_image_id='8317448d-94de-4ac2-8512-df056dac6ec2'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:36:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6fb9b5c36f049c1af4ae44e11267264',uuid=f1f19ee2-291f-4cc2-a7d9-db1874691e8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b460e41a-4e06-48e4-80b4-b551c718126e", "address": "fa:16:3e:4c:f4:6b", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb460e41a-4e", "ovs_interfaceid": "b460e41a-4e06-48e4-80b4-b551c718126e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Converting VIF {"id": "b460e41a-4e06-48e4-80b4-b551c718126e", "address": "fa:16:3e:4c:f4:6b", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb460e41a-4e", "ovs_interfaceid": "b460e41a-4e06-48e4-80b4-b551c718126e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:6b,bridge_name='br-int',has_traffic_filtering=True,id=b460e41a-4e06-48e4-80b4-b551c718126e,network=Network(09d8bdf6-f255-479c-aa38-55d468abf1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb460e41a-4e') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG os_vif [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:6b,bridge_name='br-int',has_traffic_filtering=True,id=b460e41a-4e06-48e4-80b4-b551c718126e,network=Network(09d8bdf6-f255-479c-aa38-55d468abf1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb460e41a-4e') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b9c0050-a9b6-5451-bf0d-1b7056c334ba', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb460e41a-4e, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:36:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb460e41a-4e, col_values=(('qos', UUID('893d6764-77f5-448d-8738-95755955150e')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:36:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb460e41a-4e, col_values=(('external_ids', {'iface-id': 'b460e41a-4e06-48e4-80b4-b551c718126e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:f4:6b', 'vm-uuid': 'f1f19ee2-291f-4cc2-a7d9-db1874691e8e'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:36:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:36:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:58 user nova-compute[74189]: INFO os_vif [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:6b,bridge_name='br-int',has_traffic_filtering=True,id=b460e41a-4e06-48e4-80b4-b551c718126e,network=Network(09d8bdf6-f255-479c-aa38-55d468abf1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb460e41a-4e')
Oct 25 21:36:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:36:58 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] No VIF found with MAC fa:16:3e:4c:f4:6b, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:36:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:36:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-18e6792c-ac54-4b36-b8dc-c26dfa3f22a2 req-625ec639-e6e2-4eb4-a0d3-6353bb87b3a7 service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Received event network-vif-plugged-b460e41a-4e06-48e4-80b4-b551c718126e {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:36:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-18e6792c-ac54-4b36-b8dc-c26dfa3f22a2 req-625ec639-e6e2-4eb4-a0d3-6353bb87b3a7 service nova] Acquiring lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:36:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-18e6792c-ac54-4b36-b8dc-c26dfa3f22a2 req-625ec639-e6e2-4eb4-a0d3-6353bb87b3a7 service nova] Lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:36:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-18e6792c-ac54-4b36-b8dc-c26dfa3f22a2 req-625ec639-e6e2-4eb4-a0d3-6353bb87b3a7 service nova] Lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:36:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-18e6792c-ac54-4b36-b8dc-c26dfa3f22a2 req-625ec639-e6e2-4eb4-a0d3-6353bb87b3a7 service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] No waiting events found dispatching network-vif-plugged-b460e41a-4e06-48e4-80b4-b551c718126e {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:36:59 user nova-compute[74189]: WARNING nova.compute.manager [req-18e6792c-ac54-4b36-b8dc-c26dfa3f22a2 req-625ec639-e6e2-4eb4-a0d3-6353bb87b3a7 service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Received unexpected event network-vif-plugged-b460e41a-4e06-48e4-80b4-b551c718126e for instance with vm_state shelved_offloaded and task_state spawning.
Oct 25 21:37:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:37:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:37:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:37:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:37:01 user nova-compute[74189]: DEBUG nova.compute.manager [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:37:01 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:37:01 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Instance spawned successfully.
Oct 25 21:37:01 user nova-compute[74189]: DEBUG nova.compute.manager [req-4d9b9c4c-f039-45b8-8300-e506305aa527 req-6f1bc2f5-514b-416e-9a0f-4f3fa0f02ccb service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Received event network-vif-plugged-b460e41a-4e06-48e4-80b4-b551c718126e {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:37:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4d9b9c4c-f039-45b8-8300-e506305aa527 req-6f1bc2f5-514b-416e-9a0f-4f3fa0f02ccb service nova] Acquiring lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:37:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4d9b9c4c-f039-45b8-8300-e506305aa527 req-6f1bc2f5-514b-416e-9a0f-4f3fa0f02ccb service nova] Lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:37:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4d9b9c4c-f039-45b8-8300-e506305aa527 req-6f1bc2f5-514b-416e-9a0f-4f3fa0f02ccb service nova] Lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:37:01 user nova-compute[74189]: DEBUG nova.compute.manager [req-4d9b9c4c-f039-45b8-8300-e506305aa527 req-6f1bc2f5-514b-416e-9a0f-4f3fa0f02ccb service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] No waiting events found dispatching network-vif-plugged-b460e41a-4e06-48e4-80b4-b551c718126e {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:37:01 user nova-compute[74189]: WARNING nova.compute.manager [req-4d9b9c4c-f039-45b8-8300-e506305aa527 req-6f1bc2f5-514b-416e-9a0f-4f3fa0f02ccb service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Received unexpected event network-vif-plugged-b460e41a-4e06-48e4-80b4-b551c718126e for instance with vm_state shelved_offloaded and task_state spawning.
Oct 25 21:37:01 user nova-compute[74189]: DEBUG nova.compute.manager [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:37:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f3e40c79-9981-4103-a5f0-897f0d4374a6 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.010s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:37:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:37:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:37:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:37:11 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:37:11 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:37:11 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:37:11 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:37:11 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:37:12 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Updating instance_info_cache with network_info: [{"id": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "address": "fa:16:3e:5d:2c:57", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d0e911-b6", "ovs_interfaceid": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:37:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:37:12 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:37:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:37:13 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:37:13 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:37:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:37:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:37:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:37:13 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:37:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:37:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk.rescue --force-share --output=json" returned: 0 in 0.279s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:37:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:37:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk.rescue --force-share --output=json" returned: 0 in 0.342s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:37:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:37:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:37:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:37:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:37:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:37:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:37:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:37:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:37:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:37:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:37:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:37:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:37:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:37:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:37:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:37:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:37:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:37:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:37:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f61139d-d075-41d7-bd04-cc977ec87578/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:37:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f61139d-d075-41d7-bd04-cc977ec87578/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:37:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f61139d-d075-41d7-bd04-cc977ec87578/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:37:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f61139d-d075-41d7-bd04-cc977ec87578/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:37:16 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:37:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:37:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:37:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:37:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:37:17 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:37:17 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:37:17 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:37:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=7891MB free_disk=25.0186767578125GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:37:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:37:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:37:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Applying migration context for instance 1926c2ce-9643-4d00-9f54-a6747e71875b as it has an incoming, in-progress migration ebb9e7f8-510b-4cd4-93f8-acaf513b3ddf. Migration status is finished {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 25 21:37:17 user nova-compute[74189]: INFO nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Updating resource usage from migration ebb9e7f8-510b-4cd4-93f8-acaf513b3ddf
Oct 25 21:37:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 932fe8ac-fdde-45c6-aa32-9bf866f19a4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:37:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:37:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3da14c0a-31a8-4fe3-bd5a-49378680af50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:37:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 8f61139d-d075-41d7-bd04-cc977ec87578 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:37:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Migration ebb9e7f8-510b-4cd4-93f8-acaf513b3ddf is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 25 21:37:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 1926c2ce-9643-4d00-9f54-a6747e71875b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:37:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance dcb582a2-5198-44aa-bbe8-48978975e9eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:37:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance f1f19ee2-291f-4cc2-a7d9-db1874691e8e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:37:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:37:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:37:17 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Refreshing inventories for resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 21:37:17 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Updating ProviderTree inventory for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 21:37:17 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Updating inventory in ProviderTree for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 21:37:17 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Refreshing aggregate associations for resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc, aggregates: None {{(pid=74189) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 21:37:17 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Refreshing trait associations for resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING {{(pid=74189) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 21:37:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:37:18 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:37:18 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:37:18 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:37:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.688s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:37:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:37:20 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:37:20 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:37:20 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:37:20 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:37:20 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:37:20 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:37:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:37:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:37:25 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:37:25 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:37:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:37:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-370adf92-e556-4f01-8890-97e4f519a6e5 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "1926c2ce-9643-4d00-9f54-a6747e71875b" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:37:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-370adf92-e556-4f01-8890-97e4f519a6e5 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "1926c2ce-9643-4d00-9f54-a6747e71875b" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:37:28 user nova-compute[74189]: DEBUG nova.compute.manager [None req-370adf92-e556-4f01-8890-97e4f519a6e5 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Going to confirm migration 2 {{(pid=74189) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Oct 25 21:37:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-370adf92-e556-4f01-8890-97e4f519a6e5 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "refresh_cache-1926c2ce-9643-4d00-9f54-a6747e71875b" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:37:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-370adf92-e556-4f01-8890-97e4f519a6e5 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquired lock "refresh_cache-1926c2ce-9643-4d00-9f54-a6747e71875b" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:37:28 user nova-compute[74189]: DEBUG nova.network.neutron [None req-370adf92-e556-4f01-8890-97e4f519a6e5 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:37:28 user nova-compute[74189]: DEBUG nova.objects.instance [None req-370adf92-e556-4f01-8890-97e4f519a6e5 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lazy-loading 'info_cache' on Instance uuid 1926c2ce-9643-4d00-9f54-a6747e71875b {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:37:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:37:29 user nova-compute[74189]: DEBUG nova.network.neutron [None req-370adf92-e556-4f01-8890-97e4f519a6e5 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Updating instance_info_cache with network_info: [{"id": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "address": "fa:16:3e:6e:2f:0e", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d26f4c0-28", "ovs_interfaceid": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:37:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-370adf92-e556-4f01-8890-97e4f519a6e5 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Releasing lock "refresh_cache-1926c2ce-9643-4d00-9f54-a6747e71875b" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:37:29 user nova-compute[74189]: DEBUG nova.objects.instance [None req-370adf92-e556-4f01-8890-97e4f519a6e5 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lazy-loading 'migration_context' on Instance uuid 1926c2ce-9643-4d00-9f54-a6747e71875b {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:37:29 user nova-compute[74189]: DEBUG nova.objects.base [None req-370adf92-e556-4f01-8890-97e4f519a6e5 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Object Instance<1926c2ce-9643-4d00-9f54-a6747e71875b> lazy-loaded attributes: info_cache,migration_context {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:37:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-370adf92-e556-4f01-8890-97e4f519a6e5 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:37:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-370adf92-e556-4f01-8890-97e4f519a6e5 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:37:29 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-370adf92-e556-4f01-8890-97e4f519a6e5 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:37:29 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-370adf92-e556-4f01-8890-97e4f519a6e5 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:37:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-370adf92-e556-4f01-8890-97e4f519a6e5 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.353s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:37:29 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-370adf92-e556-4f01-8890-97e4f519a6e5 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Deleted allocation for migration ebb9e7f8-510b-4cd4-93f8-acaf513b3ddf
Oct 25 21:37:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-370adf92-e556-4f01-8890-97e4f519a6e5 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "1926c2ce-9643-4d00-9f54-a6747e71875b" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.455s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:37:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:37:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:37:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:37:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:37:44 user nova-compute[74189]: DEBUG nova.compute.manager [req-10fbca9a-f94b-411d-8cfd-426326b03708 req-2096a940-c0ab-47df-8212-59dd8afbfefc service nova] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Received event network-changed-0b83b195-15ba-461f-87f1-465a6a1066ce {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:37:44 user nova-compute[74189]: DEBUG nova.compute.manager [req-10fbca9a-f94b-411d-8cfd-426326b03708 req-2096a940-c0ab-47df-8212-59dd8afbfefc service nova] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Refreshing instance network info cache due to event network-changed-0b83b195-15ba-461f-87f1-465a6a1066ce. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:37:44 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-10fbca9a-f94b-411d-8cfd-426326b03708 req-2096a940-c0ab-47df-8212-59dd8afbfefc service nova] Acquiring lock "refresh_cache-dcb582a2-5198-44aa-bbe8-48978975e9eb" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:37:44 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-10fbca9a-f94b-411d-8cfd-426326b03708 req-2096a940-c0ab-47df-8212-59dd8afbfefc service nova] Acquired lock "refresh_cache-dcb582a2-5198-44aa-bbe8-48978975e9eb" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:37:44 user nova-compute[74189]: DEBUG nova.network.neutron [req-10fbca9a-f94b-411d-8cfd-426326b03708 req-2096a940-c0ab-47df-8212-59dd8afbfefc service nova] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Refreshing network info cache for port 0b83b195-15ba-461f-87f1-465a6a1066ce {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:37:45 user nova-compute[74189]: DEBUG nova.network.neutron [req-10fbca9a-f94b-411d-8cfd-426326b03708 req-2096a940-c0ab-47df-8212-59dd8afbfefc service nova] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Updated VIF entry in instance network info cache for port 0b83b195-15ba-461f-87f1-465a6a1066ce. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:37:45 user nova-compute[74189]: DEBUG nova.network.neutron [req-10fbca9a-f94b-411d-8cfd-426326b03708 req-2096a940-c0ab-47df-8212-59dd8afbfefc service nova] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Updating instance_info_cache with network_info: [{"id": "0b83b195-15ba-461f-87f1-465a6a1066ce", "address": "fa:16:3e:34:0f:94", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b83b195-15", "ovs_interfaceid": "0b83b195-15ba-461f-87f1-465a6a1066ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:37:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-10fbca9a-f94b-411d-8cfd-426326b03708 req-2096a940-c0ab-47df-8212-59dd8afbfefc service nova] Releasing lock "refresh_cache-dcb582a2-5198-44aa-bbe8-48978975e9eb" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:37:46 user nova-compute[74189]: DEBUG nova.compute.manager [req-372ee96e-1186-4051-99e3-297e9735cfb2 req-5daeca36-c5d7-4e6a-8590-825c77ec0cb5 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Received event network-changed-83f7d737-3cbc-4a68-8f5f-da99acae2d42 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:37:46 user nova-compute[74189]: DEBUG nova.compute.manager [req-372ee96e-1186-4051-99e3-297e9735cfb2 req-5daeca36-c5d7-4e6a-8590-825c77ec0cb5 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Refreshing instance network info cache due to event network-changed-83f7d737-3cbc-4a68-8f5f-da99acae2d42. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:37:46 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-372ee96e-1186-4051-99e3-297e9735cfb2 req-5daeca36-c5d7-4e6a-8590-825c77ec0cb5 service nova] Acquiring lock "refresh_cache-8f61139d-d075-41d7-bd04-cc977ec87578" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:37:46 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-372ee96e-1186-4051-99e3-297e9735cfb2 req-5daeca36-c5d7-4e6a-8590-825c77ec0cb5 service nova] Acquired lock "refresh_cache-8f61139d-d075-41d7-bd04-cc977ec87578" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:37:46 user nova-compute[74189]: DEBUG nova.network.neutron [req-372ee96e-1186-4051-99e3-297e9735cfb2 req-5daeca36-c5d7-4e6a-8590-825c77ec0cb5 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Refreshing network info cache for port 83f7d737-3cbc-4a68-8f5f-da99acae2d42 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:37:46 user nova-compute[74189]: DEBUG nova.compute.manager [req-b8849348-e54b-4ebe-abf8-655eceddd749 req-7b02bd04-696f-4fdd-b4ce-b863887f14e5 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Received event network-changed-83f7d737-3cbc-4a68-8f5f-da99acae2d42 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:37:46 user nova-compute[74189]: DEBUG nova.compute.manager [req-b8849348-e54b-4ebe-abf8-655eceddd749 req-7b02bd04-696f-4fdd-b4ce-b863887f14e5 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Refreshing instance network info cache due to event network-changed-83f7d737-3cbc-4a68-8f5f-da99acae2d42. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:37:46 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b8849348-e54b-4ebe-abf8-655eceddd749 req-7b02bd04-696f-4fdd-b4ce-b863887f14e5 service nova] Acquiring lock "refresh_cache-8f61139d-d075-41d7-bd04-cc977ec87578" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:37:47 user nova-compute[74189]: DEBUG nova.network.neutron [req-372ee96e-1186-4051-99e3-297e9735cfb2 req-5daeca36-c5d7-4e6a-8590-825c77ec0cb5 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Updated VIF entry in instance network info cache for port 83f7d737-3cbc-4a68-8f5f-da99acae2d42. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:37:47 user nova-compute[74189]: DEBUG nova.network.neutron [req-372ee96e-1186-4051-99e3-297e9735cfb2 req-5daeca36-c5d7-4e6a-8590-825c77ec0cb5 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Updating instance_info_cache with network_info: [{"id": "83f7d737-3cbc-4a68-8f5f-da99acae2d42", "address": "fa:16:3e:f8:7c:39", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f7d737-3c", "ovs_interfaceid": "83f7d737-3cbc-4a68-8f5f-da99acae2d42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:37:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "8f61139d-d075-41d7-bd04-cc977ec87578" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:37:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "8f61139d-d075-41d7-bd04-cc977ec87578" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:37:47 user nova-compute[74189]: INFO nova.compute.manager [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Detaching volume 55bca833-cab5-4c4e-9ca0-dbffaa36867c
Oct 25 21:37:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-372ee96e-1186-4051-99e3-297e9735cfb2 req-5daeca36-c5d7-4e6a-8590-825c77ec0cb5 service nova] Releasing lock "refresh_cache-8f61139d-d075-41d7-bd04-cc977ec87578" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:37:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b8849348-e54b-4ebe-abf8-655eceddd749 req-7b02bd04-696f-4fdd-b4ce-b863887f14e5 service nova] Acquired lock "refresh_cache-8f61139d-d075-41d7-bd04-cc977ec87578" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:37:47 user nova-compute[74189]: DEBUG nova.network.neutron [req-b8849348-e54b-4ebe-abf8-655eceddd749 req-7b02bd04-696f-4fdd-b4ce-b863887f14e5 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Refreshing network info cache for port 83f7d737-3cbc-4a68-8f5f-da99acae2d42 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:37:47 user nova-compute[74189]: INFO nova.virt.block_device [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Attempting to driver detach volume 55bca833-cab5-4c4e-9ca0-dbffaa36867c from mountpoint /dev/vdb
Oct 25 21:37:47 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Attempting to detach device vdb from instance 8f61139d-d075-41d7-bd04-cc977ec87578 from the persistent domain config. {{(pid=74189) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 21:37:47 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:37:47 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:37:47 user nova-compute[74189]:   <source dev="/dev/sdb"/>
Oct 25 21:37:47 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:37:47 user nova-compute[74189]:   <serial>55bca833-cab5-4c4e-9ca0-dbffaa36867c</serial>
Oct 25 21:37:47 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:37:47 user nova-compute[74189]: </disk>
Oct 25 21:37:47 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:37:47 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Successfully detached device vdb from instance 8f61139d-d075-41d7-bd04-cc977ec87578 from the persistent domain config.
Oct 25 21:37:47 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8f61139d-d075-41d7-bd04-cc977ec87578 from the live domain config. {{(pid=74189) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 21:37:47 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:37:47 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:37:47 user nova-compute[74189]:   <source dev="/dev/sdb"/>
Oct 25 21:37:47 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:37:47 user nova-compute[74189]:   <serial>55bca833-cab5-4c4e-9ca0-dbffaa36867c</serial>
Oct 25 21:37:47 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:37:47 user nova-compute[74189]: </disk>
Oct 25 21:37:47 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:37:47 user nova-compute[74189]: DEBUG nova.network.neutron [req-b8849348-e54b-4ebe-abf8-655eceddd749 req-7b02bd04-696f-4fdd-b4ce-b863887f14e5 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Updated VIF entry in instance network info cache for port 83f7d737-3cbc-4a68-8f5f-da99acae2d42. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:37:47 user nova-compute[74189]: DEBUG nova.network.neutron [req-b8849348-e54b-4ebe-abf8-655eceddd749 req-7b02bd04-696f-4fdd-b4ce-b863887f14e5 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Updating instance_info_cache with network_info: [{"id": "83f7d737-3cbc-4a68-8f5f-da99acae2d42", "address": "fa:16:3e:f8:7c:39", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f7d737-3c", "ovs_interfaceid": "83f7d737-3cbc-4a68-8f5f-da99acae2d42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:37:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b8849348-e54b-4ebe-abf8-655eceddd749 req-7b02bd04-696f-4fdd-b4ce-b863887f14e5 service nova] Releasing lock "refresh_cache-8f61139d-d075-41d7-bd04-cc977ec87578" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:37:47 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8f61139d-d075-41d7-bd04-cc977ec87578 {{(pid=74189) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 21:37:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:37:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:37:49 user nova-compute[74189]: INFO nova.compute.manager [None req-3a94dd89-ad76-48b3-bb14-7d1614a1ce0a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Unrescuing
Oct 25 21:37:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3a94dd89-ad76-48b3-bb14-7d1614a1ce0a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "refresh_cache-3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:37:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3a94dd89-ad76-48b3-bb14-7d1614a1ce0a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquired lock "refresh_cache-3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:37:49 user nova-compute[74189]: DEBUG nova.network.neutron [None req-3a94dd89-ad76-48b3-bb14-7d1614a1ce0a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:37:49 user nova-compute[74189]: DEBUG nova.network.neutron [None req-3a94dd89-ad76-48b3-bb14-7d1614a1ce0a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Updating instance_info_cache with network_info: [{"id": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "address": "fa:16:3e:5d:2c:57", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d0e911-b6", "ovs_interfaceid": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:37:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-3a94dd89-ad76-48b3-bb14-7d1614a1ce0a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Releasing lock "refresh_cache-3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:37:49 user nova-compute[74189]: DEBUG nova.objects.instance [None req-3a94dd89-ad76-48b3-bb14-7d1614a1ce0a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lazy-loading 'flavor' on Instance uuid 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:37:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:37:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:37:50 user nova-compute[74189]: DEBUG nova.compute.manager [req-c30f5065-e885-4a95-9574-ded310d50399 req-938bfb19-219d-44df-a9a0-2bafaf9a0b08 service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Received event network-vif-unplugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:37:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c30f5065-e885-4a95-9574-ded310d50399 req-938bfb19-219d-44df-a9a0-2bafaf9a0b08 service nova] Acquiring lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:37:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c30f5065-e885-4a95-9574-ded310d50399 req-938bfb19-219d-44df-a9a0-2bafaf9a0b08 service nova] Lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:37:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c30f5065-e885-4a95-9574-ded310d50399 req-938bfb19-219d-44df-a9a0-2bafaf9a0b08 service nova] Lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:37:50 user nova-compute[74189]: DEBUG nova.compute.manager [req-c30f5065-e885-4a95-9574-ded310d50399 req-938bfb19-219d-44df-a9a0-2bafaf9a0b08 service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] No waiting events found dispatching network-vif-unplugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:37:50 user nova-compute[74189]: WARNING nova.compute.manager [req-c30f5065-e885-4a95-9574-ded310d50399 req-938bfb19-219d-44df-a9a0-2bafaf9a0b08 service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Received unexpected event network-vif-unplugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf for instance with vm_state rescued and task_state unrescuing.
Oct 25 21:37:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:37:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:37:50 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Instance destroyed successfully.
Oct 25 21:37:52 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:37:52 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:37:52 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:37:52 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:37:52 user nova-compute[74189]: DEBUG nova.compute.manager [req-930e8415-cbc1-4ac9-bdec-da10c0e9d1de req-c450b922-abcc-4af4-8b01-54ee01ce41ee service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Received event network-vif-plugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:37:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-930e8415-cbc1-4ac9-bdec-da10c0e9d1de req-c450b922-abcc-4af4-8b01-54ee01ce41ee service nova] Acquiring lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:37:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-930e8415-cbc1-4ac9-bdec-da10c0e9d1de req-c450b922-abcc-4af4-8b01-54ee01ce41ee service nova] Lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:37:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-930e8415-cbc1-4ac9-bdec-da10c0e9d1de req-c450b922-abcc-4af4-8b01-54ee01ce41ee service nova] Lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:37:52 user nova-compute[74189]: DEBUG nova.compute.manager [req-930e8415-cbc1-4ac9-bdec-da10c0e9d1de req-c450b922-abcc-4af4-8b01-54ee01ce41ee service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] No waiting events found dispatching network-vif-plugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:37:52 user nova-compute[74189]: WARNING nova.compute.manager [req-930e8415-cbc1-4ac9-bdec-da10c0e9d1de req-c450b922-abcc-4af4-8b01-54ee01ce41ee service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Received unexpected event network-vif-plugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf for instance with vm_state rescued and task_state unrescuing.
Oct 25 21:37:52 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:37:53 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:37:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:37:54 user nova-compute[74189]: DEBUG nova.compute.manager [req-faeede35-98d0-4193-997a-d6578008d2d7 req-c7a4b9ae-cda8-449b-9f00-e232a497e8dd service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Received event network-vif-plugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:37:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-faeede35-98d0-4193-997a-d6578008d2d7 req-c7a4b9ae-cda8-449b-9f00-e232a497e8dd service nova] Acquiring lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:37:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-faeede35-98d0-4193-997a-d6578008d2d7 req-c7a4b9ae-cda8-449b-9f00-e232a497e8dd service nova] Lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:37:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-faeede35-98d0-4193-997a-d6578008d2d7 req-c7a4b9ae-cda8-449b-9f00-e232a497e8dd service nova] Lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:37:54 user nova-compute[74189]: DEBUG nova.compute.manager [req-faeede35-98d0-4193-997a-d6578008d2d7 req-c7a4b9ae-cda8-449b-9f00-e232a497e8dd service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] No waiting events found dispatching network-vif-plugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:37:54 user nova-compute[74189]: WARNING nova.compute.manager [req-faeede35-98d0-4193-997a-d6578008d2d7 req-c7a4b9ae-cda8-449b-9f00-e232a497e8dd service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Received unexpected event network-vif-plugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf for instance with vm_state rescued and task_state unrescuing.
Oct 25 21:37:54 user nova-compute[74189]: DEBUG nova.compute.manager [req-faeede35-98d0-4193-997a-d6578008d2d7 req-c7a4b9ae-cda8-449b-9f00-e232a497e8dd service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Received event network-vif-plugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:37:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-faeede35-98d0-4193-997a-d6578008d2d7 req-c7a4b9ae-cda8-449b-9f00-e232a497e8dd service nova] Acquiring lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:37:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-faeede35-98d0-4193-997a-d6578008d2d7 req-c7a4b9ae-cda8-449b-9f00-e232a497e8dd service nova] Lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:37:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-faeede35-98d0-4193-997a-d6578008d2d7 req-c7a4b9ae-cda8-449b-9f00-e232a497e8dd service nova] Lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:37:54 user nova-compute[74189]: DEBUG nova.compute.manager [req-faeede35-98d0-4193-997a-d6578008d2d7 req-c7a4b9ae-cda8-449b-9f00-e232a497e8dd service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] No waiting events found dispatching network-vif-plugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:37:54 user nova-compute[74189]: WARNING nova.compute.manager [req-faeede35-98d0-4193-997a-d6578008d2d7 req-c7a4b9ae-cda8-449b-9f00-e232a497e8dd service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Received unexpected event network-vif-plugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf for instance with vm_state rescued and task_state unrescuing.
Oct 25 21:37:54 user nova-compute[74189]: DEBUG nova.compute.manager [None req-3a94dd89-ad76-48b3-bb14-7d1614a1ce0a tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:37:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:37:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "337a8739-3f22-4a83-aa01-9ef8bae750cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:38:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "337a8739-3f22-4a83-aa01-9ef8bae750cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:38:04 user nova-compute[74189]: DEBUG nova.compute.manager [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:38:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:38:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:38:04 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:38:04 user nova-compute[74189]: INFO nova.compute.claims [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Claim successful on node user
Oct 25 21:38:05 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:38:05 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:38:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:38:05 user nova-compute[74189]: DEBUG nova.compute.manager [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:38:05 user nova-compute[74189]: DEBUG nova.compute.manager [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:38:05 user nova-compute[74189]: DEBUG nova.network.neutron [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:38:05 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:38:05 user nova-compute[74189]: DEBUG nova.compute.manager [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:38:05 user nova-compute[74189]: DEBUG nova.policy [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '77a27a7ebb4a458097c901871c378bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e893e8f3f58e4e15920d313b6391682c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:38:05 user nova-compute[74189]: INFO nova.virt.block_device [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Booting with volume 54cba2c9-a4fc-4720-91eb-2fa0ca198307 at /dev/vda
Oct 25 21:38:05 user nova-compute[74189]: DEBUG os_brick.utils [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:38:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:05 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f3e500-0dde-4791-8c17-49550c229f96]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:38:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:05 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad017ac-379c-475d-92c5-c6fb5b0304cb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:38:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:05 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c15a08-5a16-4c61-95be-f907ddb2a9ad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:38:05 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa16d4bc-c57e-4329-9fac-bb9a0386b6d3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:38:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:38:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:38:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:38:05 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:38:05 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1d559f-9b9f-483f-998c-cfcf3dcb09db]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:38:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:38:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:38:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:38:05 user nova-compute[74189]: DEBUG os_brick.utils [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:38:05 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Updating existing volume attachment record: 49988cf6-fcbc-4890-95d7-635e13fbd228 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:38:06 user nova-compute[74189]: DEBUG nova.network.neutron [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Successfully created port: 092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0 {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:38:06 user nova-compute[74189]: DEBUG nova.network.neutron [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Successfully updated port: 092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0 {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:38:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "refresh_cache-337a8739-3f22-4a83-aa01-9ef8bae750cb" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:38:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquired lock "refresh_cache-337a8739-3f22-4a83-aa01-9ef8bae750cb" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:38:06 user nova-compute[74189]: DEBUG nova.network.neutron [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:38:06 user nova-compute[74189]: DEBUG nova.compute.manager [req-6ccde713-efd2-4bb8-a6a5-bfaf29af88c3 req-cac8f3bd-2076-4631-8681-a22b4dc6794a service nova] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Received event network-changed-092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:38:06 user nova-compute[74189]: DEBUG nova.compute.manager [req-6ccde713-efd2-4bb8-a6a5-bfaf29af88c3 req-cac8f3bd-2076-4631-8681-a22b4dc6794a service nova] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Refreshing instance network info cache due to event network-changed-092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:38:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-6ccde713-efd2-4bb8-a6a5-bfaf29af88c3 req-cac8f3bd-2076-4631-8681-a22b4dc6794a service nova] Acquiring lock "refresh_cache-337a8739-3f22-4a83-aa01-9ef8bae750cb" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:38:06 user nova-compute[74189]: DEBUG nova.network.neutron [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG nova.network.neutron [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Updating instance_info_cache with network_info: [{"id": "092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0", "address": "fa:16:3e:ad:51:10", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap092c0b44-09", "ovs_interfaceid": "092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Releasing lock "refresh_cache-337a8739-3f22-4a83-aa01-9ef8bae750cb" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG nova.compute.manager [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Instance network_info: |[{"id": "092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0", "address": "fa:16:3e:ad:51:10", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap092c0b44-09", "ovs_interfaceid": "092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-6ccde713-efd2-4bb8-a6a5-bfaf29af88c3 req-cac8f3bd-2076-4631-8681-a22b4dc6794a service nova] Acquired lock "refresh_cache-337a8739-3f22-4a83-aa01-9ef8bae750cb" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG nova.network.neutron [req-6ccde713-efd2-4bb8-a6a5-bfaf29af88c3 req-cac8f3bd-2076-4631-8681-a22b4dc6794a service nova] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Refreshing network info cache for port 092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:38:07 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8f61139d-d075-41d7-bd04-cc977ec87578 is timed out.
Oct 25 21:38:07 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Successfully detached device vdb from instance 8f61139d-d075-41d7-bd04-cc977ec87578 from the live domain config.
Oct 25 21:38:07 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQsvZGNl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:38:07 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:38:07 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fadf149-5367-49af-a776-323e91cda7ef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:38:07 user nova-compute[74189]: No targets found.
Oct 25 21:38:07 user nova-compute[74189]: iSNS:
Oct 25 21:38:07 user nova-compute[74189]: No targets found.
Oct 25 21:38:07 user nova-compute[74189]: STATIC:
Oct 25 21:38:07 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d
Oct 25 21:38:07 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:38:07 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:38:07 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c
Oct 25 21:38:07 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:38:07 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:38:07 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98
Oct 25 21:38:07 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:38:07 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:38:07 user nova-compute[74189]: FIRMWARE:
Oct 25 21:38:07 user nova-compute[74189]: No targets found.
Oct 25 21:38:07 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:38:07 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:38:07 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efcd9a3-402b-47e5-9204-86a4f0c11931]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e66939-c770-4a86-b05f-3d257bd0c29f]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c (non-flash)
Oct 25 21:38:07 user nova-compute[74189]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:38:07 user nova-compute[74189]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)
Oct 25 21:38:07 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c (non-flash)
Oct 25 21:38:07 user nova-compute[74189]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:38:07 user nova-compute[74189]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)
Oct 25 21:38:07 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2e422dd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c'): ({'sdb'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Removing single pathed devices sdb {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0464babf-7dde-40bf-8256-d07d113b5750]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c6abae-09df-4aa6-b605-9cb68643bebb]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Flushing IO for device /dev/sdb {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[517f2f0e-a53c-4a39-a589-42de93ab6066]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG nova.network.neutron [req-6ccde713-efd2-4bb8-a6a5-bfaf29af88c3 req-cac8f3bd-2076-4631-8681-a22b4dc6794a service nova] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Updated VIF entry in instance network info cache for port 092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG nova.network.neutron [req-6ccde713-efd2-4bb8-a6a5-bfaf29af88c3 req-cac8f3bd-2076-4631-8681-a22b4dc6794a service nova] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Updating instance_info_cache with network_info: [{"id": "092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0", "address": "fa:16:3e:ad:51:10", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap092c0b44-09", "ovs_interfaceid": "092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-6ccde713-efd2-4bb8-a6a5-bfaf29af88c3 req-cac8f3bd-2076-4631-8681-a22b4dc6794a service nova] Releasing lock "refresh_cache-337a8739-3f22-4a83-aa01-9ef8bae750cb" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c48640-63a6-40be-9cec-ae6f9e297053]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:38:07 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] SCSI volumes sdb have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:38:08 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:38:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:08 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c80664-79a6-4f88-821d-cb2283b0e0f4]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:38:08 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:38:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:08 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[05084b60-d2bc-436f-9440-3522bd98d31c]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:38:08 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c, portal: 172.16.0.220,3260]
Oct 25 21:38:08 user nova-compute[74189]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c, portal: 172.16.0.220,3260] successful.
Oct 25 21:38:08 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:38:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55bca833-cab5-4c4e-9ca0-dbffaa36867c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:08 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[021c0a60-2d60-4734-adc6-798ef5ff86c2]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:38:08 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:38:08 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:38:08 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] <== disconnect_volume: return (346ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:38:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:38:09 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:12 user nova-compute[74189]: DEBUG nova.objects.instance [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lazy-loading 'flavor' on Instance uuid 8f61139d-d075-41d7-bd04-cc977ec87578 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:38:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-cba85280-e95b-42e3-8d7d-91f509bf3b01 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "8f61139d-d075-41d7-bd04-cc977ec87578" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.444s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:38:12 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:38:12 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:38:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-3da14c0a-31a8-4fe3-bd5a-49378680af50" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:38:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-3da14c0a-31a8-4fe3-bd5a-49378680af50" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:38:12 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:38:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:13 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Updating instance_info_cache with network_info: [{"id": "a5e7898d-caba-49d7-8310-630beb75bf21", "address": "fa:16:3e:9d:7f:d0", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5e7898d-ca", "ovs_interfaceid": "a5e7898d-caba-49d7-8310-630beb75bf21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:38:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-3da14c0a-31a8-4fe3-bd5a-49378680af50" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:38:13 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:38:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:15 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:38:15 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:38:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:38:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:38:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:38:15 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:38:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:16 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:38:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f61139d-d075-41d7-bd04-cc977ec87578/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f61139d-d075-41d7-bd04-cc977ec87578/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f61139d-d075-41d7-bd04-cc977ec87578/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f61139d-d075-41d7-bd04-cc977ec87578/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:18 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:38:18 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:38:18 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:38:18 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=7914MB free_disk=25.012805938720703GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:38:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:38:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:38:18 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 932fe8ac-fdde-45c6-aa32-9bf866f19a4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:38:18 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:38:18 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3da14c0a-31a8-4fe3-bd5a-49378680af50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:38:18 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 8f61139d-d075-41d7-bd04-cc977ec87578 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:38:18 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 1926c2ce-9643-4d00-9f54-a6747e71875b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:38:18 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance dcb582a2-5198-44aa-bbe8-48978975e9eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:38:18 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance f1f19ee2-291f-4cc2-a7d9-db1874691e8e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:38:18 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 337a8739-3f22-4a83-aa01-9ef8bae750cb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:38:18 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:38:18 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:38:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:19 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:38:19 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:38:19 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:38:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.458s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:38:20 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:38:20 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:38:20 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:38:20 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:38:20 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:38:21 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:38:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:24 user nova-compute[74189]: DEBUG nova.compute.manager [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:38:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:38:24 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Creating image(s)
Oct 25 21:38:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Did not create local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 21:38:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Ensure instance console log exists: /opt/stack/data/nova/instances/337a8739-3f22-4a83-aa01-9ef8bae750cb/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:38:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:38:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:38:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:38:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Start _get_guest_xml network_info=[{"id": "092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0", "address": "fa:16:3e:ad:51:10", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap092c0b44-09", "ovs_interfaceid": "092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AhYutvnB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '337a8739-3f22-4a83-aa01-9ef8bae750cb', 'attached_at': '', 'detached_at': '', 'volume_id': '54cba2c9-a4fc-4720-91eb-2fa0ca198307', 'serial': '54cba2c9-a4fc-4720-91eb-2fa0ca198307'}, 'attachment_id': '49988cf6-fcbc-4890-95d7-635e13fbd228', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:38:24 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:38:24 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:38:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:38:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:38:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:38:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:38:24 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:38:24 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:38:24 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:38:24 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:38:24 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:38:24 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:38:24 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:38:24 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:38:24 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:38:24 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:38:24 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:38:24 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AhYutvnB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:38:25 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:38:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:38:25 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:38:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:38:25 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:38:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307 -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca254ea-398b-4203-b4f9-43cd358ecc73]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:38:25 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307 -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[799e5876-4f6a-4d81-8936-d5c7a2f65efd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307] added
Oct 25 21:38:25 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f43ae4-5187-4a04-a567-c30005135dbc]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7868dc6-7d02-4cf8-877e-1da4ffa5d47a]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AhYutvnB {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AhYutvnB" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6058705f-e17e-438b-b0c7-afe05e40d4ab]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AhYutvnB'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b2efff-1a56-4009-a95a-329bc808e1ba]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b13f70d-213c-48dd-9e06-05fa25b7736a]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:38:25 user nova-compute[74189]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)
Oct 25 21:38:25 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:38:25 user nova-compute[74189]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)
Oct 25 21:38:25 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307 -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[327b2426-d6a1-4548-b3d0-4f1cdf523aae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307, portal: 172.16.0.220,3260]
Oct 25 21:38:25 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307, portal: 172.16.0.220,3260] successful.
Oct 25 21:38:25 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9aa727-d5cf-49bd-8989-0665b320172a]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75a33fd-1192-4a47-a34f-04cd3f0b92b5]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:38:25 user nova-compute[74189]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)
Oct 25 21:38:25 user nova-compute[74189]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307 (non-flash)
Oct 25 21:38:25 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:38:25 user nova-compute[74189]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)
Oct 25 21:38:25 user nova-compute[74189]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307 (non-flash)
Oct 25 21:38:25 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[059eb339-136e-41ac-aeb4-7ccc826bb4e6]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:38:25 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:38:26 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:38:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AhYutvnB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:38:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:38:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23461333964383133', 'path': '/dev/sdb'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:38:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461333964383133', 'path': '/dev/sdb'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:38:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:38:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-348902433',display_name='tempest-TestVolumeBootPattern-server-348902433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-348902433',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbWjlurUdlTqM38TJIvyWArBvgtPS5ByZ7GvbbNhterPxeMByoQxHeDSj3q/FAwbfZCzxGnbhX1L/9RQ/CSBOb1BJ9rZaqesREBo++7UKa99YIwO5kH0uL2CiEzhHllXw==',key_name='tempest-TestVolumeBootPattern-16841960',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e893e8f3f58e4e15920d313b6391682c',ramdisk_id='',reservation_id='r-r1mk3tyx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1934687878',owner_user_name='tempest-TestVolumeBootPattern-1934687878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:38:05Z,user_data=None,user_id='77a27a7ebb4a458097c901871c378bc8',uuid=337a8739-3f22-4a83-aa01-9ef8bae750cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0", "address": "fa:16:3e:ad:51:10", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap092c0b44-09", "ovs_interfaceid": "092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:38:26 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converting VIF {"id": "092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0", "address": "fa:16:3e:ad:51:10", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap092c0b44-09", "ovs_interfaceid": "092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:38:26 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:51:10,bridge_name='br-int',has_traffic_filtering=True,id=092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap092c0b44-09') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:38:26 user nova-compute[74189]: DEBUG nova.objects.instance [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lazy-loading 'pci_devices' on Instance uuid 337a8739-3f22-4a83-aa01-9ef8bae750cb {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:38:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:38:26 user nova-compute[74189]:   <uuid>337a8739-3f22-4a83-aa01-9ef8bae750cb</uuid>
Oct 25 21:38:26 user nova-compute[74189]:   <name>instance-00000029</name>
Oct 25 21:38:26 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:38:26 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:38:26 user nova-compute[74189]:   <metadata>
Oct 25 21:38:26 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:38:26 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:38:26 user nova-compute[74189]:       <nova:name>tempest-TestVolumeBootPattern-server-348902433</nova:name>
Oct 25 21:38:26 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:38:24</nova:creationTime>
Oct 25 21:38:26 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:38:26 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:38:26 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:38:26 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:38:26 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:38:26 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:38:26 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:38:26 user nova-compute[74189]:       <nova:owner>
Oct 25 21:38:26 user nova-compute[74189]:         <nova:user uuid="77a27a7ebb4a458097c901871c378bc8">tempest-TestVolumeBootPattern-1934687878-project-member</nova:user>
Oct 25 21:38:26 user nova-compute[74189]:         <nova:project uuid="e893e8f3f58e4e15920d313b6391682c">tempest-TestVolumeBootPattern-1934687878</nova:project>
Oct 25 21:38:26 user nova-compute[74189]:       </nova:owner>
Oct 25 21:38:26 user nova-compute[74189]:       <nova:ports>
Oct 25 21:38:26 user nova-compute[74189]:         <nova:port uuid="092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0">
Oct 25 21:38:26 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 25 21:38:26 user nova-compute[74189]:         </nova:port>
Oct 25 21:38:26 user nova-compute[74189]:       </nova:ports>
Oct 25 21:38:26 user nova-compute[74189]:     </nova:instance>
Oct 25 21:38:26 user nova-compute[74189]:   </metadata>
Oct 25 21:38:26 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:38:26 user nova-compute[74189]:     <system>
Oct 25 21:38:26 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:38:26 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:38:26 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:38:26 user nova-compute[74189]:       <entry name="serial">337a8739-3f22-4a83-aa01-9ef8bae750cb</entry>
Oct 25 21:38:26 user nova-compute[74189]:       <entry name="uuid">337a8739-3f22-4a83-aa01-9ef8bae750cb</entry>
Oct 25 21:38:26 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:38:26 user nova-compute[74189]:     </system>
Oct 25 21:38:26 user nova-compute[74189]:   </sysinfo>
Oct 25 21:38:26 user nova-compute[74189]:   <os>
Oct 25 21:38:26 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:38:26 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:38:26 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:38:26 user nova-compute[74189]:   </os>
Oct 25 21:38:26 user nova-compute[74189]:   <features>
Oct 25 21:38:26 user nova-compute[74189]:     <acpi/>
Oct 25 21:38:26 user nova-compute[74189]:     <apic/>
Oct 25 21:38:26 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:38:26 user nova-compute[74189]:   </features>
Oct 25 21:38:26 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:38:26 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:38:26 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:38:26 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:38:26 user nova-compute[74189]:   </clock>
Oct 25 21:38:26 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:38:26 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:38:26 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:38:26 user nova-compute[74189]:   </cpu>
Oct 25 21:38:26 user nova-compute[74189]:   <devices>
Oct 25 21:38:26 user nova-compute[74189]:     <disk type="block" device="disk">
Oct 25 21:38:26 user nova-compute[74189]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:38:26 user nova-compute[74189]:       <source dev="/dev/sdb"/>
Oct 25 21:38:26 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:38:26 user nova-compute[74189]:       <serial>54cba2c9-a4fc-4720-91eb-2fa0ca198307</serial>
Oct 25 21:38:26 user nova-compute[74189]:     </disk>
Oct 25 21:38:26 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:38:26 user nova-compute[74189]:       <mac address="fa:16:3e:ad:51:10"/>
Oct 25 21:38:26 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:38:26 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:38:26 user nova-compute[74189]:       <target dev="tap092c0b44-09"/>
Oct 25 21:38:26 user nova-compute[74189]:     </interface>
Oct 25 21:38:26 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:38:26 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/337a8739-3f22-4a83-aa01-9ef8bae750cb/console.log" append="off"/>
Oct 25 21:38:26 user nova-compute[74189]:     </serial>
Oct 25 21:38:26 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:38:26 user nova-compute[74189]:     <video>
Oct 25 21:38:26 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:38:26 user nova-compute[74189]:     </video>
Oct 25 21:38:26 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:38:26 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:38:26 user nova-compute[74189]:     </rng>
Oct 25 21:38:26 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:38:26 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:38:26 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:38:26 user nova-compute[74189]:     </memballoon>
Oct 25 21:38:26 user nova-compute[74189]:   </devices>
Oct 25 21:38:26 user nova-compute[74189]: </domain>
Oct 25 21:38:26 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:38:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:38:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-348902433',display_name='tempest-TestVolumeBootPattern-server-348902433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-348902433',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbWjlurUdlTqM38TJIvyWArBvgtPS5ByZ7GvbbNhterPxeMByoQxHeDSj3q/FAwbfZCzxGnbhX1L/9RQ/CSBOb1BJ9rZaqesREBo++7UKa99YIwO5kH0uL2CiEzhHllXw==',key_name='tempest-TestVolumeBootPattern-16841960',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e893e8f3f58e4e15920d313b6391682c',ramdisk_id='',reservation_id='r-r1mk3tyx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1934687878',owner_user_name='tempest-TestVolumeBootPattern-1934687878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:38:05Z,user_data=None,user_id='77a27a7ebb4a458097c901871c378bc8',uuid=337a8739-3f22-4a83-aa01-9ef8bae750cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0", "address": "fa:16:3e:ad:51:10", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap092c0b44-09", "ovs_interfaceid": "092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:38:26 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converting VIF {"id": "092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0", "address": "fa:16:3e:ad:51:10", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap092c0b44-09", "ovs_interfaceid": "092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:38:26 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:51:10,bridge_name='br-int',has_traffic_filtering=True,id=092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap092c0b44-09') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:38:26 user nova-compute[74189]: DEBUG os_vif [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:51:10,bridge_name='br-int',has_traffic_filtering=True,id=092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap092c0b44-09') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:38:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:38:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:38:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ba77b8b-d062-5714-bd47-7afce05bc7e4', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:38:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:38:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap092c0b44-09, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:38:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap092c0b44-09, col_values=(('qos', UUID('711ff568-bc8c-4d87-820a-4c5458ad7d27')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:38:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap092c0b44-09, col_values=(('external_ids', {'iface-id': '092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:51:10', 'vm-uuid': '337a8739-3f22-4a83-aa01-9ef8bae750cb'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:38:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:38:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:26 user nova-compute[74189]: INFO os_vif [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:51:10,bridge_name='br-int',has_traffic_filtering=True,id=092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap092c0b44-09')
Oct 25 21:38:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:38:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] No VIF found with MAC fa:16:3e:ad:51:10, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:38:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-6a3fc46f-f9cf-447c-af0e-fee6de1b53cd req-c328db70-2cae-4a94-9f03-616f204d263c service nova] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Received event network-vif-plugged-092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:38:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-6a3fc46f-f9cf-447c-af0e-fee6de1b53cd req-c328db70-2cae-4a94-9f03-616f204d263c service nova] Acquiring lock "337a8739-3f22-4a83-aa01-9ef8bae750cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:38:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-6a3fc46f-f9cf-447c-af0e-fee6de1b53cd req-c328db70-2cae-4a94-9f03-616f204d263c service nova] Lock "337a8739-3f22-4a83-aa01-9ef8bae750cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:38:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-6a3fc46f-f9cf-447c-af0e-fee6de1b53cd req-c328db70-2cae-4a94-9f03-616f204d263c service nova] Lock "337a8739-3f22-4a83-aa01-9ef8bae750cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:38:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-6a3fc46f-f9cf-447c-af0e-fee6de1b53cd req-c328db70-2cae-4a94-9f03-616f204d263c service nova] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] No waiting events found dispatching network-vif-plugged-092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:38:27 user nova-compute[74189]: WARNING nova.compute.manager [req-6a3fc46f-f9cf-447c-af0e-fee6de1b53cd req-c328db70-2cae-4a94-9f03-616f204d263c service nova] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Received unexpected event network-vif-plugged-092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0 for instance with vm_state building and task_state spawning.
Oct 25 21:38:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:29 user nova-compute[74189]: DEBUG nova.compute.manager [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:38:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:38:29 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Instance spawned successfully.
Oct 25 21:38:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:38:30 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:38:30 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:38:30 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:38:30 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:38:30 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:38:30 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:38:30 user nova-compute[74189]: DEBUG nova.compute.manager [req-7ba6216d-51e8-4168-9071-34121db534b6 req-6d0d9bea-0bd8-4983-bfb8-0ca1388a3356 service nova] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Received event network-vif-plugged-092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:38:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7ba6216d-51e8-4168-9071-34121db534b6 req-6d0d9bea-0bd8-4983-bfb8-0ca1388a3356 service nova] Acquiring lock "337a8739-3f22-4a83-aa01-9ef8bae750cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:38:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7ba6216d-51e8-4168-9071-34121db534b6 req-6d0d9bea-0bd8-4983-bfb8-0ca1388a3356 service nova] Lock "337a8739-3f22-4a83-aa01-9ef8bae750cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:38:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7ba6216d-51e8-4168-9071-34121db534b6 req-6d0d9bea-0bd8-4983-bfb8-0ca1388a3356 service nova] Lock "337a8739-3f22-4a83-aa01-9ef8bae750cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:38:30 user nova-compute[74189]: DEBUG nova.compute.manager [req-7ba6216d-51e8-4168-9071-34121db534b6 req-6d0d9bea-0bd8-4983-bfb8-0ca1388a3356 service nova] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] No waiting events found dispatching network-vif-plugged-092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:38:30 user nova-compute[74189]: WARNING nova.compute.manager [req-7ba6216d-51e8-4168-9071-34121db534b6 req-6d0d9bea-0bd8-4983-bfb8-0ca1388a3356 service nova] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Received unexpected event network-vif-plugged-092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0 for instance with vm_state building and task_state spawning.
Oct 25 21:38:30 user nova-compute[74189]: INFO nova.compute.manager [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Took 5.14 seconds to spawn the instance on the hypervisor.
Oct 25 21:38:30 user nova-compute[74189]: DEBUG nova.compute.manager [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:38:30 user nova-compute[74189]: INFO nova.compute.manager [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Took 25.51 seconds to build instance.
Oct 25 21:38:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-7dd7c2d2-b7a6-4e24-b05f-82124da36508 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "337a8739-3f22-4a83-aa01-9ef8bae750cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.619s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:38:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:38:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ae21889f-eeb2-493f-8122-b592a7f6fcf2 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:38:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ae21889f-eeb2-493f-8122-b592a7f6fcf2 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:38:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ae21889f-eeb2-493f-8122-b592a7f6fcf2 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:38:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ae21889f-eeb2-493f-8122-b592a7f6fcf2 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:38:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ae21889f-eeb2-493f-8122-b592a7f6fcf2 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:38:41 user nova-compute[74189]: INFO nova.compute.manager [None req-ae21889f-eeb2-493f-8122-b592a7f6fcf2 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Terminating instance
Oct 25 21:38:41 user nova-compute[74189]: DEBUG nova.compute.manager [None req-ae21889f-eeb2-493f-8122-b592a7f6fcf2 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:38:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:38:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:41 user nova-compute[74189]: DEBUG nova.compute.manager [req-7392f1a5-020d-4ca0-b951-c7d8b700775f req-382dd90d-69fe-4e0d-8078-42fdb65143d8 service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Received event network-vif-unplugged-b460e41a-4e06-48e4-80b4-b551c718126e {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:38:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7392f1a5-020d-4ca0-b951-c7d8b700775f req-382dd90d-69fe-4e0d-8078-42fdb65143d8 service nova] Acquiring lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:38:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7392f1a5-020d-4ca0-b951-c7d8b700775f req-382dd90d-69fe-4e0d-8078-42fdb65143d8 service nova] Lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:38:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7392f1a5-020d-4ca0-b951-c7d8b700775f req-382dd90d-69fe-4e0d-8078-42fdb65143d8 service nova] Lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:38:41 user nova-compute[74189]: DEBUG nova.compute.manager [req-7392f1a5-020d-4ca0-b951-c7d8b700775f req-382dd90d-69fe-4e0d-8078-42fdb65143d8 service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] No waiting events found dispatching network-vif-unplugged-b460e41a-4e06-48e4-80b4-b551c718126e {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:38:41 user nova-compute[74189]: DEBUG nova.compute.manager [req-7392f1a5-020d-4ca0-b951-c7d8b700775f req-382dd90d-69fe-4e0d-8078-42fdb65143d8 service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Received event network-vif-unplugged-b460e41a-4e06-48e4-80b4-b551c718126e for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:38:42 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Instance destroyed successfully.
Oct 25 21:38:42 user nova-compute[74189]: DEBUG nova.objects.instance [None req-ae21889f-eeb2-493f-8122-b592a7f6fcf2 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lazy-loading 'resources' on Instance uuid f1f19ee2-291f-4cc2-a7d9-db1874691e8e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:38:42 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-ae21889f-eeb2-493f-8122-b592a7f6fcf2 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T21:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-904043964',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-904043964',id=36,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDW8eZT8GP9FUTvkiTAgfGM4YmLWdp9/wvP9KJIr8BZ+VLv1ILm27EcVk7KzOgSldLDctcon+WPQZKUJOQ92ZAvyIXAKSBaSECwOXFFIt1GsdvKN8JqtBdn79vB0QfIe+w==',key_name='tempest-keypair-1324843434',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:37:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e45f8868c6a04e31ad1617ee6e9438a2',ramdisk_id='',reservation_id='r-sk1uqinq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-846255404',owner_user_name='tempest-AttachVolumeShelveTestJSON-846255404-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:37:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6fb9b5c36f049c1af4ae44e11267264',uuid=f1f19ee2-291f-4cc2-a7d9-db1874691e8e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b460e41a-4e06-48e4-80b4-b551c718126e", "address": "fa:16:3e:4c:f4:6b", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb460e41a-4e", "ovs_interfaceid": "b460e41a-4e06-48e4-80b4-b551c718126e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:38:42 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-ae21889f-eeb2-493f-8122-b592a7f6fcf2 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Converting VIF {"id": "b460e41a-4e06-48e4-80b4-b551c718126e", "address": "fa:16:3e:4c:f4:6b", "network": {"id": "09d8bdf6-f255-479c-aa38-55d468abf1fc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-389121216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45f8868c6a04e31ad1617ee6e9438a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb460e41a-4e", "ovs_interfaceid": "b460e41a-4e06-48e4-80b4-b551c718126e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:38:42 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-ae21889f-eeb2-493f-8122-b592a7f6fcf2 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:6b,bridge_name='br-int',has_traffic_filtering=True,id=b460e41a-4e06-48e4-80b4-b551c718126e,network=Network(09d8bdf6-f255-479c-aa38-55d468abf1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb460e41a-4e') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:38:42 user nova-compute[74189]: DEBUG os_vif [None req-ae21889f-eeb2-493f-8122-b592a7f6fcf2 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:6b,bridge_name='br-int',has_traffic_filtering=True,id=b460e41a-4e06-48e4-80b4-b551c718126e,network=Network(09d8bdf6-f255-479c-aa38-55d468abf1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb460e41a-4e') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:38:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb460e41a-4e, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:38:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:38:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=893d6764-77f5-448d-8738-95755955150e) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:38:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:38:42 user nova-compute[74189]: INFO os_vif [None req-ae21889f-eeb2-493f-8122-b592a7f6fcf2 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:6b,bridge_name='br-int',has_traffic_filtering=True,id=b460e41a-4e06-48e4-80b4-b551c718126e,network=Network(09d8bdf6-f255-479c-aa38-55d468abf1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb460e41a-4e')
Oct 25 21:38:42 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-ae21889f-eeb2-493f-8122-b592a7f6fcf2 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Deleting instance files /opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e_del
Oct 25 21:38:42 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-ae21889f-eeb2-493f-8122-b592a7f6fcf2 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Deletion of /opt/stack/data/nova/instances/f1f19ee2-291f-4cc2-a7d9-db1874691e8e_del complete
Oct 25 21:38:42 user nova-compute[74189]: INFO nova.compute.manager [None req-ae21889f-eeb2-493f-8122-b592a7f6fcf2 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Took 0.96 seconds to destroy the instance on the hypervisor.
Oct 25 21:38:42 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-ae21889f-eeb2-493f-8122-b592a7f6fcf2 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:38:42 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:38:42 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:38:43 user nova-compute[74189]: DEBUG nova.compute.manager [req-b61a9a05-0ffa-4197-aa2a-dd3ad700ab0e req-962213e0-33a2-48ec-80f8-7d9887ffa10a service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Received event network-vif-plugged-b460e41a-4e06-48e4-80b4-b551c718126e {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:38:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b61a9a05-0ffa-4197-aa2a-dd3ad700ab0e req-962213e0-33a2-48ec-80f8-7d9887ffa10a service nova] Acquiring lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:38:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b61a9a05-0ffa-4197-aa2a-dd3ad700ab0e req-962213e0-33a2-48ec-80f8-7d9887ffa10a service nova] Lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:38:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-b61a9a05-0ffa-4197-aa2a-dd3ad700ab0e req-962213e0-33a2-48ec-80f8-7d9887ffa10a service nova] Lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:38:43 user nova-compute[74189]: DEBUG nova.compute.manager [req-b61a9a05-0ffa-4197-aa2a-dd3ad700ab0e req-962213e0-33a2-48ec-80f8-7d9887ffa10a service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] No waiting events found dispatching network-vif-plugged-b460e41a-4e06-48e4-80b4-b551c718126e {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:38:43 user nova-compute[74189]: WARNING nova.compute.manager [req-b61a9a05-0ffa-4197-aa2a-dd3ad700ab0e req-962213e0-33a2-48ec-80f8-7d9887ffa10a service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Received unexpected event network-vif-plugged-b460e41a-4e06-48e4-80b4-b551c718126e for instance with vm_state active and task_state deleting.
Oct 25 21:38:43 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:38:43 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Took 1.49 seconds to deallocate network for instance.
Oct 25 21:38:43 user nova-compute[74189]: DEBUG nova.compute.manager [req-2fd38559-a9f5-46f8-ba2d-71f0cceb3a3b req-5fd9fdab-1194-4850-a59e-7043aa6cb6ab service nova] [instance: f1f19ee2-291f-4cc2-a7d9-db1874691e8e] Received event network-vif-deleted-b460e41a-4e06-48e4-80b4-b551c718126e {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:38:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ae21889f-eeb2-493f-8122-b592a7f6fcf2 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:38:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ae21889f-eeb2-493f-8122-b592a7f6fcf2 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:38:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:44 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-ae21889f-eeb2-493f-8122-b592a7f6fcf2 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:38:44 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-ae21889f-eeb2-493f-8122-b592a7f6fcf2 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:38:44 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ae21889f-eeb2-493f-8122-b592a7f6fcf2 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.316s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:38:44 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-ae21889f-eeb2-493f-8122-b592a7f6fcf2 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Deleted allocations for instance f1f19ee2-291f-4cc2-a7d9-db1874691e8e
Oct 25 21:38:44 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ae21889f-eeb2-493f-8122-b592a7f6fcf2 tempest-AttachVolumeShelveTestJSON-846255404 tempest-AttachVolumeShelveTestJSON-846255404-project-member] Lock "f1f19ee2-291f-4cc2-a7d9-db1874691e8e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.972s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:38:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:48 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6ecb93ad-a18e-4441-94f5-b00d2f5ac383 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "8f61139d-d075-41d7-bd04-cc977ec87578" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:38:48 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6ecb93ad-a18e-4441-94f5-b00d2f5ac383 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "8f61139d-d075-41d7-bd04-cc977ec87578" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:38:48 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6ecb93ad-a18e-4441-94f5-b00d2f5ac383 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "8f61139d-d075-41d7-bd04-cc977ec87578-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:38:48 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6ecb93ad-a18e-4441-94f5-b00d2f5ac383 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "8f61139d-d075-41d7-bd04-cc977ec87578-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:38:48 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6ecb93ad-a18e-4441-94f5-b00d2f5ac383 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "8f61139d-d075-41d7-bd04-cc977ec87578-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:38:48 user nova-compute[74189]: INFO nova.compute.manager [None req-6ecb93ad-a18e-4441-94f5-b00d2f5ac383 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Terminating instance
Oct 25 21:38:48 user nova-compute[74189]: DEBUG nova.compute.manager [None req-6ecb93ad-a18e-4441-94f5-b00d2f5ac383 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:38:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:49 user nova-compute[74189]: DEBUG nova.compute.manager [req-780c770b-320e-4f05-b902-0d66ddf5cf80 req-1a10b7f4-b2b1-4e7e-8d5a-1b73682b4cd5 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Received event network-vif-unplugged-83f7d737-3cbc-4a68-8f5f-da99acae2d42 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:38:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-780c770b-320e-4f05-b902-0d66ddf5cf80 req-1a10b7f4-b2b1-4e7e-8d5a-1b73682b4cd5 service nova] Acquiring lock "8f61139d-d075-41d7-bd04-cc977ec87578-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:38:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-780c770b-320e-4f05-b902-0d66ddf5cf80 req-1a10b7f4-b2b1-4e7e-8d5a-1b73682b4cd5 service nova] Lock "8f61139d-d075-41d7-bd04-cc977ec87578-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:38:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-780c770b-320e-4f05-b902-0d66ddf5cf80 req-1a10b7f4-b2b1-4e7e-8d5a-1b73682b4cd5 service nova] Lock "8f61139d-d075-41d7-bd04-cc977ec87578-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:38:49 user nova-compute[74189]: DEBUG nova.compute.manager [req-780c770b-320e-4f05-b902-0d66ddf5cf80 req-1a10b7f4-b2b1-4e7e-8d5a-1b73682b4cd5 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] No waiting events found dispatching network-vif-unplugged-83f7d737-3cbc-4a68-8f5f-da99acae2d42 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:38:49 user nova-compute[74189]: DEBUG nova.compute.manager [req-780c770b-320e-4f05-b902-0d66ddf5cf80 req-1a10b7f4-b2b1-4e7e-8d5a-1b73682b4cd5 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Received event network-vif-unplugged-83f7d737-3cbc-4a68-8f5f-da99acae2d42 for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:38:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:49 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Instance destroyed successfully.
Oct 25 21:38:49 user nova-compute[74189]: DEBUG nova.objects.instance [None req-6ecb93ad-a18e-4441-94f5-b00d2f5ac383 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lazy-loading 'resources' on Instance uuid 8f61139d-d075-41d7-bd04-cc977ec87578 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:38:49 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-6ecb93ad-a18e-4441-94f5-b00d2f5ac383 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:33:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1184132038',display_name='tempest-TestMinimumBasicScenario-server-1184132038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1184132038',id=38,image_ref='edd168b8-e584-4508-a289-5067f7a9a84f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFABeGb2eW9FWXwpk7mHuxZn/QzdpuTanR0gI8CR6makjXS81iGEmSQVwyQe8yttiTuvjVGFiCkhwTeUstfZnfc30mXENFXNpKYGkEYJZDpv7vYHE8TIrHRK8ElvlDxug==',key_name='tempest-TestMinimumBasicScenario-1999727037',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:33:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ee1339c959b4cbebeefd550fc436c61',ramdisk_id='',reservation_id='r-6y278z7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='edd168b8-e584-4508-a289-5067f7a9a84f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1857244532',owner_user_name='tempest-TestMinimumBasicScenario-1857244532-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:36:01Z,user_data=None,user_id='a829dcf4095d45ab868a0ea904e9bfce',uuid=8f61139d-d075-41d7-bd04-cc977ec87578,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83f7d737-3cbc-4a68-8f5f-da99acae2d42", "address": "fa:16:3e:f8:7c:39", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f7d737-3c", "ovs_interfaceid": "83f7d737-3cbc-4a68-8f5f-da99acae2d42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:38:49 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-6ecb93ad-a18e-4441-94f5-b00d2f5ac383 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Converting VIF {"id": "83f7d737-3cbc-4a68-8f5f-da99acae2d42", "address": "fa:16:3e:f8:7c:39", "network": {"id": "d0eb2495-d624-4f66-91a4-2d97b9461a19", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1682476311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ee1339c959b4cbebeefd550fc436c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f7d737-3c", "ovs_interfaceid": "83f7d737-3cbc-4a68-8f5f-da99acae2d42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:38:49 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-6ecb93ad-a18e-4441-94f5-b00d2f5ac383 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:7c:39,bridge_name='br-int',has_traffic_filtering=True,id=83f7d737-3cbc-4a68-8f5f-da99acae2d42,network=Network(d0eb2495-d624-4f66-91a4-2d97b9461a19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83f7d737-3c') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:38:49 user nova-compute[74189]: DEBUG os_vif [None req-6ecb93ad-a18e-4441-94f5-b00d2f5ac383 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:7c:39,bridge_name='br-int',has_traffic_filtering=True,id=83f7d737-3cbc-4a68-8f5f-da99acae2d42,network=Network(d0eb2495-d624-4f66-91a4-2d97b9461a19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83f7d737-3c') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:38:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83f7d737-3c, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:38:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:38:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=98dea269-9938-4097-bd24-0457f0f288c8) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:38:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:49 user nova-compute[74189]: INFO os_vif [None req-6ecb93ad-a18e-4441-94f5-b00d2f5ac383 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:7c:39,bridge_name='br-int',has_traffic_filtering=True,id=83f7d737-3cbc-4a68-8f5f-da99acae2d42,network=Network(d0eb2495-d624-4f66-91a4-2d97b9461a19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83f7d737-3c')
Oct 25 21:38:49 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-6ecb93ad-a18e-4441-94f5-b00d2f5ac383 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Deleting instance files /opt/stack/data/nova/instances/8f61139d-d075-41d7-bd04-cc977ec87578_del
Oct 25 21:38:49 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-6ecb93ad-a18e-4441-94f5-b00d2f5ac383 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Deletion of /opt/stack/data/nova/instances/8f61139d-d075-41d7-bd04-cc977ec87578_del complete
Oct 25 21:38:49 user nova-compute[74189]: INFO nova.compute.manager [None req-6ecb93ad-a18e-4441-94f5-b00d2f5ac383 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 25 21:38:49 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-6ecb93ad-a18e-4441-94f5-b00d2f5ac383 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:38:49 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:38:49 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:38:49 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:38:49 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Took 0.55 seconds to deallocate network for instance.
Oct 25 21:38:49 user nova-compute[74189]: DEBUG nova.compute.manager [req-04fbcdd2-cc86-4149-a2ae-6708461dce81 req-d79a659a-b2a6-4b6e-8df1-f15ef7c14bca service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Received event network-vif-deleted-83f7d737-3cbc-4a68-8f5f-da99acae2d42 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:38:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6ecb93ad-a18e-4441-94f5-b00d2f5ac383 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:38:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6ecb93ad-a18e-4441-94f5-b00d2f5ac383 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:38:50 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-6ecb93ad-a18e-4441-94f5-b00d2f5ac383 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:38:50 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-6ecb93ad-a18e-4441-94f5-b00d2f5ac383 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:38:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6ecb93ad-a18e-4441-94f5-b00d2f5ac383 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:38:50 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-6ecb93ad-a18e-4441-94f5-b00d2f5ac383 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Deleted allocations for instance 8f61139d-d075-41d7-bd04-cc977ec87578
Oct 25 21:38:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6ecb93ad-a18e-4441-94f5-b00d2f5ac383 tempest-TestMinimumBasicScenario-1857244532 tempest-TestMinimumBasicScenario-1857244532-project-member] Lock "8f61139d-d075-41d7-bd04-cc977ec87578" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.097s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:38:51 user nova-compute[74189]: DEBUG nova.compute.manager [req-de8f1e1d-c4b8-40d7-b76a-fd0120fd7e69 req-74fadab1-dc36-4ef1-832d-d3d76de6c5d1 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Received event network-vif-plugged-83f7d737-3cbc-4a68-8f5f-da99acae2d42 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:38:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-de8f1e1d-c4b8-40d7-b76a-fd0120fd7e69 req-74fadab1-dc36-4ef1-832d-d3d76de6c5d1 service nova] Acquiring lock "8f61139d-d075-41d7-bd04-cc977ec87578-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:38:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-de8f1e1d-c4b8-40d7-b76a-fd0120fd7e69 req-74fadab1-dc36-4ef1-832d-d3d76de6c5d1 service nova] Lock "8f61139d-d075-41d7-bd04-cc977ec87578-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:38:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-de8f1e1d-c4b8-40d7-b76a-fd0120fd7e69 req-74fadab1-dc36-4ef1-832d-d3d76de6c5d1 service nova] Lock "8f61139d-d075-41d7-bd04-cc977ec87578-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:38:51 user nova-compute[74189]: DEBUG nova.compute.manager [req-de8f1e1d-c4b8-40d7-b76a-fd0120fd7e69 req-74fadab1-dc36-4ef1-832d-d3d76de6c5d1 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] No waiting events found dispatching network-vif-plugged-83f7d737-3cbc-4a68-8f5f-da99acae2d42 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:38:51 user nova-compute[74189]: WARNING nova.compute.manager [req-de8f1e1d-c4b8-40d7-b76a-fd0120fd7e69 req-74fadab1-dc36-4ef1-832d-d3d76de6c5d1 service nova] [instance: 8f61139d-d075-41d7-bd04-cc977ec87578] Received unexpected event network-vif-plugged-83f7d737-3cbc-4a68-8f5f-da99acae2d42 for instance with vm_state deleted and task_state None.
Oct 25 21:38:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:38:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:09 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:12 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:39:12 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:39:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-1926c2ce-9643-4d00-9f54-a6747e71875b" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:39:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-1926c2ce-9643-4d00-9f54-a6747e71875b" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:39:13 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:39:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:13 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Updating instance_info_cache with network_info: [{"id": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "address": "fa:16:3e:6e:2f:0e", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d26f4c0-28", "ovs_interfaceid": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:39:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-1926c2ce-9643-4d00-9f54-a6747e71875b" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:39:13 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:39:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:15 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:39:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:39:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:39:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:39:15 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:39:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:39:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:39:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:39:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:39:16 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:39:16 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:39:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:39:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:39:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:39:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:39:16 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:39:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:39:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:39:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:39:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:39:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:39:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:39:17 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:39:17 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:39:18 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:39:18 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:39:18 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=8014MB free_disk=25.055896759033203GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:39:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:39:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:39:18 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 932fe8ac-fdde-45c6-aa32-9bf866f19a4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:39:18 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:39:18 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3da14c0a-31a8-4fe3-bd5a-49378680af50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:39:18 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 1926c2ce-9643-4d00-9f54-a6747e71875b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:39:18 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance dcb582a2-5198-44aa-bbe8-48978975e9eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:39:18 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 337a8739-3f22-4a83-aa01-9ef8bae750cb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:39:18 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:39:18 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:39:18 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:39:18 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:39:18 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:39:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.410s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:39:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:19 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:39:19 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:39:19 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:39:19 user nova-compute[74189]: INFO nova.compute.manager [None req-66792d9d-19d7-4443-9bfe-dfef4b580435 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Get console output
Oct 25 21:39:19 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:39:19 user nova-compute[74189]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Oct 25 21:39:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:20 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:39:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:22 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:39:22 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:39:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:27 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:39:27 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:39:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Acquiring lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:39:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:39:31 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:39:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:39:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:39:31 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:39:31 user nova-compute[74189]: INFO nova.compute.claims [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Claim successful on node user
Oct 25 21:39:31 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:39:31 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:39:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.339s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:39:31 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:39:31 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:39:31 user nova-compute[74189]: DEBUG nova.network.neutron [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:39:31 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:39:31 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:39:32 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:39:32 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:39:32 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Creating image(s)
Oct 25 21:39:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa2b9013-4a8b-4f8d-a5dc-42842cd987a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:39:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "/opt/stack/data/nova/instances/aa2b9013-4a8b-4f8d-a5dc-42842cd987a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:39:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "/opt/stack/data/nova/instances/aa2b9013-4a8b-4f8d-a5dc-42842cd987a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:39:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:39:32 user nova-compute[74189]: DEBUG nova.policy [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd969f9eb4da9460bac75c7c54c3d27d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd14dac60ad462fbaafc984745a06df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:39:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.187s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:39:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:39:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:39:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:39:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.197s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:39:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/aa2b9013-4a8b-4f8d-a5dc-42842cd987a7/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:39:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/aa2b9013-4a8b-4f8d-a5dc-42842cd987a7/disk 1073741824" returned: 0 in 0.059s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:39:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:39:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:39:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.198s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:39:32 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa2b9013-4a8b-4f8d-a5dc-42842cd987a7/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:39:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2b9013-4a8b-4f8d-a5dc-42842cd987a7/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:39:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2b9013-4a8b-4f8d-a5dc-42842cd987a7/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:39:33 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Cannot resize image /opt/stack/data/nova/instances/aa2b9013-4a8b-4f8d-a5dc-42842cd987a7/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:39:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:39:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Ensure instance console log exists: /opt/stack/data/nova/instances/aa2b9013-4a8b-4f8d-a5dc-42842cd987a7/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:39:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:39:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:39:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:39:33 user nova-compute[74189]: DEBUG nova.network.neutron [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Successfully created port: af0547c4-bcad-40cb-9183-e3fd84c1c8fb {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.network.neutron [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Successfully updated port: af0547c4-bcad-40cb-9183-e3fd84c1c8fb {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Acquiring lock "refresh_cache-aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Acquired lock "refresh_cache-aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.network.neutron [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.compute.manager [req-d6b28ea6-d485-423b-92ea-18fdc277b4aa req-b92b50c4-215c-481b-9013-fd1e17717729 service nova] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Received event network-changed-af0547c4-bcad-40cb-9183-e3fd84c1c8fb {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.compute.manager [req-d6b28ea6-d485-423b-92ea-18fdc277b4aa req-b92b50c4-215c-481b-9013-fd1e17717729 service nova] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Refreshing instance network info cache due to event network-changed-af0547c4-bcad-40cb-9183-e3fd84c1c8fb. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d6b28ea6-d485-423b-92ea-18fdc277b4aa req-b92b50c4-215c-481b-9013-fd1e17717729 service nova] Acquiring lock "refresh_cache-aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.network.neutron [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.network.neutron [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Updating instance_info_cache with network_info: [{"id": "af0547c4-bcad-40cb-9183-e3fd84c1c8fb", "address": "fa:16:3e:17:71:69", "network": {"id": "351bf1c4-8784-41c0-8b68-a939f493bc5a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1840723104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fd14dac60ad462fbaafc984745a06df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0547c4-bc", "ovs_interfaceid": "af0547c4-bcad-40cb-9183-e3fd84c1c8fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Releasing lock "refresh_cache-aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Instance network_info: |[{"id": "af0547c4-bcad-40cb-9183-e3fd84c1c8fb", "address": "fa:16:3e:17:71:69", "network": {"id": "351bf1c4-8784-41c0-8b68-a939f493bc5a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1840723104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fd14dac60ad462fbaafc984745a06df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0547c4-bc", "ovs_interfaceid": "af0547c4-bcad-40cb-9183-e3fd84c1c8fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d6b28ea6-d485-423b-92ea-18fdc277b4aa req-b92b50c4-215c-481b-9013-fd1e17717729 service nova] Acquired lock "refresh_cache-aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.network.neutron [req-d6b28ea6-d485-423b-92ea-18fdc277b4aa req-b92b50c4-215c-481b-9013-fd1e17717729 service nova] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Refreshing network info cache for port af0547c4-bcad-40cb-9183-e3fd84c1c8fb {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Start _get_guest_xml network_info=[{"id": "af0547c4-bcad-40cb-9183-e3fd84c1c8fb", "address": "fa:16:3e:17:71:69", "network": {"id": "351bf1c4-8784-41c0-8b68-a939f493bc5a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1840723104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fd14dac60ad462fbaafc984745a06df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0547c4-bc", "ovs_interfaceid": "af0547c4-bcad-40cb-9183-e3fd84c1c8fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:39:34 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:39:34 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:39:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1924991693',display_name='tempest-TestServerVolumeAttachmentScenario-server-1924991693',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1924991693',id=42,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJzy3QIcz8k3OVVIWxk7bFwWXBb8/E2yS9Xnh6AxVBze0e54/ByCoah9dg99Lso7vVuwyC2sd5GDnIv0CbCcQPalhmgtkQGD/cYZz84EY1lkZcZN0/eulifAfNtvBLgzZA==',key_name='tempest-keypair-1564393999',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fd14dac60ad462fbaafc984745a06df',ramdisk_id='',reservation_id='r-u1brobqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-661451565',owner_user_name='tempest-TestServerVolumeAttachmentScenario-661451565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:39:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d969f9eb4da9460bac75c7c54c3d27d9',uuid=aa2b9013-4a8b-4f8d-a5dc-42842cd987a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af0547c4-bcad-40cb-9183-e3fd84c1c8fb", "address": "fa:16:3e:17:71:69", "network": {"id": "351bf1c4-8784-41c0-8b68-a939f493bc5a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1840723104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fd14dac60ad462fbaafc984745a06df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0547c4-bc", "ovs_interfaceid": "af0547c4-bcad-40cb-9183-e3fd84c1c8fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Converting VIF {"id": "af0547c4-bcad-40cb-9183-e3fd84c1c8fb", "address": "fa:16:3e:17:71:69", "network": {"id": "351bf1c4-8784-41c0-8b68-a939f493bc5a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1840723104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fd14dac60ad462fbaafc984745a06df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0547c4-bc", "ovs_interfaceid": "af0547c4-bcad-40cb-9183-e3fd84c1c8fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:71:69,bridge_name='br-int',has_traffic_filtering=True,id=af0547c4-bcad-40cb-9183-e3fd84c1c8fb,network=Network(351bf1c4-8784-41c0-8b68-a939f493bc5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf0547c4-bc') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.objects.instance [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lazy-loading 'pci_devices' on Instance uuid aa2b9013-4a8b-4f8d-a5dc-42842cd987a7 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:39:34 user nova-compute[74189]:   <uuid>aa2b9013-4a8b-4f8d-a5dc-42842cd987a7</uuid>
Oct 25 21:39:34 user nova-compute[74189]:   <name>instance-0000002a</name>
Oct 25 21:39:34 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:39:34 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:39:34 user nova-compute[74189]:   <metadata>
Oct 25 21:39:34 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:39:34 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:39:34 user nova-compute[74189]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1924991693</nova:name>
Oct 25 21:39:34 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:39:34</nova:creationTime>
Oct 25 21:39:34 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:39:34 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:39:34 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:39:34 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:39:34 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:39:34 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:39:34 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:39:34 user nova-compute[74189]:       <nova:owner>
Oct 25 21:39:34 user nova-compute[74189]:         <nova:user uuid="d969f9eb4da9460bac75c7c54c3d27d9">tempest-TestServerVolumeAttachmentScenario-661451565-project-member</nova:user>
Oct 25 21:39:34 user nova-compute[74189]:         <nova:project uuid="3fd14dac60ad462fbaafc984745a06df">tempest-TestServerVolumeAttachmentScenario-661451565</nova:project>
Oct 25 21:39:34 user nova-compute[74189]:       </nova:owner>
Oct 25 21:39:34 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:39:34 user nova-compute[74189]:       <nova:ports>
Oct 25 21:39:34 user nova-compute[74189]:         <nova:port uuid="af0547c4-bcad-40cb-9183-e3fd84c1c8fb">
Oct 25 21:39:34 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 25 21:39:34 user nova-compute[74189]:         </nova:port>
Oct 25 21:39:34 user nova-compute[74189]:       </nova:ports>
Oct 25 21:39:34 user nova-compute[74189]:     </nova:instance>
Oct 25 21:39:34 user nova-compute[74189]:   </metadata>
Oct 25 21:39:34 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:39:34 user nova-compute[74189]:     <system>
Oct 25 21:39:34 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:39:34 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:39:34 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:39:34 user nova-compute[74189]:       <entry name="serial">aa2b9013-4a8b-4f8d-a5dc-42842cd987a7</entry>
Oct 25 21:39:34 user nova-compute[74189]:       <entry name="uuid">aa2b9013-4a8b-4f8d-a5dc-42842cd987a7</entry>
Oct 25 21:39:34 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:39:34 user nova-compute[74189]:     </system>
Oct 25 21:39:34 user nova-compute[74189]:   </sysinfo>
Oct 25 21:39:34 user nova-compute[74189]:   <os>
Oct 25 21:39:34 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:39:34 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:39:34 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:39:34 user nova-compute[74189]:   </os>
Oct 25 21:39:34 user nova-compute[74189]:   <features>
Oct 25 21:39:34 user nova-compute[74189]:     <acpi/>
Oct 25 21:39:34 user nova-compute[74189]:     <apic/>
Oct 25 21:39:34 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:39:34 user nova-compute[74189]:   </features>
Oct 25 21:39:34 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:39:34 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:39:34 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:39:34 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:39:34 user nova-compute[74189]:   </clock>
Oct 25 21:39:34 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:39:34 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:39:34 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:39:34 user nova-compute[74189]:   </cpu>
Oct 25 21:39:34 user nova-compute[74189]:   <devices>
Oct 25 21:39:34 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:39:34 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:39:34 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/aa2b9013-4a8b-4f8d-a5dc-42842cd987a7/disk"/>
Oct 25 21:39:34 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:39:34 user nova-compute[74189]:     </disk>
Oct 25 21:39:34 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:39:34 user nova-compute[74189]:       <mac address="fa:16:3e:17:71:69"/>
Oct 25 21:39:34 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:39:34 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:39:34 user nova-compute[74189]:       <target dev="tapaf0547c4-bc"/>
Oct 25 21:39:34 user nova-compute[74189]:     </interface>
Oct 25 21:39:34 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:39:34 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/aa2b9013-4a8b-4f8d-a5dc-42842cd987a7/console.log" append="off"/>
Oct 25 21:39:34 user nova-compute[74189]:     </serial>
Oct 25 21:39:34 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:39:34 user nova-compute[74189]:     <video>
Oct 25 21:39:34 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:39:34 user nova-compute[74189]:     </video>
Oct 25 21:39:34 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:39:34 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:39:34 user nova-compute[74189]:     </rng>
Oct 25 21:39:34 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:39:34 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:39:34 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:39:34 user nova-compute[74189]:     </memballoon>
Oct 25 21:39:34 user nova-compute[74189]:   </devices>
Oct 25 21:39:34 user nova-compute[74189]: </domain>
Oct 25 21:39:34 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:39:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1924991693',display_name='tempest-TestServerVolumeAttachmentScenario-server-1924991693',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1924991693',id=42,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJzy3QIcz8k3OVVIWxk7bFwWXBb8/E2yS9Xnh6AxVBze0e54/ByCoah9dg99Lso7vVuwyC2sd5GDnIv0CbCcQPalhmgtkQGD/cYZz84EY1lkZcZN0/eulifAfNtvBLgzZA==',key_name='tempest-keypair-1564393999',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fd14dac60ad462fbaafc984745a06df',ramdisk_id='',reservation_id='r-u1brobqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-661451565',owner_user_name='tempest-TestServerVolumeAttachmentScenario-661451565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:39:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d969f9eb4da9460bac75c7c54c3d27d9',uuid=aa2b9013-4a8b-4f8d-a5dc-42842cd987a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af0547c4-bcad-40cb-9183-e3fd84c1c8fb", "address": "fa:16:3e:17:71:69", "network": {"id": "351bf1c4-8784-41c0-8b68-a939f493bc5a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1840723104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fd14dac60ad462fbaafc984745a06df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0547c4-bc", "ovs_interfaceid": "af0547c4-bcad-40cb-9183-e3fd84c1c8fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Converting VIF {"id": "af0547c4-bcad-40cb-9183-e3fd84c1c8fb", "address": "fa:16:3e:17:71:69", "network": {"id": "351bf1c4-8784-41c0-8b68-a939f493bc5a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1840723104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fd14dac60ad462fbaafc984745a06df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0547c4-bc", "ovs_interfaceid": "af0547c4-bcad-40cb-9183-e3fd84c1c8fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:71:69,bridge_name='br-int',has_traffic_filtering=True,id=af0547c4-bcad-40cb-9183-e3fd84c1c8fb,network=Network(351bf1c4-8784-41c0-8b68-a939f493bc5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf0547c4-bc') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG os_vif [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:71:69,bridge_name='br-int',has_traffic_filtering=True,id=af0547c4-bcad-40cb-9183-e3fd84c1c8fb,network=Network(351bf1c4-8784-41c0-8b68-a939f493bc5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf0547c4-bc') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'af1b3cff-fb11-50de-9de0-6ba90fa1fa1f', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf0547c4-bc, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf0547c4-bc, col_values=(('qos', UUID('0ee31ddc-95d1-4cd4-8294-8e33c624eb1f')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf0547c4-bc, col_values=(('external_ids', {'iface-id': 'af0547c4-bcad-40cb-9183-e3fd84c1c8fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:71:69', 'vm-uuid': 'aa2b9013-4a8b-4f8d-a5dc-42842cd987a7'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:34 user nova-compute[74189]: INFO os_vif [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:71:69,bridge_name='br-int',has_traffic_filtering=True,id=af0547c4-bcad-40cb-9183-e3fd84c1c8fb,network=Network(351bf1c4-8784-41c0-8b68-a939f493bc5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf0547c4-bc')
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:39:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] No VIF found with MAC fa:16:3e:17:71:69, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:39:35 user nova-compute[74189]: DEBUG nova.network.neutron [req-d6b28ea6-d485-423b-92ea-18fdc277b4aa req-b92b50c4-215c-481b-9013-fd1e17717729 service nova] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Updated VIF entry in instance network info cache for port af0547c4-bcad-40cb-9183-e3fd84c1c8fb. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:39:35 user nova-compute[74189]: DEBUG nova.network.neutron [req-d6b28ea6-d485-423b-92ea-18fdc277b4aa req-b92b50c4-215c-481b-9013-fd1e17717729 service nova] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Updating instance_info_cache with network_info: [{"id": "af0547c4-bcad-40cb-9183-e3fd84c1c8fb", "address": "fa:16:3e:17:71:69", "network": {"id": "351bf1c4-8784-41c0-8b68-a939f493bc5a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1840723104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fd14dac60ad462fbaafc984745a06df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0547c4-bc", "ovs_interfaceid": "af0547c4-bcad-40cb-9183-e3fd84c1c8fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:39:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d6b28ea6-d485-423b-92ea-18fdc277b4aa req-b92b50c4-215c-481b-9013-fd1e17717729 service nova] Releasing lock "refresh_cache-aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:39:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:36 user nova-compute[74189]: DEBUG nova.compute.manager [req-f19e20ed-0044-418d-be1e-7cf431e21679 req-f0ccd566-3a89-4a26-94aa-649cbdf72acb service nova] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Received event network-vif-plugged-af0547c4-bcad-40cb-9183-e3fd84c1c8fb {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:39:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f19e20ed-0044-418d-be1e-7cf431e21679 req-f0ccd566-3a89-4a26-94aa-649cbdf72acb service nova] Acquiring lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:39:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f19e20ed-0044-418d-be1e-7cf431e21679 req-f0ccd566-3a89-4a26-94aa-649cbdf72acb service nova] Lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:39:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f19e20ed-0044-418d-be1e-7cf431e21679 req-f0ccd566-3a89-4a26-94aa-649cbdf72acb service nova] Lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:39:36 user nova-compute[74189]: DEBUG nova.compute.manager [req-f19e20ed-0044-418d-be1e-7cf431e21679 req-f0ccd566-3a89-4a26-94aa-649cbdf72acb service nova] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] No waiting events found dispatching network-vif-plugged-af0547c4-bcad-40cb-9183-e3fd84c1c8fb {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:39:36 user nova-compute[74189]: WARNING nova.compute.manager [req-f19e20ed-0044-418d-be1e-7cf431e21679 req-f0ccd566-3a89-4a26-94aa-649cbdf72acb service nova] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Received unexpected event network-vif-plugged-af0547c4-bcad-40cb-9183-e3fd84c1c8fb for instance with vm_state building and task_state spawning.
Oct 25 21:39:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:38 user nova-compute[74189]: DEBUG nova.compute.manager [req-453c6d79-4f7f-4910-a488-a82c9c11b129 req-3bed93a6-7fe8-4f23-8a70-ed07d03de74a service nova] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Received event network-vif-plugged-af0547c4-bcad-40cb-9183-e3fd84c1c8fb {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:39:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-453c6d79-4f7f-4910-a488-a82c9c11b129 req-3bed93a6-7fe8-4f23-8a70-ed07d03de74a service nova] Acquiring lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:39:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-453c6d79-4f7f-4910-a488-a82c9c11b129 req-3bed93a6-7fe8-4f23-8a70-ed07d03de74a service nova] Lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:39:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-453c6d79-4f7f-4910-a488-a82c9c11b129 req-3bed93a6-7fe8-4f23-8a70-ed07d03de74a service nova] Lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:39:38 user nova-compute[74189]: DEBUG nova.compute.manager [req-453c6d79-4f7f-4910-a488-a82c9c11b129 req-3bed93a6-7fe8-4f23-8a70-ed07d03de74a service nova] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] No waiting events found dispatching network-vif-plugged-af0547c4-bcad-40cb-9183-e3fd84c1c8fb {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:39:38 user nova-compute[74189]: WARNING nova.compute.manager [req-453c6d79-4f7f-4910-a488-a82c9c11b129 req-3bed93a6-7fe8-4f23-8a70-ed07d03de74a service nova] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Received unexpected event network-vif-plugged-af0547c4-bcad-40cb-9183-e3fd84c1c8fb for instance with vm_state building and task_state spawning.
Oct 25 21:39:38 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:39:38 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:39:38 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Instance spawned successfully.
Oct 25 21:39:38 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:39:38 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:39:38 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:39:38 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:39:38 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:39:38 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:39:38 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:39:38 user nova-compute[74189]: INFO nova.compute.manager [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Took 6.76 seconds to spawn the instance on the hypervisor.
Oct 25 21:39:38 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:39:38 user nova-compute[74189]: INFO nova.compute.manager [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Took 7.46 seconds to build instance.
Oct 25 21:39:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5d016589-b132-4597-b8ee-1fc42817e5a6 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.654s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:39:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Acquiring lock "be371e0c-ebc8-46f7-89eb-44b55f4adf90" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:39:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "be371e0c-ebc8-46f7-89eb-44b55f4adf90" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:39:40 user nova-compute[74189]: DEBUG nova.compute.manager [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:39:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:39:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:39:40 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:39:40 user nova-compute[74189]: INFO nova.compute.claims [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Claim successful on node user
Oct 25 21:39:40 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:39:40 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:39:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.627s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:39:40 user nova-compute[74189]: DEBUG nova.compute.manager [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:39:40 user nova-compute[74189]: DEBUG nova.compute.manager [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:39:40 user nova-compute[74189]: DEBUG nova.network.neutron [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:39:41 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:39:41 user nova-compute[74189]: DEBUG nova.compute.manager [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:39:41 user nova-compute[74189]: DEBUG nova.policy [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2bcb3eebd1e04f0b978238f4eeeec2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1b56c6086e4a41bf9a98b96101531e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:39:41 user nova-compute[74189]: DEBUG nova.compute.manager [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:39:41 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:39:41 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Creating image(s)
Oct 25 21:39:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Acquiring lock "/opt/stack/data/nova/instances/be371e0c-ebc8-46f7-89eb-44b55f4adf90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:39:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "/opt/stack/data/nova/instances/be371e0c-ebc8-46f7-89eb-44b55f4adf90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:39:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "/opt/stack/data/nova/instances/be371e0c-ebc8-46f7-89eb-44b55f4adf90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:39:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:39:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.230s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:39:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:39:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:39:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:39:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.195s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:39:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/be371e0c-ebc8-46f7-89eb-44b55f4adf90/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:39:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/be371e0c-ebc8-46f7-89eb-44b55f4adf90/disk 1073741824" returned: 0 in 0.057s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:39:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:39:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:39:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.207s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:39:41 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Checking if we can resize image /opt/stack/data/nova/instances/be371e0c-ebc8-46f7-89eb-44b55f4adf90/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:39:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be371e0c-ebc8-46f7-89eb-44b55f4adf90/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:39:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be371e0c-ebc8-46f7-89eb-44b55f4adf90/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:39:42 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Cannot resize image /opt/stack/data/nova/instances/be371e0c-ebc8-46f7-89eb-44b55f4adf90/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:39:42 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:39:42 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Ensure instance console log exists: /opt/stack/data/nova/instances/be371e0c-ebc8-46f7-89eb-44b55f4adf90/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:39:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:39:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:39:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:39:42 user nova-compute[74189]: DEBUG nova.network.neutron [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Successfully created port: 1fc98560-71c7-45c8-a806-73adbfb8f45d {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:39:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:43 user nova-compute[74189]: DEBUG nova.network.neutron [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Successfully updated port: 1fc98560-71c7-45c8-a806-73adbfb8f45d {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:39:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Acquiring lock "refresh_cache-be371e0c-ebc8-46f7-89eb-44b55f4adf90" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:39:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Acquired lock "refresh_cache-be371e0c-ebc8-46f7-89eb-44b55f4adf90" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:39:43 user nova-compute[74189]: DEBUG nova.network.neutron [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:39:43 user nova-compute[74189]: DEBUG nova.compute.manager [req-92ebc6cf-ea8b-4e0a-b7be-f336b92c79ca req-a848691a-c5f2-43ea-80f7-105fb60cc567 service nova] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Received event network-changed-1fc98560-71c7-45c8-a806-73adbfb8f45d {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:39:43 user nova-compute[74189]: DEBUG nova.compute.manager [req-92ebc6cf-ea8b-4e0a-b7be-f336b92c79ca req-a848691a-c5f2-43ea-80f7-105fb60cc567 service nova] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Refreshing instance network info cache due to event network-changed-1fc98560-71c7-45c8-a806-73adbfb8f45d. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:39:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-92ebc6cf-ea8b-4e0a-b7be-f336b92c79ca req-a848691a-c5f2-43ea-80f7-105fb60cc567 service nova] Acquiring lock "refresh_cache-be371e0c-ebc8-46f7-89eb-44b55f4adf90" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:39:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:43 user nova-compute[74189]: DEBUG nova.network.neutron [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:39:43 user nova-compute[74189]: DEBUG nova.network.neutron [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Updating instance_info_cache with network_info: [{"id": "1fc98560-71c7-45c8-a806-73adbfb8f45d", "address": "fa:16:3e:e4:f6:a2", "network": {"id": "27a00d33-61db-45a8-a945-cd8514be6344", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1691303850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff1b56c6086e4a41bf9a98b96101531e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc98560-71", "ovs_interfaceid": "1fc98560-71c7-45c8-a806-73adbfb8f45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:39:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Releasing lock "refresh_cache-be371e0c-ebc8-46f7-89eb-44b55f4adf90" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:39:43 user nova-compute[74189]: DEBUG nova.compute.manager [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Instance network_info: |[{"id": "1fc98560-71c7-45c8-a806-73adbfb8f45d", "address": "fa:16:3e:e4:f6:a2", "network": {"id": "27a00d33-61db-45a8-a945-cd8514be6344", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1691303850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff1b56c6086e4a41bf9a98b96101531e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc98560-71", "ovs_interfaceid": "1fc98560-71c7-45c8-a806-73adbfb8f45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:39:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-92ebc6cf-ea8b-4e0a-b7be-f336b92c79ca req-a848691a-c5f2-43ea-80f7-105fb60cc567 service nova] Acquired lock "refresh_cache-be371e0c-ebc8-46f7-89eb-44b55f4adf90" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:39:43 user nova-compute[74189]: DEBUG nova.network.neutron [req-92ebc6cf-ea8b-4e0a-b7be-f336b92c79ca req-a848691a-c5f2-43ea-80f7-105fb60cc567 service nova] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Refreshing network info cache for port 1fc98560-71c7-45c8-a806-73adbfb8f45d {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:39:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Start _get_guest_xml network_info=[{"id": "1fc98560-71c7-45c8-a806-73adbfb8f45d", "address": "fa:16:3e:e4:f6:a2", "network": {"id": "27a00d33-61db-45a8-a945-cd8514be6344", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1691303850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff1b56c6086e4a41bf9a98b96101531e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc98560-71", "ovs_interfaceid": "1fc98560-71c7-45c8-a806-73adbfb8f45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:39:43 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:39:43 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:39:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:39:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:39:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-728248414',display_name='tempest-VolumesSnapshotTestJSON-instance-728248414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-728248414',id=43,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLNvrD7cNC0znB/JStHbg5w1s0p85TDVnh16HyymtMUj8QEi29pXB+GfgaDsbQytlBKx08I/7eYfq5KrTaKm0G/Lyd5BlljsfQktZMxTaKjPmzIQYApSzKagLPxbjyFSQ==',key_name='tempest-keypair-1532088590',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff1b56c6086e4a41bf9a98b96101531e',ramdisk_id='',reservation_id='r-rer817bm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1589464160',owner_user_name='tempest-VolumesSnapshotTestJSON-1589464160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:39:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bcb3eebd1e04f0b978238f4eeeec2de',uuid=be371e0c-ebc8-46f7-89eb-44b55f4adf90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fc98560-71c7-45c8-a806-73adbfb8f45d", "address": "fa:16:3e:e4:f6:a2", "network": {"id": "27a00d33-61db-45a8-a945-cd8514be6344", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1691303850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff1b56c6086e4a41bf9a98b96101531e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc98560-71", "ovs_interfaceid": "1fc98560-71c7-45c8-a806-73adbfb8f45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Converting VIF {"id": "1fc98560-71c7-45c8-a806-73adbfb8f45d", "address": "fa:16:3e:e4:f6:a2", "network": {"id": "27a00d33-61db-45a8-a945-cd8514be6344", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1691303850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff1b56c6086e4a41bf9a98b96101531e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc98560-71", "ovs_interfaceid": "1fc98560-71c7-45c8-a806-73adbfb8f45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f6:a2,bridge_name='br-int',has_traffic_filtering=True,id=1fc98560-71c7-45c8-a806-73adbfb8f45d,network=Network(27a00d33-61db-45a8-a945-cd8514be6344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fc98560-71') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG nova.objects.instance [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lazy-loading 'pci_devices' on Instance uuid be371e0c-ebc8-46f7-89eb-44b55f4adf90 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:39:44 user nova-compute[74189]:   <uuid>be371e0c-ebc8-46f7-89eb-44b55f4adf90</uuid>
Oct 25 21:39:44 user nova-compute[74189]:   <name>instance-0000002b</name>
Oct 25 21:39:44 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:39:44 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:39:44 user nova-compute[74189]:   <metadata>
Oct 25 21:39:44 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:39:44 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:39:44 user nova-compute[74189]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-728248414</nova:name>
Oct 25 21:39:44 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:39:43</nova:creationTime>
Oct 25 21:39:44 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:39:44 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:39:44 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:39:44 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:39:44 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:39:44 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:39:44 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:39:44 user nova-compute[74189]:       <nova:owner>
Oct 25 21:39:44 user nova-compute[74189]:         <nova:user uuid="2bcb3eebd1e04f0b978238f4eeeec2de">tempest-VolumesSnapshotTestJSON-1589464160-project-member</nova:user>
Oct 25 21:39:44 user nova-compute[74189]:         <nova:project uuid="ff1b56c6086e4a41bf9a98b96101531e">tempest-VolumesSnapshotTestJSON-1589464160</nova:project>
Oct 25 21:39:44 user nova-compute[74189]:       </nova:owner>
Oct 25 21:39:44 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:39:44 user nova-compute[74189]:       <nova:ports>
Oct 25 21:39:44 user nova-compute[74189]:         <nova:port uuid="1fc98560-71c7-45c8-a806-73adbfb8f45d">
Oct 25 21:39:44 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 21:39:44 user nova-compute[74189]:         </nova:port>
Oct 25 21:39:44 user nova-compute[74189]:       </nova:ports>
Oct 25 21:39:44 user nova-compute[74189]:     </nova:instance>
Oct 25 21:39:44 user nova-compute[74189]:   </metadata>
Oct 25 21:39:44 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:39:44 user nova-compute[74189]:     <system>
Oct 25 21:39:44 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:39:44 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:39:44 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:39:44 user nova-compute[74189]:       <entry name="serial">be371e0c-ebc8-46f7-89eb-44b55f4adf90</entry>
Oct 25 21:39:44 user nova-compute[74189]:       <entry name="uuid">be371e0c-ebc8-46f7-89eb-44b55f4adf90</entry>
Oct 25 21:39:44 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:39:44 user nova-compute[74189]:     </system>
Oct 25 21:39:44 user nova-compute[74189]:   </sysinfo>
Oct 25 21:39:44 user nova-compute[74189]:   <os>
Oct 25 21:39:44 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:39:44 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:39:44 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:39:44 user nova-compute[74189]:   </os>
Oct 25 21:39:44 user nova-compute[74189]:   <features>
Oct 25 21:39:44 user nova-compute[74189]:     <acpi/>
Oct 25 21:39:44 user nova-compute[74189]:     <apic/>
Oct 25 21:39:44 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:39:44 user nova-compute[74189]:   </features>
Oct 25 21:39:44 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:39:44 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:39:44 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:39:44 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:39:44 user nova-compute[74189]:   </clock>
Oct 25 21:39:44 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:39:44 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:39:44 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:39:44 user nova-compute[74189]:   </cpu>
Oct 25 21:39:44 user nova-compute[74189]:   <devices>
Oct 25 21:39:44 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:39:44 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:39:44 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/be371e0c-ebc8-46f7-89eb-44b55f4adf90/disk"/>
Oct 25 21:39:44 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:39:44 user nova-compute[74189]:     </disk>
Oct 25 21:39:44 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:39:44 user nova-compute[74189]:       <mac address="fa:16:3e:e4:f6:a2"/>
Oct 25 21:39:44 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:39:44 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:39:44 user nova-compute[74189]:       <target dev="tap1fc98560-71"/>
Oct 25 21:39:44 user nova-compute[74189]:     </interface>
Oct 25 21:39:44 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:39:44 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/be371e0c-ebc8-46f7-89eb-44b55f4adf90/console.log" append="off"/>
Oct 25 21:39:44 user nova-compute[74189]:     </serial>
Oct 25 21:39:44 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:39:44 user nova-compute[74189]:     <video>
Oct 25 21:39:44 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:39:44 user nova-compute[74189]:     </video>
Oct 25 21:39:44 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:39:44 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:39:44 user nova-compute[74189]:     </rng>
Oct 25 21:39:44 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:39:44 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:39:44 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:39:44 user nova-compute[74189]:     </memballoon>
Oct 25 21:39:44 user nova-compute[74189]:   </devices>
Oct 25 21:39:44 user nova-compute[74189]: </domain>
Oct 25 21:39:44 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:39:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-728248414',display_name='tempest-VolumesSnapshotTestJSON-instance-728248414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-728248414',id=43,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLNvrD7cNC0znB/JStHbg5w1s0p85TDVnh16HyymtMUj8QEi29pXB+GfgaDsbQytlBKx08I/7eYfq5KrTaKm0G/Lyd5BlljsfQktZMxTaKjPmzIQYApSzKagLPxbjyFSQ==',key_name='tempest-keypair-1532088590',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff1b56c6086e4a41bf9a98b96101531e',ramdisk_id='',reservation_id='r-rer817bm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1589464160',owner_user_name='tempest-VolumesSnapshotTestJSON-1589464160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:39:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bcb3eebd1e04f0b978238f4eeeec2de',uuid=be371e0c-ebc8-46f7-89eb-44b55f4adf90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fc98560-71c7-45c8-a806-73adbfb8f45d", "address": "fa:16:3e:e4:f6:a2", "network": {"id": "27a00d33-61db-45a8-a945-cd8514be6344", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1691303850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff1b56c6086e4a41bf9a98b96101531e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc98560-71", "ovs_interfaceid": "1fc98560-71c7-45c8-a806-73adbfb8f45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Converting VIF {"id": "1fc98560-71c7-45c8-a806-73adbfb8f45d", "address": "fa:16:3e:e4:f6:a2", "network": {"id": "27a00d33-61db-45a8-a945-cd8514be6344", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1691303850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff1b56c6086e4a41bf9a98b96101531e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc98560-71", "ovs_interfaceid": "1fc98560-71c7-45c8-a806-73adbfb8f45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f6:a2,bridge_name='br-int',has_traffic_filtering=True,id=1fc98560-71c7-45c8-a806-73adbfb8f45d,network=Network(27a00d33-61db-45a8-a945-cd8514be6344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fc98560-71') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG os_vif [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f6:a2,bridge_name='br-int',has_traffic_filtering=True,id=1fc98560-71c7-45c8-a806-73adbfb8f45d,network=Network(27a00d33-61db-45a8-a945-cd8514be6344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fc98560-71') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1a409956-b396-59bc-a280-1790a6a3f689', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1fc98560-71, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1fc98560-71, col_values=(('qos', UUID('72021f36-8d8e-42dc-a66f-066fc52caf8e')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1fc98560-71, col_values=(('external_ids', {'iface-id': '1fc98560-71c7-45c8-a806-73adbfb8f45d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:f6:a2', 'vm-uuid': 'be371e0c-ebc8-46f7-89eb-44b55f4adf90'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:44 user nova-compute[74189]: INFO os_vif [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f6:a2,bridge_name='br-int',has_traffic_filtering=True,id=1fc98560-71c7-45c8-a806-73adbfb8f45d,network=Network(27a00d33-61db-45a8-a945-cd8514be6344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fc98560-71')
Oct 25 21:39:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] No VIF found with MAC fa:16:3e:e4:f6:a2, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG nova.network.neutron [req-92ebc6cf-ea8b-4e0a-b7be-f336b92c79ca req-a848691a-c5f2-43ea-80f7-105fb60cc567 service nova] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Updated VIF entry in instance network info cache for port 1fc98560-71c7-45c8-a806-73adbfb8f45d. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG nova.network.neutron [req-92ebc6cf-ea8b-4e0a-b7be-f336b92c79ca req-a848691a-c5f2-43ea-80f7-105fb60cc567 service nova] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Updating instance_info_cache with network_info: [{"id": "1fc98560-71c7-45c8-a806-73adbfb8f45d", "address": "fa:16:3e:e4:f6:a2", "network": {"id": "27a00d33-61db-45a8-a945-cd8514be6344", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1691303850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff1b56c6086e4a41bf9a98b96101531e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc98560-71", "ovs_interfaceid": "1fc98560-71c7-45c8-a806-73adbfb8f45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:39:44 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-92ebc6cf-ea8b-4e0a-b7be-f336b92c79ca req-a848691a-c5f2-43ea-80f7-105fb60cc567 service nova] Releasing lock "refresh_cache-be371e0c-ebc8-46f7-89eb-44b55f4adf90" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:39:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:45 user nova-compute[74189]: DEBUG nova.compute.manager [req-aee2be50-cc57-48d6-8ede-53f87c23db8c req-d34f2f5e-87e1-4a3d-87f2-153d872bdeb7 service nova] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Received event network-vif-plugged-1fc98560-71c7-45c8-a806-73adbfb8f45d {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:39:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-aee2be50-cc57-48d6-8ede-53f87c23db8c req-d34f2f5e-87e1-4a3d-87f2-153d872bdeb7 service nova] Acquiring lock "be371e0c-ebc8-46f7-89eb-44b55f4adf90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:39:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-aee2be50-cc57-48d6-8ede-53f87c23db8c req-d34f2f5e-87e1-4a3d-87f2-153d872bdeb7 service nova] Lock "be371e0c-ebc8-46f7-89eb-44b55f4adf90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:39:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-aee2be50-cc57-48d6-8ede-53f87c23db8c req-d34f2f5e-87e1-4a3d-87f2-153d872bdeb7 service nova] Lock "be371e0c-ebc8-46f7-89eb-44b55f4adf90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:39:45 user nova-compute[74189]: DEBUG nova.compute.manager [req-aee2be50-cc57-48d6-8ede-53f87c23db8c req-d34f2f5e-87e1-4a3d-87f2-153d872bdeb7 service nova] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] No waiting events found dispatching network-vif-plugged-1fc98560-71c7-45c8-a806-73adbfb8f45d {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:39:45 user nova-compute[74189]: WARNING nova.compute.manager [req-aee2be50-cc57-48d6-8ede-53f87c23db8c req-d34f2f5e-87e1-4a3d-87f2-153d872bdeb7 service nova] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Received unexpected event network-vif-plugged-1fc98560-71c7-45c8-a806-73adbfb8f45d for instance with vm_state building and task_state spawning.
Oct 25 21:39:46 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:46 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:46 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:46 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:47 user nova-compute[74189]: DEBUG nova.compute.manager [req-0df4f788-abcd-4017-8881-622ccaef35ef req-344e781f-3c6f-402a-b421-49597bbd66d1 service nova] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Received event network-vif-plugged-1fc98560-71c7-45c8-a806-73adbfb8f45d {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:39:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0df4f788-abcd-4017-8881-622ccaef35ef req-344e781f-3c6f-402a-b421-49597bbd66d1 service nova] Acquiring lock "be371e0c-ebc8-46f7-89eb-44b55f4adf90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:39:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0df4f788-abcd-4017-8881-622ccaef35ef req-344e781f-3c6f-402a-b421-49597bbd66d1 service nova] Lock "be371e0c-ebc8-46f7-89eb-44b55f4adf90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:39:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0df4f788-abcd-4017-8881-622ccaef35ef req-344e781f-3c6f-402a-b421-49597bbd66d1 service nova] Lock "be371e0c-ebc8-46f7-89eb-44b55f4adf90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:39:47 user nova-compute[74189]: DEBUG nova.compute.manager [req-0df4f788-abcd-4017-8881-622ccaef35ef req-344e781f-3c6f-402a-b421-49597bbd66d1 service nova] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] No waiting events found dispatching network-vif-plugged-1fc98560-71c7-45c8-a806-73adbfb8f45d {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:39:47 user nova-compute[74189]: WARNING nova.compute.manager [req-0df4f788-abcd-4017-8881-622ccaef35ef req-344e781f-3c6f-402a-b421-49597bbd66d1 service nova] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Received unexpected event network-vif-plugged-1fc98560-71c7-45c8-a806-73adbfb8f45d for instance with vm_state building and task_state spawning.
Oct 25 21:39:48 user nova-compute[74189]: DEBUG nova.compute.manager [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:39:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:39:48 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Instance spawned successfully.
Oct 25 21:39:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:39:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:39:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:39:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:39:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:39:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:39:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:39:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:49 user nova-compute[74189]: INFO nova.compute.manager [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Took 7.93 seconds to spawn the instance on the hypervisor.
Oct 25 21:39:49 user nova-compute[74189]: DEBUG nova.compute.manager [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:39:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:49 user nova-compute[74189]: INFO nova.compute.manager [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Took 9.02 seconds to build instance.
Oct 25 21:39:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ed425b6f-36db-4165-8d18-65ea197e1276 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "be371e0c-ebc8-46f7-89eb-44b55f4adf90" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.159s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:39:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:39:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:39:51 user nova-compute[74189]: DEBUG nova.compute.manager [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:39:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:39:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:39:51 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:39:51 user nova-compute[74189]: INFO nova.compute.claims [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Claim successful on node user
Oct 25 21:39:52 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:39:52 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:39:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.618s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:39:52 user nova-compute[74189]: DEBUG nova.compute.manager [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:39:52 user nova-compute[74189]: DEBUG nova.compute.manager [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:39:52 user nova-compute[74189]: DEBUG nova.network.neutron [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:39:52 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:39:52 user nova-compute[74189]: DEBUG nova.compute.manager [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:39:52 user nova-compute[74189]: DEBUG nova.policy [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '155c948b95c64c9083da984cdf6af494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df03fc18fc3467db76e336c6de78c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:39:52 user nova-compute[74189]: DEBUG nova.compute.manager [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:39:52 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:39:52 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Creating image(s)
Oct 25 21:39:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "/opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:39:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "/opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:39:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "/opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:39:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:39:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.290s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:39:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:39:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:39:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:39:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.362s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:39:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:39:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk 1073741824" returned: 0 in 0.205s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:39:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.579s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:39:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:39:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.180s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:39:53 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Checking if we can resize image /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:39:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:39:53 user nova-compute[74189]: DEBUG nova.network.neutron [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Successfully created port: d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:39:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:39:53 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Cannot resize image /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:39:53 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:39:53 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Ensure instance console log exists: /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:39:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:39:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:39:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:39:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:54 user nova-compute[74189]: DEBUG nova.network.neutron [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Successfully updated port: d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:39:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "refresh_cache-915a1d25-6499-4d3e-9edd-5f3cfd487bac" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:39:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquired lock "refresh_cache-915a1d25-6499-4d3e-9edd-5f3cfd487bac" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:39:54 user nova-compute[74189]: DEBUG nova.network.neutron [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:39:54 user nova-compute[74189]: DEBUG nova.compute.manager [req-80ae584a-eaaf-4091-bef6-34396a66445c req-0444dccd-43a9-466b-9ef3-4c37593eea44 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Received event network-changed-d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:39:54 user nova-compute[74189]: DEBUG nova.compute.manager [req-80ae584a-eaaf-4091-bef6-34396a66445c req-0444dccd-43a9-466b-9ef3-4c37593eea44 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Refreshing instance network info cache due to event network-changed-d8084804-8e6e-4787-b331-96822b5ed349. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:39:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-80ae584a-eaaf-4091-bef6-34396a66445c req-0444dccd-43a9-466b-9ef3-4c37593eea44 service nova] Acquiring lock "refresh_cache-915a1d25-6499-4d3e-9edd-5f3cfd487bac" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:39:54 user nova-compute[74189]: DEBUG nova.network.neutron [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:39:54 user nova-compute[74189]: DEBUG nova.network.neutron [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Updating instance_info_cache with network_info: [{"id": "d8084804-8e6e-4787-b331-96822b5ed349", "address": "fa:16:3e:1c:bf:ba", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8084804-8e", "ovs_interfaceid": "d8084804-8e6e-4787-b331-96822b5ed349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:39:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Releasing lock "refresh_cache-915a1d25-6499-4d3e-9edd-5f3cfd487bac" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:39:54 user nova-compute[74189]: DEBUG nova.compute.manager [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Instance network_info: |[{"id": "d8084804-8e6e-4787-b331-96822b5ed349", "address": "fa:16:3e:1c:bf:ba", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8084804-8e", "ovs_interfaceid": "d8084804-8e6e-4787-b331-96822b5ed349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:39:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-80ae584a-eaaf-4091-bef6-34396a66445c req-0444dccd-43a9-466b-9ef3-4c37593eea44 service nova] Acquired lock "refresh_cache-915a1d25-6499-4d3e-9edd-5f3cfd487bac" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:39:54 user nova-compute[74189]: DEBUG nova.network.neutron [req-80ae584a-eaaf-4091-bef6-34396a66445c req-0444dccd-43a9-466b-9ef3-4c37593eea44 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Refreshing network info cache for port d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:39:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Start _get_guest_xml network_info=[{"id": "d8084804-8e6e-4787-b331-96822b5ed349", "address": "fa:16:3e:1c:bf:ba", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8084804-8e", "ovs_interfaceid": "d8084804-8e6e-4787-b331-96822b5ed349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:39:55 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:39:55 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:39:55 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1472118533',display_name='tempest-ServerRescueNegativeTestJSON-server-1472118533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1472118533',id=44,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0nf2hM/WlDG+sQ+FxLN/EMmeMuByeyGz9+k278o6v87wvvWwukeL2QOlXyvE/n9zyiGco1JHpAvDrdVaXClm1csDAdyWDdcVv33SghS4TAVXWuVSS44IvuXUNWj1aXVw==',key_name='tempest-keypair-426278292',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3df03fc18fc3467db76e336c6de78c92',ramdisk_id='',reservation_id='r-qa2hot3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-383982506',owner_user_name='tempest-ServerRescueNegativeTestJSON-383982506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:39:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='155c948b95c64c9083da984cdf6af494',uuid=915a1d25-6499-4d3e-9edd-5f3cfd487bac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8084804-8e6e-4787-b331-96822b5ed349", "address": "fa:16:3e:1c:bf:ba", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8084804-8e", "ovs_interfaceid": "d8084804-8e6e-4787-b331-96822b5ed349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Converting VIF {"id": "d8084804-8e6e-4787-b331-96822b5ed349", "address": "fa:16:3e:1c:bf:ba", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8084804-8e", "ovs_interfaceid": "d8084804-8e6e-4787-b331-96822b5ed349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:bf:ba,bridge_name='br-int',has_traffic_filtering=True,id=d8084804-8e6e-4787-b331-96822b5ed349,network=Network(b496a106-2367-44dc-a788-bcd22ec98feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8084804-8e') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG nova.objects.instance [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lazy-loading 'pci_devices' on Instance uuid 915a1d25-6499-4d3e-9edd-5f3cfd487bac {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:39:55 user nova-compute[74189]:   <uuid>915a1d25-6499-4d3e-9edd-5f3cfd487bac</uuid>
Oct 25 21:39:55 user nova-compute[74189]:   <name>instance-0000002c</name>
Oct 25 21:39:55 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:39:55 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:39:55 user nova-compute[74189]:   <metadata>
Oct 25 21:39:55 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:39:55 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:39:55 user nova-compute[74189]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1472118533</nova:name>
Oct 25 21:39:55 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:39:55</nova:creationTime>
Oct 25 21:39:55 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:39:55 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:39:55 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:39:55 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:39:55 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:39:55 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:39:55 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:39:55 user nova-compute[74189]:       <nova:owner>
Oct 25 21:39:55 user nova-compute[74189]:         <nova:user uuid="155c948b95c64c9083da984cdf6af494">tempest-ServerRescueNegativeTestJSON-383982506-project-member</nova:user>
Oct 25 21:39:55 user nova-compute[74189]:         <nova:project uuid="3df03fc18fc3467db76e336c6de78c92">tempest-ServerRescueNegativeTestJSON-383982506</nova:project>
Oct 25 21:39:55 user nova-compute[74189]:       </nova:owner>
Oct 25 21:39:55 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:39:55 user nova-compute[74189]:       <nova:ports>
Oct 25 21:39:55 user nova-compute[74189]:         <nova:port uuid="d8084804-8e6e-4787-b331-96822b5ed349">
Oct 25 21:39:55 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 21:39:55 user nova-compute[74189]:         </nova:port>
Oct 25 21:39:55 user nova-compute[74189]:       </nova:ports>
Oct 25 21:39:55 user nova-compute[74189]:     </nova:instance>
Oct 25 21:39:55 user nova-compute[74189]:   </metadata>
Oct 25 21:39:55 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:39:55 user nova-compute[74189]:     <system>
Oct 25 21:39:55 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:39:55 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:39:55 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:39:55 user nova-compute[74189]:       <entry name="serial">915a1d25-6499-4d3e-9edd-5f3cfd487bac</entry>
Oct 25 21:39:55 user nova-compute[74189]:       <entry name="uuid">915a1d25-6499-4d3e-9edd-5f3cfd487bac</entry>
Oct 25 21:39:55 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:39:55 user nova-compute[74189]:     </system>
Oct 25 21:39:55 user nova-compute[74189]:   </sysinfo>
Oct 25 21:39:55 user nova-compute[74189]:   <os>
Oct 25 21:39:55 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:39:55 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:39:55 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:39:55 user nova-compute[74189]:   </os>
Oct 25 21:39:55 user nova-compute[74189]:   <features>
Oct 25 21:39:55 user nova-compute[74189]:     <acpi/>
Oct 25 21:39:55 user nova-compute[74189]:     <apic/>
Oct 25 21:39:55 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:39:55 user nova-compute[74189]:   </features>
Oct 25 21:39:55 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:39:55 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:39:55 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:39:55 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:39:55 user nova-compute[74189]:   </clock>
Oct 25 21:39:55 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:39:55 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:39:55 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:39:55 user nova-compute[74189]:   </cpu>
Oct 25 21:39:55 user nova-compute[74189]:   <devices>
Oct 25 21:39:55 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:39:55 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:39:55 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk"/>
Oct 25 21:39:55 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:39:55 user nova-compute[74189]:     </disk>
Oct 25 21:39:55 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:39:55 user nova-compute[74189]:       <mac address="fa:16:3e:1c:bf:ba"/>
Oct 25 21:39:55 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:39:55 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:39:55 user nova-compute[74189]:       <target dev="tapd8084804-8e"/>
Oct 25 21:39:55 user nova-compute[74189]:     </interface>
Oct 25 21:39:55 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:39:55 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/console.log" append="off"/>
Oct 25 21:39:55 user nova-compute[74189]:     </serial>
Oct 25 21:39:55 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:39:55 user nova-compute[74189]:     <video>
Oct 25 21:39:55 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:39:55 user nova-compute[74189]:     </video>
Oct 25 21:39:55 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:39:55 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:39:55 user nova-compute[74189]:     </rng>
Oct 25 21:39:55 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:39:55 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:39:55 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:39:55 user nova-compute[74189]:     </memballoon>
Oct 25 21:39:55 user nova-compute[74189]:   </devices>
Oct 25 21:39:55 user nova-compute[74189]: </domain>
Oct 25 21:39:55 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1472118533',display_name='tempest-ServerRescueNegativeTestJSON-server-1472118533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1472118533',id=44,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0nf2hM/WlDG+sQ+FxLN/EMmeMuByeyGz9+k278o6v87wvvWwukeL2QOlXyvE/n9zyiGco1JHpAvDrdVaXClm1csDAdyWDdcVv33SghS4TAVXWuVSS44IvuXUNWj1aXVw==',key_name='tempest-keypair-426278292',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3df03fc18fc3467db76e336c6de78c92',ramdisk_id='',reservation_id='r-qa2hot3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-383982506',owner_user_name='tempest-ServerRescueNegativeTestJSON-383982506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:39:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='155c948b95c64c9083da984cdf6af494',uuid=915a1d25-6499-4d3e-9edd-5f3cfd487bac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8084804-8e6e-4787-b331-96822b5ed349", "address": "fa:16:3e:1c:bf:ba", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8084804-8e", "ovs_interfaceid": "d8084804-8e6e-4787-b331-96822b5ed349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Converting VIF {"id": "d8084804-8e6e-4787-b331-96822b5ed349", "address": "fa:16:3e:1c:bf:ba", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8084804-8e", "ovs_interfaceid": "d8084804-8e6e-4787-b331-96822b5ed349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:bf:ba,bridge_name='br-int',has_traffic_filtering=True,id=d8084804-8e6e-4787-b331-96822b5ed349,network=Network(b496a106-2367-44dc-a788-bcd22ec98feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8084804-8e') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG os_vif [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:bf:ba,bridge_name='br-int',has_traffic_filtering=True,id=d8084804-8e6e-4787-b331-96822b5ed349,network=Network(b496a106-2367-44dc-a788-bcd22ec98feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8084804-8e') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3da11d09-d275-509e-86d1-30b6cdbba9e9', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8084804-8e, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd8084804-8e, col_values=(('qos', UUID('ab94d5ae-5583-4678-a7d5-b6e36cc7923f')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd8084804-8e, col_values=(('external_ids', {'iface-id': 'd8084804-8e6e-4787-b331-96822b5ed349', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:bf:ba', 'vm-uuid': '915a1d25-6499-4d3e-9edd-5f3cfd487bac'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:55 user nova-compute[74189]: INFO os_vif [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:bf:ba,bridge_name='br-int',has_traffic_filtering=True,id=d8084804-8e6e-4787-b331-96822b5ed349,network=Network(b496a106-2367-44dc-a788-bcd22ec98feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8084804-8e')
Oct 25 21:39:55 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] No VIF found with MAC fa:16:3e:1c:bf:ba, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG nova.network.neutron [req-80ae584a-eaaf-4091-bef6-34396a66445c req-0444dccd-43a9-466b-9ef3-4c37593eea44 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Updated VIF entry in instance network info cache for port d8084804-8e6e-4787-b331-96822b5ed349. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG nova.network.neutron [req-80ae584a-eaaf-4091-bef6-34396a66445c req-0444dccd-43a9-466b-9ef3-4c37593eea44 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Updating instance_info_cache with network_info: [{"id": "d8084804-8e6e-4787-b331-96822b5ed349", "address": "fa:16:3e:1c:bf:ba", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8084804-8e", "ovs_interfaceid": "d8084804-8e6e-4787-b331-96822b5ed349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:39:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-80ae584a-eaaf-4091-bef6-34396a66445c req-0444dccd-43a9-466b-9ef3-4c37593eea44 service nova] Releasing lock "refresh_cache-915a1d25-6499-4d3e-9edd-5f3cfd487bac" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:39:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-29a018ea-a5c8-4d54-b905-e0fa727650ac req-4a00dcb0-9370-4b01-9af4-7736e06d106a service nova] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Received event network-changed-092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:39:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-29a018ea-a5c8-4d54-b905-e0fa727650ac req-4a00dcb0-9370-4b01-9af4-7736e06d106a service nova] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Refreshing instance network info cache due to event network-changed-092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:39:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-29a018ea-a5c8-4d54-b905-e0fa727650ac req-4a00dcb0-9370-4b01-9af4-7736e06d106a service nova] Acquiring lock "refresh_cache-337a8739-3f22-4a83-aa01-9ef8bae750cb" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:39:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-29a018ea-a5c8-4d54-b905-e0fa727650ac req-4a00dcb0-9370-4b01-9af4-7736e06d106a service nova] Acquired lock "refresh_cache-337a8739-3f22-4a83-aa01-9ef8bae750cb" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:39:57 user nova-compute[74189]: DEBUG nova.network.neutron [req-29a018ea-a5c8-4d54-b905-e0fa727650ac req-4a00dcb0-9370-4b01-9af4-7736e06d106a service nova] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Refreshing network info cache for port 092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:39:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-f2053edd-67b7-4bfa-9328-47df5ef83b71 req-b23335c7-f9e5-4c63-b1fb-1044c7f23e82 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Received event network-vif-plugged-d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:39:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f2053edd-67b7-4bfa-9328-47df5ef83b71 req-b23335c7-f9e5-4c63-b1fb-1044c7f23e82 service nova] Acquiring lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:39:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f2053edd-67b7-4bfa-9328-47df5ef83b71 req-b23335c7-f9e5-4c63-b1fb-1044c7f23e82 service nova] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:39:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f2053edd-67b7-4bfa-9328-47df5ef83b71 req-b23335c7-f9e5-4c63-b1fb-1044c7f23e82 service nova] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:39:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-f2053edd-67b7-4bfa-9328-47df5ef83b71 req-b23335c7-f9e5-4c63-b1fb-1044c7f23e82 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] No waiting events found dispatching network-vif-plugged-d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:39:57 user nova-compute[74189]: WARNING nova.compute.manager [req-f2053edd-67b7-4bfa-9328-47df5ef83b71 req-b23335c7-f9e5-4c63-b1fb-1044c7f23e82 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Received unexpected event network-vif-plugged-d8084804-8e6e-4787-b331-96822b5ed349 for instance with vm_state building and task_state spawning.
Oct 25 21:39:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "337a8739-3f22-4a83-aa01-9ef8bae750cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:39:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "337a8739-3f22-4a83-aa01-9ef8bae750cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:39:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "337a8739-3f22-4a83-aa01-9ef8bae750cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:39:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "337a8739-3f22-4a83-aa01-9ef8bae750cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:39:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "337a8739-3f22-4a83-aa01-9ef8bae750cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:39:58 user nova-compute[74189]: INFO nova.compute.manager [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Terminating instance
Oct 25 21:39:58 user nova-compute[74189]: DEBUG nova.compute.manager [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:39:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-65463d74-036f-4bdd-ab08-e199a46ebd06 req-d28b2405-f6c4-43e4-9d28-e511c70d17da service nova] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Received event network-vif-unplugged-092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-65463d74-036f-4bdd-ab08-e199a46ebd06 req-d28b2405-f6c4-43e4-9d28-e511c70d17da service nova] Acquiring lock "337a8739-3f22-4a83-aa01-9ef8bae750cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-65463d74-036f-4bdd-ab08-e199a46ebd06 req-d28b2405-f6c4-43e4-9d28-e511c70d17da service nova] Lock "337a8739-3f22-4a83-aa01-9ef8bae750cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-65463d74-036f-4bdd-ab08-e199a46ebd06 req-d28b2405-f6c4-43e4-9d28-e511c70d17da service nova] Lock "337a8739-3f22-4a83-aa01-9ef8bae750cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-65463d74-036f-4bdd-ab08-e199a46ebd06 req-d28b2405-f6c4-43e4-9d28-e511c70d17da service nova] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] No waiting events found dispatching network-vif-unplugged-092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-65463d74-036f-4bdd-ab08-e199a46ebd06 req-d28b2405-f6c4-43e4-9d28-e511c70d17da service nova] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Received event network-vif-unplugged-092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0 for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:39:59 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Instance destroyed successfully.
Oct 25 21:39:59 user nova-compute[74189]: DEBUG nova.objects.instance [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lazy-loading 'resources' on Instance uuid 337a8739-3f22-4a83-aa01-9ef8bae750cb {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:38:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-348902433',display_name='tempest-TestVolumeBootPattern-server-348902433',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-348902433',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbWjlurUdlTqM38TJIvyWArBvgtPS5ByZ7GvbbNhterPxeMByoQxHeDSj3q/FAwbfZCzxGnbhX1L/9RQ/CSBOb1BJ9rZaqesREBo++7UKa99YIwO5kH0uL2CiEzhHllXw==',key_name='tempest-TestVolumeBootPattern-16841960',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:38:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e893e8f3f58e4e15920d313b6391682c',ramdisk_id='',reservation_id='r-r1mk3tyx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1934687878',owner_user_name='tempest-TestVolumeBootPattern-1934687878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:38:30Z,user_data=None,user_id='77a27a7ebb4a458097c901871c378bc8',uuid=337a8739-3f22-4a83-aa01-9ef8bae750cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0", "address": "fa:16:3e:ad:51:10", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap092c0b44-09", "ovs_interfaceid": "092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converting VIF {"id": "092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0", "address": "fa:16:3e:ad:51:10", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap092c0b44-09", "ovs_interfaceid": "092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:51:10,bridge_name='br-int',has_traffic_filtering=True,id=092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap092c0b44-09') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG os_vif [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:51:10,bridge_name='br-int',has_traffic_filtering=True,id=092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap092c0b44-09') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap092c0b44-09, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=711ff568-bc8c-4d87-820a-4c5458ad7d27) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-0ade2fed-286a-413b-a451-d980cf20b60a req-4f1e9282-efb7-47fa-a112-a03627e9bf2c service nova] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Received event network-changed-092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-0ade2fed-286a-413b-a451-d980cf20b60a req-4f1e9282-efb7-47fa-a112-a03627e9bf2c service nova] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Refreshing instance network info cache due to event network-changed-092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0ade2fed-286a-413b-a451-d980cf20b60a req-4f1e9282-efb7-47fa-a112-a03627e9bf2c service nova] Acquiring lock "refresh_cache-337a8739-3f22-4a83-aa01-9ef8bae750cb" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:39:59 user nova-compute[74189]: INFO os_vif [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:51:10,bridge_name='br-int',has_traffic_filtering=True,id=092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap092c0b44-09')
Oct 25 21:39:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-aceb0476-86f6-4e0d-b62f-cfe7ddf38b42 req-f7e27cb7-8eab-4a9d-8c69-6f48975b506f service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Received event network-vif-plugged-d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-aceb0476-86f6-4e0d-b62f-cfe7ddf38b42 req-f7e27cb7-8eab-4a9d-8c69-6f48975b506f service nova] Acquiring lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-aceb0476-86f6-4e0d-b62f-cfe7ddf38b42 req-f7e27cb7-8eab-4a9d-8c69-6f48975b506f service nova] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-aceb0476-86f6-4e0d-b62f-cfe7ddf38b42 req-f7e27cb7-8eab-4a9d-8c69-6f48975b506f service nova] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-aceb0476-86f6-4e0d-b62f-cfe7ddf38b42 req-f7e27cb7-8eab-4a9d-8c69-6f48975b506f service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] No waiting events found dispatching network-vif-plugged-d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:39:59 user nova-compute[74189]: WARNING nova.compute.manager [req-aceb0476-86f6-4e0d-b62f-cfe7ddf38b42 req-f7e27cb7-8eab-4a9d-8c69-6f48975b506f service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Received unexpected event network-vif-plugged-d8084804-8e6e-4787-b331-96822b5ed349 for instance with vm_state building and task_state spawning.
Oct 25 21:39:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AhYutvnB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:39:59 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:39:59 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG nova.compute.manager [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:39:59 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Instance spawned successfully.
Oct 25 21:39:59 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0051adea-47c6-4656-83b1-2c62b56aaddf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:39:59 user nova-compute[74189]: No targets found.
Oct 25 21:39:59 user nova-compute[74189]: iSNS:
Oct 25 21:39:59 user nova-compute[74189]: No targets found.
Oct 25 21:39:59 user nova-compute[74189]: STATIC:
Oct 25 21:39:59 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307
Oct 25 21:39:59 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:39:59 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:39:59 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d
Oct 25 21:39:59 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:39:59 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:39:59 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98
Oct 25 21:39:59 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:39:59 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:39:59 user nova-compute[74189]: FIRMWARE:
Oct 25 21:39:59 user nova-compute[74189]: No targets found.
Oct 25 21:39:59 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:39:59 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:39:59 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[56be4780-2e18-40d5-8c78-8ee3872c9d75]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG nova.network.neutron [req-29a018ea-a5c8-4d54-b905-e0fa727650ac req-4a00dcb0-9370-4b01-9af4-7736e06d106a service nova] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Updated VIF entry in instance network info cache for port 092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG nova.network.neutron [req-29a018ea-a5c8-4d54-b905-e0fa727650ac req-4a00dcb0-9370-4b01-9af4-7736e06d106a service nova] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Updating instance_info_cache with network_info: [{"id": "092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0", "address": "fa:16:3e:ad:51:10", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap092c0b44-09", "ovs_interfaceid": "092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-29a018ea-a5c8-4d54-b905-e0fa727650ac req-4a00dcb0-9370-4b01-9af4-7736e06d106a service nova] Releasing lock "refresh_cache-337a8739-3f22-4a83-aa01-9ef8bae750cb" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0ade2fed-286a-413b-a451-d980cf20b60a req-4f1e9282-efb7-47fa-a112-a03627e9bf2c service nova] Acquired lock "refresh_cache-337a8739-3f22-4a83-aa01-9ef8bae750cb" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG nova.network.neutron [req-0ade2fed-286a-413b-a451-d980cf20b60a req-4f1e9282-efb7-47fa-a112-a03627e9bf2c service nova] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Refreshing network info cache for port 092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a621997f-5fc4-4519-9c48-5f075996e004]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:39:59 user nova-compute[74189]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)
Oct 25 21:39:59 user nova-compute[74189]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307 (non-flash)
Oct 25 21:39:59 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:39:59 user nova-compute[74189]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)
Oct 25 21:39:59 user nova-compute[74189]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307 (non-flash)
Oct 25 21:39:59 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2e42bf490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307'): ({'sdb'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Removing single pathed devices sdb {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4dda3a-3501-4b39-a6e9-336d8e595d16]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:39:59 user nova-compute[74189]: INFO nova.compute.manager [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Took 6.87 seconds to spawn the instance on the hypervisor.
Oct 25 21:39:59 user nova-compute[74189]: DEBUG nova.compute.manager [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85b733c-a7c7-44d0-855e-812e5ffe281e]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Flushing IO for device /dev/sdb {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9e2aae-53af-4d80-8a03-381f782b68a6]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[771d561a-3c7f-4056-88ae-8adbc8765551]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] SCSI volumes sdb have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7de05ff-da8e-4a19-9a55-1769dc8c17fb]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:39:59 user nova-compute[74189]: INFO nova.compute.manager [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Took 8.12 seconds to build instance.
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307 -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-802ca58e-6f46-49b7-a3e0-b5d5134552a3 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.290s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a88af74-d5ea-4659-8942-5a8a83807411]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307, portal: 172.16.0.220,3260]
Oct 25 21:39:59 user nova-compute[74189]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307, portal: 172.16.0.220,3260] successful.
Oct 25 21:39:59 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307 -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54cba2c9-a4fc-4720-91eb-2fa0ca198307 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[71999993-186b-4927-9e91-26fd7a090c16]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.473s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] <== disconnect_volume: return (475ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:39:59 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Deleting instance files /opt/stack/data/nova/instances/337a8739-3f22-4a83-aa01-9ef8bae750cb_del
Oct 25 21:39:59 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Deletion of /opt/stack/data/nova/instances/337a8739-3f22-4a83-aa01-9ef8bae750cb_del complete
Oct 25 21:39:59 user nova-compute[74189]: INFO nova.compute.manager [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Took 1.55 seconds to destroy the instance on the hypervisor.
Oct 25 21:39:59 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:39:59 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:40:00 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:40:00 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Took 0.82 seconds to deallocate network for instance.
Oct 25 21:40:00 user nova-compute[74189]: DEBUG nova.network.neutron [req-0ade2fed-286a-413b-a451-d980cf20b60a req-4f1e9282-efb7-47fa-a112-a03627e9bf2c service nova] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Updated VIF entry in instance network info cache for port 092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:40:00 user nova-compute[74189]: DEBUG nova.network.neutron [req-0ade2fed-286a-413b-a451-d980cf20b60a req-4f1e9282-efb7-47fa-a112-a03627e9bf2c service nova] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Updating instance_info_cache with network_info: [{"id": "092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0", "address": "fa:16:3e:ad:51:10", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap092c0b44-09", "ovs_interfaceid": "092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:40:00 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0ade2fed-286a-413b-a451-d980cf20b60a req-4f1e9282-efb7-47fa-a112-a03627e9bf2c service nova] Releasing lock "refresh_cache-337a8739-3f22-4a83-aa01-9ef8bae750cb" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:40:01 user nova-compute[74189]: DEBUG nova.compute.manager [req-870e67d0-dde8-4384-a293-2fef8ce0790d req-3bebb827-19f1-4dd3-b699-820de84f80bf service nova] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Received event network-vif-plugged-092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:40:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-870e67d0-dde8-4384-a293-2fef8ce0790d req-3bebb827-19f1-4dd3-b699-820de84f80bf service nova] Acquiring lock "337a8739-3f22-4a83-aa01-9ef8bae750cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:40:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-870e67d0-dde8-4384-a293-2fef8ce0790d req-3bebb827-19f1-4dd3-b699-820de84f80bf service nova] Lock "337a8739-3f22-4a83-aa01-9ef8bae750cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:40:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-870e67d0-dde8-4384-a293-2fef8ce0790d req-3bebb827-19f1-4dd3-b699-820de84f80bf service nova] Lock "337a8739-3f22-4a83-aa01-9ef8bae750cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:40:01 user nova-compute[74189]: DEBUG nova.compute.manager [req-870e67d0-dde8-4384-a293-2fef8ce0790d req-3bebb827-19f1-4dd3-b699-820de84f80bf service nova] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] No waiting events found dispatching network-vif-plugged-092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:40:01 user nova-compute[74189]: WARNING nova.compute.manager [req-870e67d0-dde8-4384-a293-2fef8ce0790d req-3bebb827-19f1-4dd3-b699-820de84f80bf service nova] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Received unexpected event network-vif-plugged-092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0 for instance with vm_state active and task_state deleting.
Oct 25 21:40:01 user nova-compute[74189]: DEBUG nova.compute.manager [req-4eb5f6f9-ca9b-4cb4-b220-ef9a613e8abd req-4a7f394f-c88c-4e3c-8fa8-4559d1381bea service nova] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Received event network-vif-deleted-092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:40:01 user nova-compute[74189]: INFO nova.compute.manager [req-4eb5f6f9-ca9b-4cb4-b220-ef9a613e8abd req-4a7f394f-c88c-4e3c-8fa8-4559d1381bea service nova] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Neutron deleted interface 092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0; detaching it from the instance and deleting it from the info cache
Oct 25 21:40:01 user nova-compute[74189]: DEBUG nova.network.neutron [req-4eb5f6f9-ca9b-4cb4-b220-ef9a613e8abd req-4a7f394f-c88c-4e3c-8fa8-4559d1381bea service nova] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:40:01 user nova-compute[74189]: DEBUG nova.compute.manager [req-4eb5f6f9-ca9b-4cb4-b220-ef9a613e8abd req-4a7f394f-c88c-4e3c-8fa8-4559d1381bea service nova] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Detach interface failed, port_id=092c0b44-092b-4f3f-a7d4-8cc9a9b2c1f0, reason: Instance 337a8739-3f22-4a83-aa01-9ef8bae750cb could not be found. {{(pid=74189) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 21:40:01 user nova-compute[74189]: INFO nova.compute.manager [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: 337a8739-3f22-4a83-aa01-9ef8bae750cb] Took 1.12 seconds to detach 1 volumes for instance.
Oct 25 21:40:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:40:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:40:02 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:40:02 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:40:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:40:02 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Deleted allocations for instance 337a8739-3f22-4a83-aa01-9ef8bae750cb
Oct 25 21:40:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f5baa803-27ba-4eb3-9424-a81351febe16 tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "337a8739-3f22-4a83-aa01-9ef8bae750cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.166s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:40:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:09 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:09 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:11 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Acquiring lock "fff8f286-0baa-4865-994f-4418af3edd0a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:40:11 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "fff8f286-0baa-4865-994f-4418af3edd0a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:40:11 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:40:11 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:40:11 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:40:11 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:40:11 user nova-compute[74189]: INFO nova.compute.claims [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Claim successful on node user
Oct 25 21:40:12 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:40:12 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:40:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:40:12 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:40:12 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:40:12 user nova-compute[74189]: DEBUG nova.network.neutron [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:40:12 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:40:12 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:40:12 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:40:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:40:12 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Creating image(s)
Oct 25 21:40:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Acquiring lock "/opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:40:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "/opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:40:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "/opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:40:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:40:12 user nova-compute[74189]: DEBUG nova.policy [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9425c459e5364e3f9239908d003ab077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebe8152ff7c45b8bc0df106f7e61a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:40:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.173s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:40:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:40:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:40:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:40:12 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:40:12 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:40:12 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Rebuilding the list of instances to heal {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 21:40:12 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Skipping network cache update for instance because it is Building. {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 25 21:40:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.231s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:40:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:40:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-932fe8ac-fdde-45c6-aa32-9bf866f19a4e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:40:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-932fe8ac-fdde-45c6-aa32-9bf866f19a4e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:40:13 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:40:13 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lazy-loading 'info_cache' on Instance uuid 932fe8ac-fdde-45c6-aa32-9bf866f19a4e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:40:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk 1073741824" returned: 0 in 0.069s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:40:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:40:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:40:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.222s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:40:13 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:40:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:40:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:40:13 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Cannot resize image /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:40:13 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:40:13 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Ensure instance console log exists: /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:40:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:40:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:40:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:40:13 user nova-compute[74189]: DEBUG nova.network.neutron [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Successfully created port: 7e686cf6-429d-4de6-8bfc-c57e256bd47a {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:40:13 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Updating instance_info_cache with network_info: [{"id": "8eb6e9e2-60c6-463d-8525-b768933a94df", "address": "fa:16:3e:e8:de:d0", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb6e9e2-60", "ovs_interfaceid": "8eb6e9e2-60c6-463d-8525-b768933a94df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:40:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-932fe8ac-fdde-45c6-aa32-9bf866f19a4e" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:40:13 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.network.neutron [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Successfully updated port: 7e686cf6-429d-4de6-8bfc-c57e256bd47a {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Acquiring lock "refresh_cache-fff8f286-0baa-4865-994f-4418af3edd0a" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Acquired lock "refresh_cache-fff8f286-0baa-4865-994f-4418af3edd0a" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.network.neutron [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.compute.manager [req-96513fe1-b1cf-49c5-9e8f-217f38c187f6 req-56f65ac3-b8fc-4815-9f82-5b0e67aefe86 service nova] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Received event network-changed-7e686cf6-429d-4de6-8bfc-c57e256bd47a {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.compute.manager [req-96513fe1-b1cf-49c5-9e8f-217f38c187f6 req-56f65ac3-b8fc-4815-9f82-5b0e67aefe86 service nova] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Refreshing instance network info cache due to event network-changed-7e686cf6-429d-4de6-8bfc-c57e256bd47a. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-96513fe1-b1cf-49c5-9e8f-217f38c187f6 req-56f65ac3-b8fc-4815-9f82-5b0e67aefe86 service nova] Acquiring lock "refresh_cache-fff8f286-0baa-4865-994f-4418af3edd0a" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.network.neutron [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.network.neutron [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Updating instance_info_cache with network_info: [{"id": "7e686cf6-429d-4de6-8bfc-c57e256bd47a", "address": "fa:16:3e:b8:cf:38", "network": {"id": "0a65fa19-10fa-4360-b5f9-4faa8905e7df", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1120695373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebe8152ff7c45b8bc0df106f7e61a91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e686cf6-42", "ovs_interfaceid": "7e686cf6-429d-4de6-8bfc-c57e256bd47a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Releasing lock "refresh_cache-fff8f286-0baa-4865-994f-4418af3edd0a" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Instance network_info: |[{"id": "7e686cf6-429d-4de6-8bfc-c57e256bd47a", "address": "fa:16:3e:b8:cf:38", "network": {"id": "0a65fa19-10fa-4360-b5f9-4faa8905e7df", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1120695373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebe8152ff7c45b8bc0df106f7e61a91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e686cf6-42", "ovs_interfaceid": "7e686cf6-429d-4de6-8bfc-c57e256bd47a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-96513fe1-b1cf-49c5-9e8f-217f38c187f6 req-56f65ac3-b8fc-4815-9f82-5b0e67aefe86 service nova] Acquired lock "refresh_cache-fff8f286-0baa-4865-994f-4418af3edd0a" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.network.neutron [req-96513fe1-b1cf-49c5-9e8f-217f38c187f6 req-56f65ac3-b8fc-4815-9f82-5b0e67aefe86 service nova] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Refreshing network info cache for port 7e686cf6-429d-4de6-8bfc-c57e256bd47a {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Start _get_guest_xml network_info=[{"id": "7e686cf6-429d-4de6-8bfc-c57e256bd47a", "address": "fa:16:3e:b8:cf:38", "network": {"id": "0a65fa19-10fa-4360-b5f9-4faa8905e7df", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1120695373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebe8152ff7c45b8bc0df106f7e61a91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e686cf6-42", "ovs_interfaceid": "7e686cf6-429d-4de6-8bfc-c57e256bd47a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:40:14 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:40:14 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:40:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-727778402',display_name='tempest-SnapshotDataIntegrityTests-server-727778402',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-727778402',id=45,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJChaGAYchfI6+cZmQTo+EBnWqcpveg+fkDzaCz48wgJRof/qlTEZzhVdC7OszT4Uw2KuF+scBk2Yb4OkHPq3cQm/md0D7TF55bt6KLds401fwItaMbsz99eQkw3xNdHTQ==',key_name='tempest-keypair-1482529823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ebe8152ff7c45b8bc0df106f7e61a91',ramdisk_id='',reservation_id='r-p28be20u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1158049058',owner_user_name='tempest-SnapshotDataIntegrityTests-1158049058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:40:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9425c459e5364e3f9239908d003ab077',uuid=fff8f286-0baa-4865-994f-4418af3edd0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e686cf6-429d-4de6-8bfc-c57e256bd47a", "address": "fa:16:3e:b8:cf:38", "network": {"id": "0a65fa19-10fa-4360-b5f9-4faa8905e7df", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1120695373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebe8152ff7c45b8bc0df106f7e61a91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e686cf6-42", "ovs_interfaceid": "7e686cf6-429d-4de6-8bfc-c57e256bd47a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Converting VIF {"id": "7e686cf6-429d-4de6-8bfc-c57e256bd47a", "address": "fa:16:3e:b8:cf:38", "network": {"id": "0a65fa19-10fa-4360-b5f9-4faa8905e7df", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1120695373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebe8152ff7c45b8bc0df106f7e61a91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e686cf6-42", "ovs_interfaceid": "7e686cf6-429d-4de6-8bfc-c57e256bd47a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:cf:38,bridge_name='br-int',has_traffic_filtering=True,id=7e686cf6-429d-4de6-8bfc-c57e256bd47a,network=Network(0a65fa19-10fa-4360-b5f9-4faa8905e7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e686cf6-42') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.objects.instance [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lazy-loading 'pci_devices' on Instance uuid fff8f286-0baa-4865-994f-4418af3edd0a {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:40:14 user nova-compute[74189]:   <uuid>fff8f286-0baa-4865-994f-4418af3edd0a</uuid>
Oct 25 21:40:14 user nova-compute[74189]:   <name>instance-0000002d</name>
Oct 25 21:40:14 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:40:14 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:40:14 user nova-compute[74189]:   <metadata>
Oct 25 21:40:14 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:40:14 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:40:14 user nova-compute[74189]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-727778402</nova:name>
Oct 25 21:40:14 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:40:14</nova:creationTime>
Oct 25 21:40:14 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:40:14 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:40:14 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:40:14 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:40:14 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:40:14 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:40:14 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:40:14 user nova-compute[74189]:       <nova:owner>
Oct 25 21:40:14 user nova-compute[74189]:         <nova:user uuid="9425c459e5364e3f9239908d003ab077">tempest-SnapshotDataIntegrityTests-1158049058-project-member</nova:user>
Oct 25 21:40:14 user nova-compute[74189]:         <nova:project uuid="0ebe8152ff7c45b8bc0df106f7e61a91">tempest-SnapshotDataIntegrityTests-1158049058</nova:project>
Oct 25 21:40:14 user nova-compute[74189]:       </nova:owner>
Oct 25 21:40:14 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:40:14 user nova-compute[74189]:       <nova:ports>
Oct 25 21:40:14 user nova-compute[74189]:         <nova:port uuid="7e686cf6-429d-4de6-8bfc-c57e256bd47a">
Oct 25 21:40:14 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 25 21:40:14 user nova-compute[74189]:         </nova:port>
Oct 25 21:40:14 user nova-compute[74189]:       </nova:ports>
Oct 25 21:40:14 user nova-compute[74189]:     </nova:instance>
Oct 25 21:40:14 user nova-compute[74189]:   </metadata>
Oct 25 21:40:14 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:40:14 user nova-compute[74189]:     <system>
Oct 25 21:40:14 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:40:14 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:40:14 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:40:14 user nova-compute[74189]:       <entry name="serial">fff8f286-0baa-4865-994f-4418af3edd0a</entry>
Oct 25 21:40:14 user nova-compute[74189]:       <entry name="uuid">fff8f286-0baa-4865-994f-4418af3edd0a</entry>
Oct 25 21:40:14 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:40:14 user nova-compute[74189]:     </system>
Oct 25 21:40:14 user nova-compute[74189]:   </sysinfo>
Oct 25 21:40:14 user nova-compute[74189]:   <os>
Oct 25 21:40:14 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:40:14 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:40:14 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:40:14 user nova-compute[74189]:   </os>
Oct 25 21:40:14 user nova-compute[74189]:   <features>
Oct 25 21:40:14 user nova-compute[74189]:     <acpi/>
Oct 25 21:40:14 user nova-compute[74189]:     <apic/>
Oct 25 21:40:14 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:40:14 user nova-compute[74189]:   </features>
Oct 25 21:40:14 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:40:14 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:40:14 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:40:14 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:40:14 user nova-compute[74189]:   </clock>
Oct 25 21:40:14 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:40:14 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:40:14 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:40:14 user nova-compute[74189]:   </cpu>
Oct 25 21:40:14 user nova-compute[74189]:   <devices>
Oct 25 21:40:14 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:40:14 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:40:14 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk"/>
Oct 25 21:40:14 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:40:14 user nova-compute[74189]:     </disk>
Oct 25 21:40:14 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:40:14 user nova-compute[74189]:       <mac address="fa:16:3e:b8:cf:38"/>
Oct 25 21:40:14 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:40:14 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:40:14 user nova-compute[74189]:       <target dev="tap7e686cf6-42"/>
Oct 25 21:40:14 user nova-compute[74189]:     </interface>
Oct 25 21:40:14 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:40:14 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/console.log" append="off"/>
Oct 25 21:40:14 user nova-compute[74189]:     </serial>
Oct 25 21:40:14 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:40:14 user nova-compute[74189]:     <video>
Oct 25 21:40:14 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:40:14 user nova-compute[74189]:     </video>
Oct 25 21:40:14 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:40:14 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:40:14 user nova-compute[74189]:     </rng>
Oct 25 21:40:14 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:40:14 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:40:14 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:40:14 user nova-compute[74189]:     </memballoon>
Oct 25 21:40:14 user nova-compute[74189]:   </devices>
Oct 25 21:40:14 user nova-compute[74189]: </domain>
Oct 25 21:40:14 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:40:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-727778402',display_name='tempest-SnapshotDataIntegrityTests-server-727778402',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-727778402',id=45,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJChaGAYchfI6+cZmQTo+EBnWqcpveg+fkDzaCz48wgJRof/qlTEZzhVdC7OszT4Uw2KuF+scBk2Yb4OkHPq3cQm/md0D7TF55bt6KLds401fwItaMbsz99eQkw3xNdHTQ==',key_name='tempest-keypair-1482529823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ebe8152ff7c45b8bc0df106f7e61a91',ramdisk_id='',reservation_id='r-p28be20u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1158049058',owner_user_name='tempest-SnapshotDataIntegrityTests-1158049058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:40:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9425c459e5364e3f9239908d003ab077',uuid=fff8f286-0baa-4865-994f-4418af3edd0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e686cf6-429d-4de6-8bfc-c57e256bd47a", "address": "fa:16:3e:b8:cf:38", "network": {"id": "0a65fa19-10fa-4360-b5f9-4faa8905e7df", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1120695373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebe8152ff7c45b8bc0df106f7e61a91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e686cf6-42", "ovs_interfaceid": "7e686cf6-429d-4de6-8bfc-c57e256bd47a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Converting VIF {"id": "7e686cf6-429d-4de6-8bfc-c57e256bd47a", "address": "fa:16:3e:b8:cf:38", "network": {"id": "0a65fa19-10fa-4360-b5f9-4faa8905e7df", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1120695373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebe8152ff7c45b8bc0df106f7e61a91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e686cf6-42", "ovs_interfaceid": "7e686cf6-429d-4de6-8bfc-c57e256bd47a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:cf:38,bridge_name='br-int',has_traffic_filtering=True,id=7e686cf6-429d-4de6-8bfc-c57e256bd47a,network=Network(0a65fa19-10fa-4360-b5f9-4faa8905e7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e686cf6-42') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG os_vif [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:cf:38,bridge_name='br-int',has_traffic_filtering=True,id=7e686cf6-429d-4de6-8bfc-c57e256bd47a,network=Network(0a65fa19-10fa-4360-b5f9-4faa8905e7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e686cf6-42') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e7a0ae40-ae3f-5260-985f-aa3e73a7a6b8', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e686cf6-42, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e686cf6-42, col_values=(('qos', UUID('6f46f379-5584-488b-859f-59446211b46f')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e686cf6-42, col_values=(('external_ids', {'iface-id': '7e686cf6-429d-4de6-8bfc-c57e256bd47a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:cf:38', 'vm-uuid': 'fff8f286-0baa-4865-994f-4418af3edd0a'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:14 user nova-compute[74189]: INFO os_vif [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:cf:38,bridge_name='br-int',has_traffic_filtering=True,id=7e686cf6-429d-4de6-8bfc-c57e256bd47a,network=Network(0a65fa19-10fa-4360-b5f9-4faa8905e7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e686cf6-42')
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:40:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] No VIF found with MAC fa:16:3e:b8:cf:38, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:40:15 user nova-compute[74189]: DEBUG nova.network.neutron [req-96513fe1-b1cf-49c5-9e8f-217f38c187f6 req-56f65ac3-b8fc-4815-9f82-5b0e67aefe86 service nova] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Updated VIF entry in instance network info cache for port 7e686cf6-429d-4de6-8bfc-c57e256bd47a. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:40:15 user nova-compute[74189]: DEBUG nova.network.neutron [req-96513fe1-b1cf-49c5-9e8f-217f38c187f6 req-56f65ac3-b8fc-4815-9f82-5b0e67aefe86 service nova] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Updating instance_info_cache with network_info: [{"id": "7e686cf6-429d-4de6-8bfc-c57e256bd47a", "address": "fa:16:3e:b8:cf:38", "network": {"id": "0a65fa19-10fa-4360-b5f9-4faa8905e7df", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1120695373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebe8152ff7c45b8bc0df106f7e61a91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e686cf6-42", "ovs_interfaceid": "7e686cf6-429d-4de6-8bfc-c57e256bd47a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:40:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-96513fe1-b1cf-49c5-9e8f-217f38c187f6 req-56f65ac3-b8fc-4815-9f82-5b0e67aefe86 service nova] Releasing lock "refresh_cache-fff8f286-0baa-4865-994f-4418af3edd0a" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:40:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:16 user nova-compute[74189]: DEBUG nova.compute.manager [req-27b92fc8-9931-4dba-89b8-06d25432a572 req-f4c3f14d-3567-4770-a554-4ac43b5c0765 service nova] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Received event network-vif-plugged-7e686cf6-429d-4de6-8bfc-c57e256bd47a {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:40:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-27b92fc8-9931-4dba-89b8-06d25432a572 req-f4c3f14d-3567-4770-a554-4ac43b5c0765 service nova] Acquiring lock "fff8f286-0baa-4865-994f-4418af3edd0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:40:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-27b92fc8-9931-4dba-89b8-06d25432a572 req-f4c3f14d-3567-4770-a554-4ac43b5c0765 service nova] Lock "fff8f286-0baa-4865-994f-4418af3edd0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:40:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-27b92fc8-9931-4dba-89b8-06d25432a572 req-f4c3f14d-3567-4770-a554-4ac43b5c0765 service nova] Lock "fff8f286-0baa-4865-994f-4418af3edd0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:40:16 user nova-compute[74189]: DEBUG nova.compute.manager [req-27b92fc8-9931-4dba-89b8-06d25432a572 req-f4c3f14d-3567-4770-a554-4ac43b5c0765 service nova] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] No waiting events found dispatching network-vif-plugged-7e686cf6-429d-4de6-8bfc-c57e256bd47a {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:40:16 user nova-compute[74189]: WARNING nova.compute.manager [req-27b92fc8-9931-4dba-89b8-06d25432a572 req-f4c3f14d-3567-4770-a554-4ac43b5c0765 service nova] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Received unexpected event network-vif-plugged-7e686cf6-429d-4de6-8bfc-c57e256bd47a for instance with vm_state building and task_state spawning.
Oct 25 21:40:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:17 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:40:17 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:40:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:40:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:40:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:40:17 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:40:18 user nova-compute[74189]: DEBUG nova.compute.manager [req-42e2524e-b196-41d3-b6b9-17e7a971301a req-8ecab8e1-5237-4b46-9660-fcf50dfbe0f2 service nova] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Received event network-vif-plugged-7e686cf6-429d-4de6-8bfc-c57e256bd47a {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:40:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-42e2524e-b196-41d3-b6b9-17e7a971301a req-8ecab8e1-5237-4b46-9660-fcf50dfbe0f2 service nova] Acquiring lock "fff8f286-0baa-4865-994f-4418af3edd0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:40:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-42e2524e-b196-41d3-b6b9-17e7a971301a req-8ecab8e1-5237-4b46-9660-fcf50dfbe0f2 service nova] Lock "fff8f286-0baa-4865-994f-4418af3edd0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:40:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-42e2524e-b196-41d3-b6b9-17e7a971301a req-8ecab8e1-5237-4b46-9660-fcf50dfbe0f2 service nova] Lock "fff8f286-0baa-4865-994f-4418af3edd0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:40:18 user nova-compute[74189]: DEBUG nova.compute.manager [req-42e2524e-b196-41d3-b6b9-17e7a971301a req-8ecab8e1-5237-4b46-9660-fcf50dfbe0f2 service nova] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] No waiting events found dispatching network-vif-plugged-7e686cf6-429d-4de6-8bfc-c57e256bd47a {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:40:18 user nova-compute[74189]: WARNING nova.compute.manager [req-42e2524e-b196-41d3-b6b9-17e7a971301a req-8ecab8e1-5237-4b46-9660-fcf50dfbe0f2 service nova] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Received unexpected event network-vif-plugged-7e686cf6-429d-4de6-8bfc-c57e256bd47a for instance with vm_state building and task_state spawning.
Oct 25 21:40:18 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:40:18 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:40:18 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Instance spawned successfully.
Oct 25 21:40:18 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:40:18 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:40:18 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:40:18 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:40:18 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:40:18 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:40:18 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:40:18 user nova-compute[74189]: INFO nova.compute.manager [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Took 6.16 seconds to spawn the instance on the hypervisor.
Oct 25 21:40:18 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:40:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be371e0c-ebc8-46f7-89eb-44b55f4adf90/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:40:18 user nova-compute[74189]: INFO nova.compute.manager [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Took 7.00 seconds to build instance.
Oct 25 21:40:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5beeba4e-7e50-425e-b87d-9f14f8a4a239 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "fff8f286-0baa-4865-994f-4418af3edd0a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.133s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:40:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be371e0c-ebc8-46f7-89eb-44b55f4adf90/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:40:18 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be371e0c-ebc8-46f7-89eb-44b55f4adf90/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:40:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be371e0c-ebc8-46f7-89eb-44b55f4adf90/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:40:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:40:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:40:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:40:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:40:19 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:40:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:40:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:40:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:40:19 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:40:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:40:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:40:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:40:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:40:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:40:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json" returned: 0 in 0.225s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:40:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:40:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "1926c2ce-9643-4d00-9f54-a6747e71875b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:40:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "1926c2ce-9643-4d00-9f54-a6747e71875b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:40:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "1926c2ce-9643-4d00-9f54-a6747e71875b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:40:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "1926c2ce-9643-4d00-9f54-a6747e71875b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:40:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "1926c2ce-9643-4d00-9f54-a6747e71875b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:40:20 user nova-compute[74189]: INFO nova.compute.manager [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Terminating instance
Oct 25 21:40:20 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:40:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:40:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG nova.compute.manager [req-efb65141-33ca-4bc9-9dba-9baaa09c93e8 req-2fbdca07-f5eb-4a82-9ca4-7462b07b8d07 service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Received event network-vif-unplugged-5d26f4c0-286d-4528-95fc-2d881f739fd2 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-efb65141-33ca-4bc9-9dba-9baaa09c93e8 req-2fbdca07-f5eb-4a82-9ca4-7462b07b8d07 service nova] Acquiring lock "1926c2ce-9643-4d00-9f54-a6747e71875b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-efb65141-33ca-4bc9-9dba-9baaa09c93e8 req-2fbdca07-f5eb-4a82-9ca4-7462b07b8d07 service nova] Lock "1926c2ce-9643-4d00-9f54-a6747e71875b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-efb65141-33ca-4bc9-9dba-9baaa09c93e8 req-2fbdca07-f5eb-4a82-9ca4-7462b07b8d07 service nova] Lock "1926c2ce-9643-4d00-9f54-a6747e71875b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG nova.compute.manager [req-efb65141-33ca-4bc9-9dba-9baaa09c93e8 req-2fbdca07-f5eb-4a82-9ca4-7462b07b8d07 service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] No waiting events found dispatching network-vif-unplugged-5d26f4c0-286d-4528-95fc-2d881f739fd2 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG nova.compute.manager [req-efb65141-33ca-4bc9-9dba-9baaa09c93e8 req-2fbdca07-f5eb-4a82-9ca4-7462b07b8d07 service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Received event network-vif-unplugged-5d26f4c0-286d-4528-95fc-2d881f739fd2 for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2b9013-4a8b-4f8d-a5dc-42842cd987a7/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2b9013-4a8b-4f8d-a5dc-42842cd987a7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2b9013-4a8b-4f8d-a5dc-42842cd987a7/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:40:21 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Instance destroyed successfully.
Oct 25 21:40:21 user nova-compute[74189]: DEBUG nova.objects.instance [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lazy-loading 'resources' on Instance uuid 1926c2ce-9643-4d00-9f54-a6747e71875b {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:33:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1901274081',display_name='tempest-ServerActionsTestOtherA-server-1901274081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1901274081',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2S7seSL6H542o42+kjhdFVCcVB3vmP0zFQehKH4IjkXrBgeXgKPGixJeOzeDKKnbCU86Dz8L3oU7gAYCj2cW/f6u+7OuTUBmRTwo8tpApDh9NwCKVzKxF9Lu0jaZZAvw==',key_name='tempest-keypair-2141227250',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:36:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4815aedea48841188ed8797a0eb51925',ramdisk_id='',reservation_id='r-984gu0e6',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1355855048',owner_user_name='tempest-ServerActionsTestOtherA-1355855048-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:37:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b34817b1868f40a38a32a51d0e970d51',uuid=1926c2ce-9643-4d00-9f54-a6747e71875b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "address": "fa:16:3e:6e:2f:0e", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d26f4c0-28", "ovs_interfaceid": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Converting VIF {"id": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "address": "fa:16:3e:6e:2f:0e", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d26f4c0-28", "ovs_interfaceid": "5d26f4c0-286d-4528-95fc-2d881f739fd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:2f:0e,bridge_name='br-int',has_traffic_filtering=True,id=5d26f4c0-286d-4528-95fc-2d881f739fd2,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d26f4c0-28') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG os_vif [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:2f:0e,bridge_name='br-int',has_traffic_filtering=True,id=5d26f4c0-286d-4528-95fc-2d881f739fd2,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d26f4c0-28') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d26f4c0-28, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38ec57c4-706c-44b4-a648-5b19e29e2971) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:40:21 user nova-compute[74189]: INFO os_vif [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:2f:0e,bridge_name='br-int',has_traffic_filtering=True,id=5d26f4c0-286d-4528-95fc-2d881f739fd2,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d26f4c0-28')
Oct 25 21:40:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsJSLGjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:40:21 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:40:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aca2dd0-1b38-45db-8477-4f6a5e56ee1d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:40:21 user nova-compute[74189]: No targets found.
Oct 25 21:40:21 user nova-compute[74189]: iSNS:
Oct 25 21:40:21 user nova-compute[74189]: No targets found.
Oct 25 21:40:21 user nova-compute[74189]: STATIC:
Oct 25 21:40:21 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d
Oct 25 21:40:21 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:40:21 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:40:21 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98
Oct 25 21:40:21 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:40:21 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:40:21 user nova-compute[74189]: FIRMWARE:
Oct 25 21:40:21 user nova-compute[74189]: No targets found.
Oct 25 21:40:21 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:40:21 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:40:21 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2b9013-4a8b-4f8d-a5dc-42842cd987a7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f210e3fc-e932-46c1-af9c-747bc15b44e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8e6210-5e80-499c-8536-78a8f0f8f792]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:40:21 user nova-compute[74189]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)
Oct 25 21:40:21 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 (non-flash)
Oct 25 21:40:21 user nova-compute[74189]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)
Oct 25 21:40:21 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2c47088b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98'): ({'sdd'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Removing single pathed devices sdd {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4867451a-aad5-404e-9ee5-70bd1280b0fd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1384e642-5f74-4885-a3b7-1a514b19e9ab]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Flushing IO for device /dev/sdd {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.032s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[21feb415-e4f6-46b3-be77-dac15386406c]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:40:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3325379b-a205-46fe-92f7-9012dc13459e]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] SCSI volumes sdd have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO22d79a25-aa13b3482cc84e27', '/dev/disk/by-id/scsi-26161313362333438', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_22d79a25') {{(pid=85079) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 25 21:40:22 user nova-compute[74189]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO22d79a25-aa13b3482cc84e27
Oct 25 21:40:22 user nova-compute[74189]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26161313362333438
Oct 25 21:40:22 user nova-compute[74189]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_22d79a25
Oct 25 21:40:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99a8096-a8a1-45a8-a6e4-80b05b508b17]: (4, None) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf2084a-6221-4add-a9c0-b997a1c14149]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc2435e-3c27-4ef3-bb2c-e1c50dc137e1]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98, portal: 172.16.0.220,3260]
Oct 25 21:40:22 user nova-compute[74189]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98, portal: 172.16.0.220,3260] successful.
Oct 25 21:40:22 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb01afd-1b09-48a3-ab75-9326700c7e98 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0dfc5d-aa39-4fa9-b8f1-305cfc4ffde0]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] <== disconnect_volume: return (423ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:40:22 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Deleting instance files /opt/stack/data/nova/instances/1926c2ce-9643-4d00-9f54-a6747e71875b_del
Oct 25 21:40:22 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Deletion of /opt/stack/data/nova/instances/1926c2ce-9643-4d00-9f54-a6747e71875b_del complete
Oct 25 21:40:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:40:22 user nova-compute[74189]: INFO nova.compute.manager [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Took 1.45 seconds to destroy the instance on the hypervisor.
Oct 25 21:40:22 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:40:22 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:40:22 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:40:22 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=7613MB free_disk=24.980613708496094GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 932fe8ac-fdde-45c6-aa32-9bf866f19a4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3da14c0a-31a8-4fe3-bd5a-49378680af50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 1926c2ce-9643-4d00-9f54-a6747e71875b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance dcb582a2-5198-44aa-bbe8-48978975e9eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance aa2b9013-4a8b-4f8d-a5dc-42842cd987a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance be371e0c-ebc8-46f7-89eb-44b55f4adf90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 915a1d25-6499-4d3e-9edd-5f3cfd487bac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance fff8f286-0baa-4865-994f-4418af3edd0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:40:22 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:40:23 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:40:23 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:40:23 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:40:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.566s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:40:23 user nova-compute[74189]: DEBUG nova.compute.manager [req-c4a766ec-d5b0-4afc-8d49-79fd4eb3976c req-79c6fff3-6cd5-4044-90f3-e1e2cbdb9f3f service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Received event network-vif-plugged-5d26f4c0-286d-4528-95fc-2d881f739fd2 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:40:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c4a766ec-d5b0-4afc-8d49-79fd4eb3976c req-79c6fff3-6cd5-4044-90f3-e1e2cbdb9f3f service nova] Acquiring lock "1926c2ce-9643-4d00-9f54-a6747e71875b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:40:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c4a766ec-d5b0-4afc-8d49-79fd4eb3976c req-79c6fff3-6cd5-4044-90f3-e1e2cbdb9f3f service nova] Lock "1926c2ce-9643-4d00-9f54-a6747e71875b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:40:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c4a766ec-d5b0-4afc-8d49-79fd4eb3976c req-79c6fff3-6cd5-4044-90f3-e1e2cbdb9f3f service nova] Lock "1926c2ce-9643-4d00-9f54-a6747e71875b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:40:23 user nova-compute[74189]: DEBUG nova.compute.manager [req-c4a766ec-d5b0-4afc-8d49-79fd4eb3976c req-79c6fff3-6cd5-4044-90f3-e1e2cbdb9f3f service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] No waiting events found dispatching network-vif-plugged-5d26f4c0-286d-4528-95fc-2d881f739fd2 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:40:23 user nova-compute[74189]: WARNING nova.compute.manager [req-c4a766ec-d5b0-4afc-8d49-79fd4eb3976c req-79c6fff3-6cd5-4044-90f3-e1e2cbdb9f3f service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Received unexpected event network-vif-plugged-5d26f4c0-286d-4528-95fc-2d881f739fd2 for instance with vm_state active and task_state deleting.
Oct 25 21:40:23 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:40:23 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Took 1.39 seconds to deallocate network for instance.
Oct 25 21:40:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:24 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:40:24 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:40:24 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:40:24 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:40:24 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:40:24 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:40:24 user nova-compute[74189]: INFO nova.compute.manager [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Took 0.98 seconds to detach 1 volumes for instance.
Oct 25 21:40:24 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Deleting volume: 4eb01afd-1b09-48a3-ab75-9326700c7e98 {{(pid=74189) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 25 21:40:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:40:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:40:25 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:40:25 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:40:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:40:25 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Deleted allocations for instance 1926c2ce-9643-4d00-9f54-a6747e71875b
Oct 25 21:40:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5303886a-7559-4848-aa6f-c503a7145cf1 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "1926c2ce-9643-4d00-9f54-a6747e71875b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.545s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:40:25 user nova-compute[74189]: DEBUG nova.compute.manager [req-4a221886-1690-4fb4-b882-ac77d1663405 req-dc468691-7df6-43fd-b330-84d0ca3eebef service nova] [instance: 1926c2ce-9643-4d00-9f54-a6747e71875b] Received event network-vif-deleted-5d26f4c0-286d-4528-95fc-2d881f739fd2 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:40:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:28 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:40:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:46 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:51 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:40:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:11 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:14 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:41:14 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:41:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:41:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:41:14 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:41:15 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Updating instance_info_cache with network_info: [{"id": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "address": "fa:16:3e:5d:2c:57", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d0e911-b6", "ovs_interfaceid": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:41:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:41:15 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:41:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:18 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:41:19 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:41:19 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:41:19 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:41:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:41:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:41:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:41:19 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:41:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be371e0c-ebc8-46f7-89eb-44b55f4adf90/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be371e0c-ebc8-46f7-89eb-44b55f4adf90/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be371e0c-ebc8-46f7-89eb-44b55f4adf90/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be371e0c-ebc8-46f7-89eb-44b55f4adf90/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:41:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:20 user nova-compute[74189]: DEBUG nova.compute.manager [req-f5cca40f-1218-4e8f-820d-b687c50937d5 req-33782063-8010-47b3-9b25-cc3aed751372 service nova] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Received event network-changed-0b83b195-15ba-461f-87f1-465a6a1066ce {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:41:20 user nova-compute[74189]: DEBUG nova.compute.manager [req-f5cca40f-1218-4e8f-820d-b687c50937d5 req-33782063-8010-47b3-9b25-cc3aed751372 service nova] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Refreshing instance network info cache due to event network-changed-0b83b195-15ba-461f-87f1-465a6a1066ce. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:41:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f5cca40f-1218-4e8f-820d-b687c50937d5 req-33782063-8010-47b3-9b25-cc3aed751372 service nova] Acquiring lock "refresh_cache-dcb582a2-5198-44aa-bbe8-48978975e9eb" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:41:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f5cca40f-1218-4e8f-820d-b687c50937d5 req-33782063-8010-47b3-9b25-cc3aed751372 service nova] Acquired lock "refresh_cache-dcb582a2-5198-44aa-bbe8-48978975e9eb" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:41:20 user nova-compute[74189]: DEBUG nova.network.neutron [req-f5cca40f-1218-4e8f-820d-b687c50937d5 req-33782063-8010-47b3-9b25-cc3aed751372 service nova] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Refreshing network info cache for port 0b83b195-15ba-461f-87f1-465a6a1066ce {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "dcb582a2-5198-44aa-bbe8-48978975e9eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "dcb582a2-5198-44aa-bbe8-48978975e9eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "dcb582a2-5198-44aa-bbe8-48978975e9eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "dcb582a2-5198-44aa-bbe8-48978975e9eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "dcb582a2-5198-44aa-bbe8-48978975e9eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:41:21 user nova-compute[74189]: INFO nova.compute.manager [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Terminating instance
Oct 25 21:41:21 user nova-compute[74189]: DEBUG nova.compute.manager [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG nova.network.neutron [req-f5cca40f-1218-4e8f-820d-b687c50937d5 req-33782063-8010-47b3-9b25-cc3aed751372 service nova] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Updated VIF entry in instance network info cache for port 0b83b195-15ba-461f-87f1-465a6a1066ce. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG nova.network.neutron [req-f5cca40f-1218-4e8f-820d-b687c50937d5 req-33782063-8010-47b3-9b25-cc3aed751372 service nova] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Updating instance_info_cache with network_info: [{"id": "0b83b195-15ba-461f-87f1-465a6a1066ce", "address": "fa:16:3e:34:0f:94", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b83b195-15", "ovs_interfaceid": "0b83b195-15ba-461f-87f1-465a6a1066ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f5cca40f-1218-4e8f-820d-b687c50937d5 req-33782063-8010-47b3-9b25-cc3aed751372 service nova] Releasing lock "refresh_cache-dcb582a2-5198-44aa-bbe8-48978975e9eb" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:21 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Instance destroyed successfully.
Oct 25 21:41:21 user nova-compute[74189]: DEBUG nova.objects.instance [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lazy-loading 'resources' on Instance uuid dcb582a2-5198-44aa-bbe8-48978975e9eb {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:35:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1992719043',display_name='tempest-TestVolumeBootPattern-server-1992719043',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1992719043',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbWjlurUdlTqM38TJIvyWArBvgtPS5ByZ7GvbbNhterPxeMByoQxHeDSj3q/FAwbfZCzxGnbhX1L/9RQ/CSBOb1BJ9rZaqesREBo++7UKa99YIwO5kH0uL2CiEzhHllXw==',key_name='tempest-TestVolumeBootPattern-16841960',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:36:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e893e8f3f58e4e15920d313b6391682c',ramdisk_id='',reservation_id='r-l6yc2bcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1934687878',owner_user_name='tempest-TestVolumeBootPattern-1934687878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:36:21Z,user_data=None,user_id='77a27a7ebb4a458097c901871c378bc8',uuid=dcb582a2-5198-44aa-bbe8-48978975e9eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b83b195-15ba-461f-87f1-465a6a1066ce", "address": "fa:16:3e:34:0f:94", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b83b195-15", "ovs_interfaceid": "0b83b195-15ba-461f-87f1-465a6a1066ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converting VIF {"id": "0b83b195-15ba-461f-87f1-465a6a1066ce", "address": "fa:16:3e:34:0f:94", "network": {"id": "a8d301e4-90d5-46e6-a5cd-027d1447a233", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1630456087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e893e8f3f58e4e15920d313b6391682c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b83b195-15", "ovs_interfaceid": "0b83b195-15ba-461f-87f1-465a6a1066ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:0f:94,bridge_name='br-int',has_traffic_filtering=True,id=0b83b195-15ba-461f-87f1-465a6a1066ce,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b83b195-15') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG os_vif [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:0f:94,bridge_name='br-int',has_traffic_filtering=True,id=0b83b195-15ba-461f-87f1-465a6a1066ce,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b83b195-15') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b83b195-15, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab93cb43-dbdd-4f08-8497-ea6d50fe1857) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:41:21 user nova-compute[74189]: INFO os_vif [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:0f:94,bridge_name='br-int',has_traffic_filtering=True,id=0b83b195-15ba-461f-87f1-465a6a1066ce,network=Network(a8d301e4-90d5-46e6-a5cd-027d1447a233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b83b195-15')
Oct 25 21:41:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oXdtAbSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:41:21 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:41:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6475d3d2-8944-4ca4-9583-6f47d69e6de6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:41:21 user nova-compute[74189]: No targets found.
Oct 25 21:41:21 user nova-compute[74189]: iSNS:
Oct 25 21:41:21 user nova-compute[74189]: No targets found.
Oct 25 21:41:21 user nova-compute[74189]: STATIC:
Oct 25 21:41:21 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d
Oct 25 21:41:21 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:41:21 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:41:21 user nova-compute[74189]: FIRMWARE:
Oct 25 21:41:21 user nova-compute[74189]: No targets found.
Oct 25 21:41:21 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:41:21 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:41:21 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:41:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6061afea-1b14-4102-8f7d-35ed150f2527]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a110b093-1f28-4f25-bcd6-78ab091be0ce]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)
Oct 25 21:41:22 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d (non-flash)
Oct 25 21:41:22 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2c471f9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d'): ({'sdc'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Removing single pathed devices sdc {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[11abe639-edc9-4a96-8469-235db7e2d4c0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[221a2685-0c17-4041-a394-e0c01b29abc8]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Flushing IO for device /dev/sdc {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9cedfc-3cb9-40da-a3ee-c97069906aa5]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.063s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0362a684-c17e-40c9-81d1-d174a673ff33]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] SCSI volumes sdc have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[12437736-6b9d-404d-bf76-d0ad82a91dfa]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f5441c-3181-4ae8-a46b-cd7574ae1cc3]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d, portal: 172.16.0.220,3260]
Oct 25 21:41:22 user nova-compute[74189]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d, portal: 172.16.0.220,3260] successful.
Oct 25 21:41:22 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-37f018df-26ab-4a7b-a7bf-5a6deb14d789 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "932fe8ac-fdde-45c6-aa32-9bf866f19a4e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-37f018df-26ab-4a7b-a7bf-5a6deb14d789 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "932fe8ac-fdde-45c6-aa32-9bf866f19a4e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-37f018df-26ab-4a7b-a7bf-5a6deb14d789 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "932fe8ac-fdde-45c6-aa32-9bf866f19a4e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-37f018df-26ab-4a7b-a7bf-5a6deb14d789 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "932fe8ac-fdde-45c6-aa32-9bf866f19a4e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-37f018df-26ab-4a7b-a7bf-5a6deb14d789 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "932fe8ac-fdde-45c6-aa32-9bf866f19a4e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:41:22 user nova-compute[74189]: INFO nova.compute.manager [None req-37f018df-26ab-4a7b-a7bf-5a6deb14d789 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Terminating instance
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c22cfde-db3c-4c83-994c-46925b21920d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc5f2d0-512f-40c2-abfe-beed555ad51b]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] <== disconnect_volume: return (412ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:41:22 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Deleting instance files /opt/stack/data/nova/instances/dcb582a2-5198-44aa-bbe8-48978975e9eb_del
Oct 25 21:41:22 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Deletion of /opt/stack/data/nova/instances/dcb582a2-5198-44aa-bbe8-48978975e9eb_del complete
Oct 25 21:41:22 user nova-compute[74189]: DEBUG nova.compute.manager [None req-37f018df-26ab-4a7b-a7bf-5a6deb14d789 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2b9013-4a8b-4f8d-a5dc-42842cd987a7/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:22 user nova-compute[74189]: INFO nova.compute.manager [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Took 1.42 seconds to destroy the instance on the hypervisor.
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2b9013-4a8b-4f8d-a5dc-42842cd987a7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2b9013-4a8b-4f8d-a5dc-42842cd987a7/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2b9013-4a8b-4f8d-a5dc-42842cd987a7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:23 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Instance destroyed successfully.
Oct 25 21:41:23 user nova-compute[74189]: DEBUG nova.objects.instance [None req-37f018df-26ab-4a7b-a7bf-5a6deb14d789 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lazy-loading 'resources' on Instance uuid 932fe8ac-fdde-45c6-aa32-9bf866f19a4e {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-37f018df-26ab-4a7b-a7bf-5a6deb14d789 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:21:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-944612279',display_name='tempest-ServerActionsTestOtherA-server-944612279',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-944612279',id=18,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2S7seSL6H542o42+kjhdFVCcVB3vmP0zFQehKH4IjkXrBgeXgKPGixJeOzeDKKnbCU86Dz8L3oU7gAYCj2cW/f6u+7OuTUBmRTwo8tpApDh9NwCKVzKxF9Lu0jaZZAvw==',key_name='tempest-keypair-2141227250',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:22:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4815aedea48841188ed8797a0eb51925',ramdisk_id='',reservation_id='r-fqo400nx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1355855048',owner_user_name='tempest-ServerActionsTestOtherA-1355855048-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:22:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b34817b1868f40a38a32a51d0e970d51',uuid=932fe8ac-fdde-45c6-aa32-9bf866f19a4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8eb6e9e2-60c6-463d-8525-b768933a94df", "address": "fa:16:3e:e8:de:d0", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb6e9e2-60", "ovs_interfaceid": "8eb6e9e2-60c6-463d-8525-b768933a94df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-37f018df-26ab-4a7b-a7bf-5a6deb14d789 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Converting VIF {"id": "8eb6e9e2-60c6-463d-8525-b768933a94df", "address": "fa:16:3e:e8:de:d0", "network": {"id": "8b22c71c-d31c-4786-84ad-76bdec1e1bbc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-94415228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4815aedea48841188ed8797a0eb51925", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb6e9e2-60", "ovs_interfaceid": "8eb6e9e2-60c6-463d-8525-b768933a94df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-37f018df-26ab-4a7b-a7bf-5a6deb14d789 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:de:d0,bridge_name='br-int',has_traffic_filtering=True,id=8eb6e9e2-60c6-463d-8525-b768933a94df,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eb6e9e2-60') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG os_vif [None req-37f018df-26ab-4a7b-a7bf-5a6deb14d789 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:de:d0,bridge_name='br-int',has_traffic_filtering=True,id=8eb6e9e2-60c6-463d-8525-b768933a94df,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eb6e9e2-60') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG nova.compute.manager [req-c7130f14-69ab-4bc1-bf05-674d10905260 req-f06e0f09-9c41-41b1-809f-845a4d7d0389 service nova] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Received event network-vif-unplugged-0b83b195-15ba-461f-87f1-465a6a1066ce {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c7130f14-69ab-4bc1-bf05-674d10905260 req-f06e0f09-9c41-41b1-809f-845a4d7d0389 service nova] Acquiring lock "dcb582a2-5198-44aa-bbe8-48978975e9eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c7130f14-69ab-4bc1-bf05-674d10905260 req-f06e0f09-9c41-41b1-809f-845a4d7d0389 service nova] Lock "dcb582a2-5198-44aa-bbe8-48978975e9eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c7130f14-69ab-4bc1-bf05-674d10905260 req-f06e0f09-9c41-41b1-809f-845a4d7d0389 service nova] Lock "dcb582a2-5198-44aa-bbe8-48978975e9eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG nova.compute.manager [req-c7130f14-69ab-4bc1-bf05-674d10905260 req-f06e0f09-9c41-41b1-809f-845a4d7d0389 service nova] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] No waiting events found dispatching network-vif-unplugged-0b83b195-15ba-461f-87f1-465a6a1066ce {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG nova.compute.manager [req-c7130f14-69ab-4bc1-bf05-674d10905260 req-f06e0f09-9c41-41b1-809f-845a4d7d0389 service nova] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Received event network-vif-unplugged-0b83b195-15ba-461f-87f1-465a6a1066ce for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG nova.compute.manager [req-c7130f14-69ab-4bc1-bf05-674d10905260 req-f06e0f09-9c41-41b1-809f-845a4d7d0389 service nova] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Received event network-vif-plugged-0b83b195-15ba-461f-87f1-465a6a1066ce {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c7130f14-69ab-4bc1-bf05-674d10905260 req-f06e0f09-9c41-41b1-809f-845a4d7d0389 service nova] Acquiring lock "dcb582a2-5198-44aa-bbe8-48978975e9eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c7130f14-69ab-4bc1-bf05-674d10905260 req-f06e0f09-9c41-41b1-809f-845a4d7d0389 service nova] Lock "dcb582a2-5198-44aa-bbe8-48978975e9eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c7130f14-69ab-4bc1-bf05-674d10905260 req-f06e0f09-9c41-41b1-809f-845a4d7d0389 service nova] Lock "dcb582a2-5198-44aa-bbe8-48978975e9eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG nova.compute.manager [req-c7130f14-69ab-4bc1-bf05-674d10905260 req-f06e0f09-9c41-41b1-809f-845a4d7d0389 service nova] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] No waiting events found dispatching network-vif-plugged-0b83b195-15ba-461f-87f1-465a6a1066ce {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:41:23 user nova-compute[74189]: WARNING nova.compute.manager [req-c7130f14-69ab-4bc1-bf05-674d10905260 req-f06e0f09-9c41-41b1-809f-845a4d7d0389 service nova] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Received unexpected event network-vif-plugged-0b83b195-15ba-461f-87f1-465a6a1066ce for instance with vm_state active and task_state deleting.
Oct 25 21:41:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8eb6e9e2-60, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9cb8e7ac-1363-4fec-b3c3-bc08a621eb75) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:41:23 user nova-compute[74189]: INFO os_vif [None req-37f018df-26ab-4a7b-a7bf-5a6deb14d789 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:de:d0,bridge_name='br-int',has_traffic_filtering=True,id=8eb6e9e2-60c6-463d-8525-b768933a94df,network=Network(8b22c71c-d31c-4786-84ad-76bdec1e1bbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eb6e9e2-60')
Oct 25 21:41:23 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-37f018df-26ab-4a7b-a7bf-5a6deb14d789 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Deleting instance files /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e_del
Oct 25 21:41:23 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-37f018df-26ab-4a7b-a7bf-5a6deb14d789 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Deletion of /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e_del complete
Oct 25 21:41:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json" returned: 1 in 0.173s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk --force-share --output=json' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:41:23 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000012, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/932fe8ac-fdde-45c6-aa32-9bf866f19a4e/disk
Oct 25 21:41:23 user nova-compute[74189]: DEBUG nova.compute.manager [req-97c38c58-ed51-4c9b-8e7d-ba7ed6552ad9 req-39827d09-acde-4ed9-b5bd-962df942b498 service nova] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Received event network-vif-unplugged-8eb6e9e2-60c6-463d-8525-b768933a94df {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-97c38c58-ed51-4c9b-8e7d-ba7ed6552ad9 req-39827d09-acde-4ed9-b5bd-962df942b498 service nova] Acquiring lock "932fe8ac-fdde-45c6-aa32-9bf866f19a4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-97c38c58-ed51-4c9b-8e7d-ba7ed6552ad9 req-39827d09-acde-4ed9-b5bd-962df942b498 service nova] Lock "932fe8ac-fdde-45c6-aa32-9bf866f19a4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-97c38c58-ed51-4c9b-8e7d-ba7ed6552ad9 req-39827d09-acde-4ed9-b5bd-962df942b498 service nova] Lock "932fe8ac-fdde-45c6-aa32-9bf866f19a4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG nova.compute.manager [req-97c38c58-ed51-4c9b-8e7d-ba7ed6552ad9 req-39827d09-acde-4ed9-b5bd-962df942b498 service nova] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] No waiting events found dispatching network-vif-unplugged-8eb6e9e2-60c6-463d-8525-b768933a94df {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG nova.compute.manager [req-97c38c58-ed51-4c9b-8e7d-ba7ed6552ad9 req-39827d09-acde-4ed9-b5bd-962df942b498 service nova] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Received event network-vif-unplugged-8eb6e9e2-60c6-463d-8525-b768933a94df for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:41:23 user nova-compute[74189]: INFO nova.compute.manager [None req-37f018df-26ab-4a7b-a7bf-5a6deb14d789 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Took 1.24 seconds to destroy the instance on the hypervisor.
Oct 25 21:41:23 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-37f018df-26ab-4a7b-a7bf-5a6deb14d789 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:41:23 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:41:23 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:41:23 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=7792MB free_disk=24.946880340576172GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 932fe8ac-fdde-45c6-aa32-9bf866f19a4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3da14c0a-31a8-4fe3-bd5a-49378680af50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance dcb582a2-5198-44aa-bbe8-48978975e9eb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance aa2b9013-4a8b-4f8d-a5dc-42842cd987a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance be371e0c-ebc8-46f7-89eb-44b55f4adf90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 915a1d25-6499-4d3e-9edd-5f3cfd487bac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance fff8f286-0baa-4865-994f-4418af3edd0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Acquiring lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG nova.objects.instance [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lazy-loading 'flavor' on Instance uuid aa2b9013-4a8b-4f8d-a5dc-42842cd987a7 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:41:23 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:41:23 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Took 1.32 seconds to deallocate network for instance.
Oct 25 21:41:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:41:24 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:41:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Acquiring lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:41:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:41:24 user nova-compute[74189]: INFO nova.compute.manager [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Attaching volume 0ddb81d0-cc03-4175-ae74-e6a70fd02772 to /dev/vdb
Oct 25 21:41:24 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:41:24 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:41:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.481s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:41:24 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:41:24 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74189) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 21:41:24 user nova-compute[74189]: DEBUG os_brick.utils [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:41:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:24 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:41:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:24 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[479a8a0a-24af-4fa0-b88e-f5cd96c7e112]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:24 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Took 0.56 seconds to deallocate network for instance.
Oct 25 21:41:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:24 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[74da188c-c711-46a2-9f09-585126c89ca2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:24 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a81848-c911-4d41-a2a7-2593e281c930]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:24 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[886c8a66-b0c2-400e-b069-49701182a282]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:41:24 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:41:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-37f018df-26ab-4a7b-a7bf-5a6deb14d789 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:41:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-37f018df-26ab-4a7b-a7bf-5a6deb14d789 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:41:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:41:24 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:41:24 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[582fcb7f-ed46-499e-ab6b-7977dab351ee]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:24 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:41:24 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:41:24 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:41:24 user nova-compute[74189]: DEBUG os_brick.utils [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:41:24 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Updating existing volume attachment record: 9e6f40c5-e26d-4852-a012-97a44c1c3864 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:41:24 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-37f018df-26ab-4a7b-a7bf-5a6deb14d789 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:41:24 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-37f018df-26ab-4a7b-a7bf-5a6deb14d789 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:41:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-37f018df-26ab-4a7b-a7bf-5a6deb14d789 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:41:24 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-37f018df-26ab-4a7b-a7bf-5a6deb14d789 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Deleted allocations for instance 932fe8ac-fdde-45c6-aa32-9bf866f19a4e
Oct 25 21:41:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-37f018df-26ab-4a7b-a7bf-5a6deb14d789 tempest-ServerActionsTestOtherA-1355855048 tempest-ServerActionsTestOtherA-1355855048-project-member] Lock "932fe8ac-fdde-45c6-aa32-9bf866f19a4e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.467s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:41:24 user nova-compute[74189]: INFO nova.compute.manager [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Took 1.13 seconds to detach 1 volumes for instance.
Oct 25 21:41:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:41:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:41:25 user nova-compute[74189]: DEBUG nova.compute.manager [req-4d7a844e-6556-4810-b8e7-7b165f374bc2 req-9f8c5f94-ad46-45e0-a0d4-2821d8e0b037 service nova] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Received event network-changed-af0547c4-bcad-40cb-9183-e3fd84c1c8fb {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:41:25 user nova-compute[74189]: DEBUG nova.compute.manager [req-4d7a844e-6556-4810-b8e7-7b165f374bc2 req-9f8c5f94-ad46-45e0-a0d4-2821d8e0b037 service nova] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Refreshing instance network info cache due to event network-changed-af0547c4-bcad-40cb-9183-e3fd84c1c8fb. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:41:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4d7a844e-6556-4810-b8e7-7b165f374bc2 req-9f8c5f94-ad46-45e0-a0d4-2821d8e0b037 service nova] Acquiring lock "refresh_cache-aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:41:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4d7a844e-6556-4810-b8e7-7b165f374bc2 req-9f8c5f94-ad46-45e0-a0d4-2821d8e0b037 service nova] Acquired lock "refresh_cache-aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:41:25 user nova-compute[74189]: DEBUG nova.network.neutron [req-4d7a844e-6556-4810-b8e7-7b165f374bc2 req-9f8c5f94-ad46-45e0-a0d4-2821d8e0b037 service nova] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Refreshing network info cache for port af0547c4-bcad-40cb-9183-e3fd84c1c8fb {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:41:25 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:41:25 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:41:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:41:25 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Deleted allocations for instance dcb582a2-5198-44aa-bbe8-48978975e9eb
Oct 25 21:41:25 user nova-compute[74189]: DEBUG nova.compute.manager [req-3c4a2496-e5c0-46f4-a687-98cc52368995 req-ce273ff2-0187-4c2b-9f63-419745212060 service nova] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Received event network-vif-plugged-8eb6e9e2-60c6-463d-8525-b768933a94df {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:41:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3c4a2496-e5c0-46f4-a687-98cc52368995 req-ce273ff2-0187-4c2b-9f63-419745212060 service nova] Acquiring lock "932fe8ac-fdde-45c6-aa32-9bf866f19a4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:41:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3c4a2496-e5c0-46f4-a687-98cc52368995 req-ce273ff2-0187-4c2b-9f63-419745212060 service nova] Lock "932fe8ac-fdde-45c6-aa32-9bf866f19a4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:41:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3c4a2496-e5c0-46f4-a687-98cc52368995 req-ce273ff2-0187-4c2b-9f63-419745212060 service nova] Lock "932fe8ac-fdde-45c6-aa32-9bf866f19a4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:41:25 user nova-compute[74189]: DEBUG nova.compute.manager [req-3c4a2496-e5c0-46f4-a687-98cc52368995 req-ce273ff2-0187-4c2b-9f63-419745212060 service nova] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] No waiting events found dispatching network-vif-plugged-8eb6e9e2-60c6-463d-8525-b768933a94df {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:41:25 user nova-compute[74189]: WARNING nova.compute.manager [req-3c4a2496-e5c0-46f4-a687-98cc52368995 req-ce273ff2-0187-4c2b-9f63-419745212060 service nova] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Received unexpected event network-vif-plugged-8eb6e9e2-60c6-463d-8525-b768933a94df for instance with vm_state deleted and task_state None.
Oct 25 21:41:25 user nova-compute[74189]: DEBUG nova.compute.manager [req-3c4a2496-e5c0-46f4-a687-98cc52368995 req-ce273ff2-0187-4c2b-9f63-419745212060 service nova] [instance: dcb582a2-5198-44aa-bbe8-48978975e9eb] Received event network-vif-deleted-0b83b195-15ba-461f-87f1-465a6a1066ce {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:41:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9d2a6ff7-c346-41c1-8074-70981bdec16f tempest-TestVolumeBootPattern-1934687878 tempest-TestVolumeBootPattern-1934687878-project-member] Lock "dcb582a2-5198-44aa-bbe8-48978975e9eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.308s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:41:25 user nova-compute[74189]: DEBUG nova.network.neutron [req-4d7a844e-6556-4810-b8e7-7b165f374bc2 req-9f8c5f94-ad46-45e0-a0d4-2821d8e0b037 service nova] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Updated VIF entry in instance network info cache for port af0547c4-bcad-40cb-9183-e3fd84c1c8fb. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:41:25 user nova-compute[74189]: DEBUG nova.network.neutron [req-4d7a844e-6556-4810-b8e7-7b165f374bc2 req-9f8c5f94-ad46-45e0-a0d4-2821d8e0b037 service nova] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Updating instance_info_cache with network_info: [{"id": "af0547c4-bcad-40cb-9183-e3fd84c1c8fb", "address": "fa:16:3e:17:71:69", "network": {"id": "351bf1c4-8784-41c0-8b68-a939f493bc5a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1840723104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fd14dac60ad462fbaafc984745a06df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0547c4-bc", "ovs_interfaceid": "af0547c4-bcad-40cb-9183-e3fd84c1c8fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:41:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4d7a844e-6556-4810-b8e7-7b165f374bc2 req-9f8c5f94-ad46-45e0-a0d4-2821d8e0b037 service nova] Releasing lock "refresh_cache-aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:41:25 user nova-compute[74189]: DEBUG nova.compute.manager [req-4d7a844e-6556-4810-b8e7-7b165f374bc2 req-9f8c5f94-ad46-45e0-a0d4-2821d8e0b037 service nova] [instance: 932fe8ac-fdde-45c6-aa32-9bf866f19a4e] Received event network-vif-deleted-8eb6e9e2-60c6-463d-8525-b768933a94df {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:41:26 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:41:26 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:41:26 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:41:26 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:41:26 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:41:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:28 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:41:28 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:41:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG nova.compute.manager [req-aee6563e-1810-475d-a0ce-1fc6f51cceb7 req-76274933-4808-40e4-aa3a-562fa2b61a82 service nova] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Received event network-changed-1fc98560-71c7-45c8-a806-73adbfb8f45d {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG nova.compute.manager [req-aee6563e-1810-475d-a0ce-1fc6f51cceb7 req-76274933-4808-40e4-aa3a-562fa2b61a82 service nova] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Refreshing instance network info cache due to event network-changed-1fc98560-71c7-45c8-a806-73adbfb8f45d. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-aee6563e-1810-475d-a0ce-1fc6f51cceb7 req-76274933-4808-40e4-aa3a-562fa2b61a82 service nova] Acquiring lock "refresh_cache-be371e0c-ebc8-46f7-89eb-44b55f4adf90" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-aee6563e-1810-475d-a0ce-1fc6f51cceb7 req-76274933-4808-40e4-aa3a-562fa2b61a82 service nova] Acquired lock "refresh_cache-be371e0c-ebc8-46f7-89eb-44b55f4adf90" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG nova.network.neutron [req-aee6563e-1810-475d-a0ce-1fc6f51cceb7 req-76274933-4808-40e4-aa3a-562fa2b61a82 service nova] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Refreshing network info cache for port 1fc98560-71c7-45c8-a806-73adbfb8f45d {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Acquiring lock "be371e0c-ebc8-46f7-89eb-44b55f4adf90" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "be371e0c-ebc8-46f7-89eb-44b55f4adf90" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG nova.objects.instance [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lazy-loading 'flavor' on Instance uuid be371e0c-ebc8-46f7-89eb-44b55f4adf90 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:41:31 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Ignoring supplied device name: /dev/vdb
Oct 25 21:41:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "be371e0c-ebc8-46f7-89eb-44b55f4adf90" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG nova.network.neutron [req-aee6563e-1810-475d-a0ce-1fc6f51cceb7 req-76274933-4808-40e4-aa3a-562fa2b61a82 service nova] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Updated VIF entry in instance network info cache for port 1fc98560-71c7-45c8-a806-73adbfb8f45d. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG nova.network.neutron [req-aee6563e-1810-475d-a0ce-1fc6f51cceb7 req-76274933-4808-40e4-aa3a-562fa2b61a82 service nova] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Updating instance_info_cache with network_info: [{"id": "1fc98560-71c7-45c8-a806-73adbfb8f45d", "address": "fa:16:3e:e4:f6:a2", "network": {"id": "27a00d33-61db-45a8-a945-cd8514be6344", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1691303850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff1b56c6086e4a41bf9a98b96101531e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc98560-71", "ovs_interfaceid": "1fc98560-71c7-45c8-a806-73adbfb8f45d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-aee6563e-1810-475d-a0ce-1fc6f51cceb7 req-76274933-4808-40e4-aa3a-562fa2b61a82 service nova] Releasing lock "refresh_cache-be371e0c-ebc8-46f7-89eb-44b55f4adf90" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Acquiring lock "be371e0c-ebc8-46f7-89eb-44b55f4adf90" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "be371e0c-ebc8-46f7-89eb-44b55f4adf90" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:41:31 user nova-compute[74189]: INFO nova.compute.manager [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Attaching volume 68cdc8db-e979-4dbc-9546-9058400e4adf to /dev/vdb
Oct 25 21:41:31 user nova-compute[74189]: DEBUG os_brick.utils [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6a9851-cd98-4e95-a2be-d9f713bf5fb4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6cca52-9a9c-4fcc-b9d2-722900aded8f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1e55c3-44ab-426b-80ac-3fae8408371c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f097dc-5991-4a95-96cf-68914f33f0b1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:41:31 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:41:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f411fa4-a3d0-4ee2-9992-0c74829d9054]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG os_brick.utils [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Updating existing volume attachment record: 1c5f22f6-cc87-441f-96b3-a3ccef60886d {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Cleaning up deleted instances {{(pid=74189) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 21:41:31 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] There are 0 instances to clean {{(pid=74189) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 21:41:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:42 user nova-compute[74189]: DEBUG nova.compute.manager [req-75f74ae9-cfa2-4efe-ae0c-31c1ed6a203a req-f2399824-d5fe-4f26-af58-eb31800dded9 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Received event network-changed-d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:41:42 user nova-compute[74189]: DEBUG nova.compute.manager [req-75f74ae9-cfa2-4efe-ae0c-31c1ed6a203a req-f2399824-d5fe-4f26-af58-eb31800dded9 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Refreshing instance network info cache due to event network-changed-d8084804-8e6e-4787-b331-96822b5ed349. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:41:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-75f74ae9-cfa2-4efe-ae0c-31c1ed6a203a req-f2399824-d5fe-4f26-af58-eb31800dded9 service nova] Acquiring lock "refresh_cache-915a1d25-6499-4d3e-9edd-5f3cfd487bac" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:41:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-75f74ae9-cfa2-4efe-ae0c-31c1ed6a203a req-f2399824-d5fe-4f26-af58-eb31800dded9 service nova] Acquired lock "refresh_cache-915a1d25-6499-4d3e-9edd-5f3cfd487bac" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:41:42 user nova-compute[74189]: DEBUG nova.network.neutron [req-75f74ae9-cfa2-4efe-ae0c-31c1ed6a203a req-f2399824-d5fe-4f26-af58-eb31800dded9 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Refreshing network info cache for port d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:41:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:41:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:41:42 user nova-compute[74189]: DEBUG nova.objects.instance [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lazy-loading 'flavor' on Instance uuid 915a1d25-6499-4d3e-9edd-5f3cfd487bac {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:41:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:41:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:41:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:41:42 user nova-compute[74189]: INFO nova.compute.manager [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Attaching volume 9db1c721-ba3e-4493-8658-9d7ec0a8bc29 to /dev/vdb
Oct 25 21:41:42 user nova-compute[74189]: DEBUG nova.network.neutron [req-75f74ae9-cfa2-4efe-ae0c-31c1ed6a203a req-f2399824-d5fe-4f26-af58-eb31800dded9 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Updated VIF entry in instance network info cache for port d8084804-8e6e-4787-b331-96822b5ed349. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:41:42 user nova-compute[74189]: DEBUG nova.network.neutron [req-75f74ae9-cfa2-4efe-ae0c-31c1ed6a203a req-f2399824-d5fe-4f26-af58-eb31800dded9 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Updating instance_info_cache with network_info: [{"id": "d8084804-8e6e-4787-b331-96822b5ed349", "address": "fa:16:3e:1c:bf:ba", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8084804-8e", "ovs_interfaceid": "d8084804-8e6e-4787-b331-96822b5ed349", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:41:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-75f74ae9-cfa2-4efe-ae0c-31c1ed6a203a req-f2399824-d5fe-4f26-af58-eb31800dded9 service nova] Releasing lock "refresh_cache-915a1d25-6499-4d3e-9edd-5f3cfd487bac" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:41:42 user nova-compute[74189]: DEBUG os_brick.utils [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:41:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:42 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9c0cf9-af89-4573-94ae-13804f8671d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:42 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b640f8a-0bf8-4f61-a8b5-0fb34622d759]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:42 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[76aa94b1-555a-4d63-b229-ceba3ea40a0c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:42 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[78464d20-8788-466f-afbe-a2f4dc929c04]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:41:42 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:41:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:41:42 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:41:42 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb61c44-4487-4f55-8db5-09c315adaa8d]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:42 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:41:42 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:41:42 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:41:42 user nova-compute[74189]: DEBUG os_brick.utils [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:41:42 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Updating existing volume attachment record: fcb7b2c6-021b-4e33-ac3b-17f31150a69c {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:41:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ViZjoDwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:41:49 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:41:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:41:49 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:41:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:41:49 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:41:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[97dfee43-4082-4533-82dd-a8370a1e8d78]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:41:49 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4397eb3-7eef-4549-9fb1-8209b92c5f9d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf] added
Oct 25 21:41:49 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd2c387-ced0-49ac-a39e-e1b02dc20379]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e5b60e-aa01-4084-99fd-8295cd12d31d]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ViZjoDwW {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ViZjoDwW" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1d247e-0aff-4256-8069-293d5f62e352]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ViZjoDwW'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a760e728-3785-4f47-9694-40cfd941aa90]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6354a288-6a29-4fc5-b2bd-06dcbaebeb34]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 21:41:49 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 21:41:49 user nova-compute[74189]:  {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:41:49 user nova-compute[74189]: WARNING os_brick.initiator.connectors.iscsi [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 21:41:49 user nova-compute[74189]: 
Oct 25 21:41:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5503978e-3919-43d0-9c95-384851779799]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf, portal: 172.16.0.220,3260]
Oct 25 21:41:49 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf, portal: 172.16.0.220,3260] successful.
Oct 25 21:41:49 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f63fbc-c910-4fb7-afbd-1b02736c9907]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4177af-dfc4-49fe-95d5-569273efe949]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf (non-flash)
Oct 25 21:41:49 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf (non-flash)
Oct 25 21:41:49 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b5deaf-014d-4c79-9fbf-9873616c6892]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:41:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ViZjoDwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:41:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:41:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23266663163353633', 'path': '/dev/sdb'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:41:50 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266663163353633', 'path': '/dev/sdb'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:41:50 user nova-compute[74189]: DEBUG nova.objects.instance [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lazy-loading 'flavor' on Instance uuid be371e0c-ebc8-46f7-89eb-44b55f4adf90 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:41:50 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 21:41:50 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:41:50 user nova-compute[74189]:   <source dev="/dev/sdb"/>
Oct 25 21:41:50 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:41:50 user nova-compute[74189]:   <serial>68cdc8db-e979-4dbc-9546-9058400e4adf</serial>
Oct 25 21:41:50 user nova-compute[74189]: </disk>
Oct 25 21:41:50 user nova-compute[74189]:  {{(pid=74189) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 21:41:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:41:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:41:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] No VIF found with MAC fa:16:3e:e4:f6:a2, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:41:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e4f7fa3e-52ac-4c79-ad64-f6fc550ab1c0 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "be371e0c-ebc8-46f7-89eb-44b55f4adf90" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.751s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:41:51 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:41:53 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:54 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:41:54 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Triggering sync for uuid 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef {{(pid=74189) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 21:41:54 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Triggering sync for uuid 3da14c0a-31a8-4fe3-bd5a-49378680af50 {{(pid=74189) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 21:41:54 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Triggering sync for uuid aa2b9013-4a8b-4f8d-a5dc-42842cd987a7 {{(pid=74189) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 21:41:54 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Triggering sync for uuid be371e0c-ebc8-46f7-89eb-44b55f4adf90 {{(pid=74189) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 21:41:54 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Triggering sync for uuid 915a1d25-6499-4d3e-9edd-5f3cfd487bac {{(pid=74189) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 21:41:54 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Triggering sync for uuid fff8f286-0baa-4865-994f-4418af3edd0a {{(pid=74189) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 21:41:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:41:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:41:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "3da14c0a-31a8-4fe3-bd5a-49378680af50" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:41:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "3da14c0a-31a8-4fe3-bd5a-49378680af50" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:41:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:41:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "be371e0c-ebc8-46f7-89eb-44b55f4adf90" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:41:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "be371e0c-ebc8-46f7-89eb-44b55f4adf90" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:41:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:41:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "fff8f286-0baa-4865-994f-4418af3edd0a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:41:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "fff8f286-0baa-4865-994f-4418af3edd0a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:41:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:41:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "3da14c0a-31a8-4fe3-bd5a-49378680af50" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:41:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "fff8f286-0baa-4865-994f-4418af3edd0a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:41:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "be371e0c-ebc8-46f7-89eb-44b55f4adf90" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:41:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:41:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:42:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:42:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tCHFjSMp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:42:00 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:42:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:42:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:42:00 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:42:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:42:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:42:00 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:42:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:00 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5ddcbc-45b3-4257-8b4f-ad7f69f044aa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:42:00 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:00 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4baf7b-2acd-4200-8bab-8c6305fdcfa0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29] added
Oct 25 21:42:00 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:00 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4c1cf1-01d5-4f5a-bccc-e894000faf75]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:00 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:00 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4a7f9c-99fc-4380-84aa-bf3bcb4e6288]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tCHFjSMp {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tCHFjSMp" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ebd31a-1bcd-4436-b1c8-82e6e13a547e]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tCHFjSMp'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6237354-89c3-4ca1-8c72-6354f2de3cde]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[faaf80a6-fed2-43f0-a6a1-dcc682bb0435]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf (non-flash)
Oct 25 21:42:01 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf (non-flash)
Oct 25 21:42:01 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd04c08f-2a08-4a08-9d4f-e52abb38e57d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29, portal: 172.16.0.220,3260]
Oct 25 21:42:01 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29, portal: 172.16.0.220,3260] successful.
Oct 25 21:42:01 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a033c272-3cd3-4f92-9654-492fee62f000]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d52df1-adb6-4108-9352-61af714155a2]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf (non-flash)
Oct 25 21:42:01 user nova-compute[74189]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:42:01 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf (non-flash)
Oct 25 21:42:01 user nova-compute[74189]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:42:01 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[462cfa79-f9d7-40ba-9e9e-debb9ef1f873]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:42:01 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tCHFjSMp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:42:02 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:42:02 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26362653034656263', 'path': '/dev/sdc'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:42:02 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362653034656263', 'path': '/dev/sdc'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:42:02 user nova-compute[74189]: DEBUG nova.objects.instance [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lazy-loading 'flavor' on Instance uuid 915a1d25-6499-4d3e-9edd-5f3cfd487bac {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:42:02 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 21:42:02 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:42:02 user nova-compute[74189]:   <source dev="/dev/sdc"/>
Oct 25 21:42:02 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:42:02 user nova-compute[74189]:   <serial>9db1c721-ba3e-4493-8658-9d7ec0a8bc29</serial>
Oct 25 21:42:02 user nova-compute[74189]: </disk>
Oct 25 21:42:02 user nova-compute[74189]:  {{(pid=74189) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 21:42:02 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:42:02 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:42:02 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] No VIF found with MAC fa:16:3e:1c:bf:ba, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:42:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e3743ee8-6a78-4803-818f-6614480c22b4 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.073s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:42:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 7.882s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:42:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:42:02 user nova-compute[74189]: DEBUG nova.compute.manager [req-caa0877f-3905-4998-968f-bcaaa4dec08f req-afdd66f4-14e9-4cfa-b276-a3c0ca400b34 service nova] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Received event network-changed-7e686cf6-429d-4de6-8bfc-c57e256bd47a {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:42:02 user nova-compute[74189]: DEBUG nova.compute.manager [req-caa0877f-3905-4998-968f-bcaaa4dec08f req-afdd66f4-14e9-4cfa-b276-a3c0ca400b34 service nova] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Refreshing instance network info cache due to event network-changed-7e686cf6-429d-4de6-8bfc-c57e256bd47a. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:42:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-caa0877f-3905-4998-968f-bcaaa4dec08f req-afdd66f4-14e9-4cfa-b276-a3c0ca400b34 service nova] Acquiring lock "refresh_cache-fff8f286-0baa-4865-994f-4418af3edd0a" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:42:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-caa0877f-3905-4998-968f-bcaaa4dec08f req-afdd66f4-14e9-4cfa-b276-a3c0ca400b34 service nova] Acquired lock "refresh_cache-fff8f286-0baa-4865-994f-4418af3edd0a" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:42:02 user nova-compute[74189]: DEBUG nova.network.neutron [req-caa0877f-3905-4998-968f-bcaaa4dec08f req-afdd66f4-14e9-4cfa-b276-a3c0ca400b34 service nova] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Refreshing network info cache for port 7e686cf6-429d-4de6-8bfc-c57e256bd47a {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:42:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:42:03 user nova-compute[74189]: DEBUG nova.network.neutron [req-caa0877f-3905-4998-968f-bcaaa4dec08f req-afdd66f4-14e9-4cfa-b276-a3c0ca400b34 service nova] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Updated VIF entry in instance network info cache for port 7e686cf6-429d-4de6-8bfc-c57e256bd47a. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:42:03 user nova-compute[74189]: DEBUG nova.network.neutron [req-caa0877f-3905-4998-968f-bcaaa4dec08f req-afdd66f4-14e9-4cfa-b276-a3c0ca400b34 service nova] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Updating instance_info_cache with network_info: [{"id": "7e686cf6-429d-4de6-8bfc-c57e256bd47a", "address": "fa:16:3e:b8:cf:38", "network": {"id": "0a65fa19-10fa-4360-b5f9-4faa8905e7df", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1120695373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebe8152ff7c45b8bc0df106f7e61a91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e686cf6-42", "ovs_interfaceid": "7e686cf6-429d-4de6-8bfc-c57e256bd47a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:42:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-caa0877f-3905-4998-968f-bcaaa4dec08f req-afdd66f4-14e9-4cfa-b276-a3c0ca400b34 service nova] Releasing lock "refresh_cache-fff8f286-0baa-4865-994f-4418af3edd0a" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:42:03 user nova-compute[74189]: INFO nova.compute.manager [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Rescuing
Oct 25 21:42:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "refresh_cache-915a1d25-6499-4d3e-9edd-5f3cfd487bac" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:42:03 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquired lock "refresh_cache-915a1d25-6499-4d3e-9edd-5f3cfd487bac" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:42:03 user nova-compute[74189]: DEBUG nova.network.neutron [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:42:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:42:04 user nova-compute[74189]: DEBUG nova.network.neutron [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Updating instance_info_cache with network_info: [{"id": "d8084804-8e6e-4787-b331-96822b5ed349", "address": "fa:16:3e:1c:bf:ba", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8084804-8e", "ovs_interfaceid": "d8084804-8e6e-4787-b331-96822b5ed349", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:42:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Releasing lock "refresh_cache-915a1d25-6499-4d3e-9edd-5f3cfd487bac" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:42:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:42:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:42:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:42:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KRCXqEkQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:42:05 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:42:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:42:05 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:42:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:42:05 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bca5d9-04c1-49fe-a72d-56f5071bc229]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:42:05 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13759dd-6642-433e-8c2a-74642203513c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772] added
Oct 25 21:42:05 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a0e210-d1c5-4184-b23b-2f0bcdeeb9df]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.compute.manager [req-937103ef-22fa-40a4-8c76-bb26b4f8868f req-e18af8a0-356c-4946-9516-714134834291 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Received event network-vif-unplugged-d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-937103ef-22fa-40a4-8c76-bb26b4f8868f req-e18af8a0-356c-4946-9516-714134834291 service nova] Acquiring lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-937103ef-22fa-40a4-8c76-bb26b4f8868f req-e18af8a0-356c-4946-9516-714134834291 service nova] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-937103ef-22fa-40a4-8c76-bb26b4f8868f req-e18af8a0-356c-4946-9516-714134834291 service nova] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.compute.manager [req-937103ef-22fa-40a4-8c76-bb26b4f8868f req-e18af8a0-356c-4946-9516-714134834291 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] No waiting events found dispatching network-vif-unplugged-d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:42:05 user nova-compute[74189]: WARNING nova.compute.manager [req-937103ef-22fa-40a4-8c76-bb26b4f8868f req-e18af8a0-356c-4946-9516-714134834291 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Received unexpected event network-vif-unplugged-d8084804-8e6e-4787-b331-96822b5ed349 for instance with vm_state active and task_state rescuing.
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cade12-bdea-4ed0-bee7-1a27ac930142]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KRCXqEkQ {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KRCXqEkQ" returned: 0 in 0.030s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fc2db6-d481-47db-9bbe-ab4f6c37cdb4]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KRCXqEkQ'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:05 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Instance destroyed successfully.
Oct 25 21:42:05 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Attempting rescue
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74189) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Instance directory exists: not creating {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 21:42:05 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Creating image(s)
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "/opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "/opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "/opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.objects.instance [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lazy-loading 'trusted_certs' on Instance uuid 915a1d25-6499-4d3e-9edd-5f3cfd487bac {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed8334d-ace6-49da-b454-312cd9974646]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[332d5960-1adc-4e35-b93e-7fa723cc83f1]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf (non-flash)
Oct 25 21:42:05 user nova-compute[74189]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:42:05 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf (non-flash)
Oct 25 21:42:05 user nova-compute[74189]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:42:05 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c120f13-4685-427c-ae26-e301d7acfec0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772, portal: 172.16.0.220,3260]
Oct 25 21:42:05 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772, portal: 172.16.0.220,3260] successful.
Oct 25 21:42:05 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[67494fc7-2f96-43bc-872c-7d84005dc2c1]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[55135d4b-0d0a-4d40-abf0-a115edff14b6]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf (non-flash)
Oct 25 21:42:05 user nova-compute[74189]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:42:05 user nova-compute[74189]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 (non-flash)
Oct 25 21:42:05 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf (non-flash)
Oct 25 21:42:05 user nova-compute[74189]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:42:05 user nova-compute[74189]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 (non-flash)
Oct 25 21:42:05 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.404s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] HCTL ('35', '-', '-', 0) found on session 53 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb87e6cc-64bb-4bf1-a1da-e964db8aaf48]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Searching for a device in session 53 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KRCXqEkQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.249s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk.rescue {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk.rescue" returned: 0 in 0.070s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.326s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.objects.instance [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lazy-loading 'migration_context' on Instance uuid 915a1d25-6499-4d3e-9edd-5f3cfd487bac {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.objects.base [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Object Instance<915a1d25-6499-4d3e-9edd-5f3cfd487bac> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Start _get_guest_xml network_info=[{"id": "d8084804-8e6e-4787-b331-96822b5ed349", "address": "fa:16:3e:1c:bf:ba", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "vif_mac": "fa:16:3e:1c:bf:ba"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8084804-8e", "ovs_interfaceid": "d8084804-8e6e-4787-b331-96822b5ed349", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.objects.instance [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lazy-loading 'resources' on Instance uuid 915a1d25-6499-4d3e-9edd-5f3cfd487bac {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.objects.base [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Object Instance<915a1d25-6499-4d3e-9edd-5f3cfd487bac> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.objects.instance [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lazy-loading 'numa_topology' on Instance uuid 915a1d25-6499-4d3e-9edd-5f3cfd487bac {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.objects.base [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Object Instance<915a1d25-6499-4d3e-9edd-5f3cfd487bac> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:42:05 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:42:05 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.objects.instance [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lazy-loading 'vcpu_model' on Instance uuid 915a1d25-6499-4d3e-9edd-5f3cfd487bac {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.objects.base [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Object Instance<915a1d25-6499-4d3e-9edd-5f3cfd487bac> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1472118533',display_name='tempest-ServerRescueNegativeTestJSON-server-1472118533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1472118533',id=44,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0nf2hM/WlDG+sQ+FxLN/EMmeMuByeyGz9+k278o6v87wvvWwukeL2QOlXyvE/n9zyiGco1JHpAvDrdVaXClm1csDAdyWDdcVv33SghS4TAVXWuVSS44IvuXUNWj1aXVw==',key_name='tempest-keypair-426278292',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:39:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3df03fc18fc3467db76e336c6de78c92',ramdisk_id='',reservation_id='r-qa2hot3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-383982506',owner_user_name='tempest-ServerRescueNegativeTestJSON-383982506-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:39:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='155c948b95c64c9083da984cdf6af494',uuid=915a1d25-6499-4d3e-9edd-5f3cfd487bac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8084804-8e6e-4787-b331-96822b5ed349", "address": "fa:16:3e:1c:bf:ba", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "vif_mac": "fa:16:3e:1c:bf:ba"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8084804-8e", "ovs_interfaceid": "d8084804-8e6e-4787-b331-96822b5ed349", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Converting VIF {"id": "d8084804-8e6e-4787-b331-96822b5ed349", "address": "fa:16:3e:1c:bf:ba", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "vif_mac": "fa:16:3e:1c:bf:ba"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8084804-8e", "ovs_interfaceid": "d8084804-8e6e-4787-b331-96822b5ed349", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:bf:ba,bridge_name='br-int',has_traffic_filtering=True,id=d8084804-8e6e-4787-b331-96822b5ed349,network=Network(b496a106-2367-44dc-a788-bcd22ec98feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8084804-8e') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.objects.instance [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lazy-loading 'pci_devices' on Instance uuid 915a1d25-6499-4d3e-9edd-5f3cfd487bac {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.objects.base [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Object Instance<915a1d25-6499-4d3e-9edd-5f3cfd487bac> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74189) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:42:05 user nova-compute[74189]:   <uuid>915a1d25-6499-4d3e-9edd-5f3cfd487bac</uuid>
Oct 25 21:42:05 user nova-compute[74189]:   <name>instance-0000002c</name>
Oct 25 21:42:05 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:42:05 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:42:05 user nova-compute[74189]:   <metadata>
Oct 25 21:42:05 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:42:05 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:42:05 user nova-compute[74189]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1472118533</nova:name>
Oct 25 21:42:05 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:42:05</nova:creationTime>
Oct 25 21:42:05 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:42:05 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:42:05 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:42:05 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:42:05 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:42:05 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:42:05 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:42:05 user nova-compute[74189]:       <nova:owner>
Oct 25 21:42:05 user nova-compute[74189]:         <nova:user uuid="155c948b95c64c9083da984cdf6af494">tempest-ServerRescueNegativeTestJSON-383982506-project-member</nova:user>
Oct 25 21:42:05 user nova-compute[74189]:         <nova:project uuid="3df03fc18fc3467db76e336c6de78c92">tempest-ServerRescueNegativeTestJSON-383982506</nova:project>
Oct 25 21:42:05 user nova-compute[74189]:       </nova:owner>
Oct 25 21:42:05 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:42:05 user nova-compute[74189]:       <nova:ports>
Oct 25 21:42:05 user nova-compute[74189]:         <nova:port uuid="d8084804-8e6e-4787-b331-96822b5ed349">
Oct 25 21:42:05 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 21:42:05 user nova-compute[74189]:         </nova:port>
Oct 25 21:42:05 user nova-compute[74189]:       </nova:ports>
Oct 25 21:42:05 user nova-compute[74189]:     </nova:instance>
Oct 25 21:42:05 user nova-compute[74189]:   </metadata>
Oct 25 21:42:05 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:42:05 user nova-compute[74189]:     <system>
Oct 25 21:42:05 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:42:05 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:42:05 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:42:05 user nova-compute[74189]:       <entry name="serial">915a1d25-6499-4d3e-9edd-5f3cfd487bac</entry>
Oct 25 21:42:05 user nova-compute[74189]:       <entry name="uuid">915a1d25-6499-4d3e-9edd-5f3cfd487bac</entry>
Oct 25 21:42:05 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:42:05 user nova-compute[74189]:     </system>
Oct 25 21:42:05 user nova-compute[74189]:   </sysinfo>
Oct 25 21:42:05 user nova-compute[74189]:   <os>
Oct 25 21:42:05 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:42:05 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:42:05 user nova-compute[74189]:   </os>
Oct 25 21:42:05 user nova-compute[74189]:   <features>
Oct 25 21:42:05 user nova-compute[74189]:     <acpi/>
Oct 25 21:42:05 user nova-compute[74189]:     <apic/>
Oct 25 21:42:05 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:42:05 user nova-compute[74189]:   </features>
Oct 25 21:42:05 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:42:05 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:42:05 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:42:05 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:42:05 user nova-compute[74189]:   </clock>
Oct 25 21:42:05 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:42:05 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:42:05 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:42:05 user nova-compute[74189]:   </cpu>
Oct 25 21:42:05 user nova-compute[74189]:   <devices>
Oct 25 21:42:05 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:42:05 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:42:05 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk.rescue"/>
Oct 25 21:42:05 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:42:05 user nova-compute[74189]:     </disk>
Oct 25 21:42:05 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:42:05 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:42:05 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk"/>
Oct 25 21:42:05 user nova-compute[74189]:       <target dev="vdb" bus="virtio"/>
Oct 25 21:42:05 user nova-compute[74189]:     </disk>
Oct 25 21:42:05 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:42:05 user nova-compute[74189]:       <mac address="fa:16:3e:1c:bf:ba"/>
Oct 25 21:42:05 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:42:05 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:42:05 user nova-compute[74189]:       <target dev="tapd8084804-8e"/>
Oct 25 21:42:05 user nova-compute[74189]:     </interface>
Oct 25 21:42:05 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:42:05 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/console.log" append="off"/>
Oct 25 21:42:05 user nova-compute[74189]:     </serial>
Oct 25 21:42:05 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:42:05 user nova-compute[74189]:     <video>
Oct 25 21:42:05 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:42:05 user nova-compute[74189]:     </video>
Oct 25 21:42:05 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:42:05 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:42:05 user nova-compute[74189]:     </rng>
Oct 25 21:42:05 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:42:05 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:42:05 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:42:05 user nova-compute[74189]:     </memballoon>
Oct 25 21:42:05 user nova-compute[74189]:   </devices>
Oct 25 21:42:05 user nova-compute[74189]: </domain>
Oct 25 21:42:05 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:42:05 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Instance destroyed successfully.
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:42:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] No VIF found with MAC fa:16:3e:1c:bf:ba, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:42:06 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.441s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:42:06 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] <== connect_volume: return (1442ms) {'type': 'block', 'scsi_wwn': '23630313632353932', 'path': '/dev/sdd'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:42:06 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630313632353932', 'path': '/dev/sdd'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:42:06 user nova-compute[74189]: DEBUG nova.objects.instance [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lazy-loading 'flavor' on Instance uuid aa2b9013-4a8b-4f8d-a5dc-42842cd987a7 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:42:06 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 21:42:06 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:42:06 user nova-compute[74189]:   <source dev="/dev/sdd"/>
Oct 25 21:42:06 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:42:06 user nova-compute[74189]:   <serial>0ddb81d0-cc03-4175-ae74-e6a70fd02772</serial>
Oct 25 21:42:06 user nova-compute[74189]: </disk>
Oct 25 21:42:06 user nova-compute[74189]:  {{(pid=74189) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 21:42:07 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:42:07 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:42:07 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] No VIF found with MAC fa:16:3e:17:71:69, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:42:07 user nova-compute[74189]: DEBUG nova.compute.manager [req-a01892a5-069e-4761-8872-65afef231746 req-a20fead8-150a-4fec-8818-9f1a3d18deb7 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Received event network-vif-plugged-d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:42:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a01892a5-069e-4761-8872-65afef231746 req-a20fead8-150a-4fec-8818-9f1a3d18deb7 service nova] Acquiring lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:42:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a01892a5-069e-4761-8872-65afef231746 req-a20fead8-150a-4fec-8818-9f1a3d18deb7 service nova] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:42:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a01892a5-069e-4761-8872-65afef231746 req-a20fead8-150a-4fec-8818-9f1a3d18deb7 service nova] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:42:07 user nova-compute[74189]: DEBUG nova.compute.manager [req-a01892a5-069e-4761-8872-65afef231746 req-a20fead8-150a-4fec-8818-9f1a3d18deb7 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] No waiting events found dispatching network-vif-plugged-d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:42:07 user nova-compute[74189]: WARNING nova.compute.manager [req-a01892a5-069e-4761-8872-65afef231746 req-a20fead8-150a-4fec-8818-9f1a3d18deb7 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Received unexpected event network-vif-plugged-d8084804-8e6e-4787-b331-96822b5ed349 for instance with vm_state active and task_state rescuing.
Oct 25 21:42:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-be2877c4-489f-4f22-9f63-8954510a1d89 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 43.368s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:42:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 12.502s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:42:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:42:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:42:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:42:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:42:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:42:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:42:09 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:42:09 user nova-compute[74189]: DEBUG nova.compute.manager [req-88e004ed-5fba-4f2c-bf4e-26dd30bd5126 req-443c830b-afc5-4afb-9681-dfc050da9d0b service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Received event network-vif-plugged-d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:42:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-88e004ed-5fba-4f2c-bf4e-26dd30bd5126 req-443c830b-afc5-4afb-9681-dfc050da9d0b service nova] Acquiring lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:42:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-88e004ed-5fba-4f2c-bf4e-26dd30bd5126 req-443c830b-afc5-4afb-9681-dfc050da9d0b service nova] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:42:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-88e004ed-5fba-4f2c-bf4e-26dd30bd5126 req-443c830b-afc5-4afb-9681-dfc050da9d0b service nova] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:42:09 user nova-compute[74189]: DEBUG nova.compute.manager [req-88e004ed-5fba-4f2c-bf4e-26dd30bd5126 req-443c830b-afc5-4afb-9681-dfc050da9d0b service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] No waiting events found dispatching network-vif-plugged-d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:42:09 user nova-compute[74189]: WARNING nova.compute.manager [req-88e004ed-5fba-4f2c-bf4e-26dd30bd5126 req-443c830b-afc5-4afb-9681-dfc050da9d0b service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Received unexpected event network-vif-plugged-d8084804-8e6e-4787-b331-96822b5ed349 for instance with vm_state active and task_state rescuing.
Oct 25 21:42:09 user nova-compute[74189]: DEBUG nova.compute.manager [req-88e004ed-5fba-4f2c-bf4e-26dd30bd5126 req-443c830b-afc5-4afb-9681-dfc050da9d0b service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Received event network-vif-plugged-d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:42:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-88e004ed-5fba-4f2c-bf4e-26dd30bd5126 req-443c830b-afc5-4afb-9681-dfc050da9d0b service nova] Acquiring lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:42:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-88e004ed-5fba-4f2c-bf4e-26dd30bd5126 req-443c830b-afc5-4afb-9681-dfc050da9d0b service nova] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:42:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-88e004ed-5fba-4f2c-bf4e-26dd30bd5126 req-443c830b-afc5-4afb-9681-dfc050da9d0b service nova] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:42:09 user nova-compute[74189]: DEBUG nova.compute.manager [req-88e004ed-5fba-4f2c-bf4e-26dd30bd5126 req-443c830b-afc5-4afb-9681-dfc050da9d0b service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] No waiting events found dispatching network-vif-plugged-d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:42:09 user nova-compute[74189]: WARNING nova.compute.manager [req-88e004ed-5fba-4f2c-bf4e-26dd30bd5126 req-443c830b-afc5-4afb-9681-dfc050da9d0b service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Received unexpected event network-vif-plugged-d8084804-8e6e-4787-b331-96822b5ed349 for instance with vm_state active and task_state rescuing.
Oct 25 21:42:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Acquiring lock "fff8f286-0baa-4865-994f-4418af3edd0a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:42:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "fff8f286-0baa-4865-994f-4418af3edd0a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:42:09 user nova-compute[74189]: DEBUG nova.objects.instance [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lazy-loading 'flavor' on Instance uuid fff8f286-0baa-4865-994f-4418af3edd0a {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:42:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "fff8f286-0baa-4865-994f-4418af3edd0a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:42:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Acquiring lock "fff8f286-0baa-4865-994f-4418af3edd0a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:42:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "fff8f286-0baa-4865-994f-4418af3edd0a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:42:09 user nova-compute[74189]: INFO nova.compute.manager [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Attaching volume 14ce106e-394e-45a9-9538-375cfad8688a to /dev/vdb
Oct 25 21:42:09 user nova-compute[74189]: DEBUG nova.compute.manager [None req-42680bda-a11e-4af6-9d4c-a5b3b307e202 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG os_brick.utils [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[090dc651-1f71-407b-8048-cac7d0829641]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac1ad42-3b27-466f-b78d-b94163aaa3d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02e4479-c5ea-40e2-93dd-2708ee5535de]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f854a9-3bbf-45d6-b45c-6135f33cfb19]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:42:10 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:42:10 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99912e7-21ab-408e-8cff-5aef26e2357a]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG os_brick.utils [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Updating existing volume attachment record: d2fc2639-4acb-4273-b9a4-519d8b4bb2bf {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Acquiring lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG nova.objects.instance [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lazy-loading 'flavor' on Instance uuid aa2b9013-4a8b-4f8d-a5dc-42842cd987a7 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Acquiring lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:42:10 user nova-compute[74189]: INFO nova.compute.manager [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Attaching volume 5981cb48-061e-4256-ac4e-8b8529bfdaff to /dev/vdc
Oct 25 21:42:10 user nova-compute[74189]: DEBUG os_brick.utils [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f06e39-3b74-4cd7-ad75-021203c67c35]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4e3b44-6cc8-467c-b296-b6de118bc266]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbe8dd6-7e88-4dff-8044-06e0c1a83680]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9492f4-5ebb-4950-9f39-ffba3ee90bd4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:10 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:42:11 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:42:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:11 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:42:11 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:42:11 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed4206b-61fb-4cdf-9d03-5abcaa0daa74]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:11 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:42:11 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:42:11 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:42:11 user nova-compute[74189]: DEBUG os_brick.utils [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:42:11 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Updating existing volume attachment record: 9a70e740-e5a3-4a24-b348-0cea047f6f43 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:42:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:42:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:42:14 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:42:14 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:42:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-3da14c0a-31a8-4fe3-bd5a-49378680af50" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:42:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-3da14c0a-31a8-4fe3-bd5a-49378680af50" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:42:15 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:42:16 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Updating instance_info_cache with network_info: [{"id": "a5e7898d-caba-49d7-8310-630beb75bf21", "address": "fa:16:3e:9d:7f:d0", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5e7898d-ca", "ovs_interfaceid": "a5e7898d-caba-49d7-8310-630beb75bf21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:42:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-3da14c0a-31a8-4fe3-bd5a-49378680af50" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:42:16 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:42:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:42:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:42:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:42:19 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:42:19 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:42:19 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:42:19 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:42:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:42:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:42:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:42:19 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:42:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be371e0c-ebc8-46f7-89eb-44b55f4adf90/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be371e0c-ebc8-46f7-89eb-44b55f4adf90/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be371e0c-ebc8-46f7-89eb-44b55f4adf90/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be371e0c-ebc8-46f7-89eb-44b55f4adf90/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:42:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:42:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2b9013-4a8b-4f8d-a5dc-42842cd987a7/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2b9013-4a8b-4f8d-a5dc-42842cd987a7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2b9013-4a8b-4f8d-a5dc-42842cd987a7/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2b9013-4a8b-4f8d-a5dc-42842cd987a7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:22 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:42:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:42:23 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:42:23 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:42:23 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=8167MB free_disk=24.96233367919922GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:42:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:42:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:42:23 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:42:23 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3da14c0a-31a8-4fe3-bd5a-49378680af50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:42:23 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance aa2b9013-4a8b-4f8d-a5dc-42842cd987a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:42:23 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance be371e0c-ebc8-46f7-89eb-44b55f4adf90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:42:23 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 915a1d25-6499-4d3e-9edd-5f3cfd487bac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:42:23 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance fff8f286-0baa-4865-994f-4418af3edd0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:42:23 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:42:23 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:42:23 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Refreshing inventories for resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 21:42:24 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Updating ProviderTree inventory for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 21:42:24 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Updating inventory in ProviderTree for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 21:42:24 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Refreshing aggregate associations for resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc, aggregates: None {{(pid=74189) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 21:42:24 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Refreshing trait associations for resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING {{(pid=74189) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 21:42:24 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:42:24 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:42:24 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:42:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.010s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:42:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:42:27 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:42:27 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:42:27 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:42:27 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:42:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:42:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:42:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:42:30 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:42:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NEoPHMCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:42:30 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:42:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:42:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:42:30 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:42:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:42:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:42:30 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:42:30 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:42:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3791e30-aee7-42f8-a256-901780711a69]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:42:30 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd8aa9d-3db5-452d-b3f6-b83e18bb25ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a] added
Oct 25 21:42:30 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc631bc-b8d7-4241-be89-0e3d6db47bba]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a9a5fd-5fd0-4261-9b4c-601ffae4ace5]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NEoPHMCb {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NEoPHMCb" returned: 0 in 0.029s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e343846-0d39-40e0-b047-cf647f6e4ae6]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NEoPHMCb'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[60814d91-5f8d-449c-8371-634ff972bdec]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f09a9e-082f-45da-be3f-a8fa16448995]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf (non-flash)
Oct 25 21:42:31 user nova-compute[74189]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:42:31 user nova-compute[74189]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 (non-flash)
Oct 25 21:42:31 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:42:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf (non-flash)
Oct 25 21:42:31 user nova-compute[74189]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:42:31 user nova-compute[74189]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 (non-flash)
Oct 25 21:42:31 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:42:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3e347b-8378-4b1c-a57c-1218ce549bcb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a, portal: 172.16.0.220,3260]
Oct 25 21:42:31 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a, portal: 172.16.0.220,3260] successful.
Oct 25 21:42:31 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27da228-0084-422c-a3e8-02ed237bad85]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea00992c-a758-48c1-a633-1d5005c25b91]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf (non-flash)
Oct 25 21:42:31 user nova-compute[74189]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:42:31 user nova-compute[74189]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 (non-flash)
Oct 25 21:42:31 user nova-compute[74189]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a (non-flash)
Oct 25 21:42:31 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:42:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf (non-flash)
Oct 25 21:42:31 user nova-compute[74189]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:42:31 user nova-compute[74189]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 (non-flash)
Oct 25 21:42:31 user nova-compute[74189]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a (non-flash)
Oct 25 21:42:31 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:42:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:42:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:42:31 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] HCTL ('36', '-', '-', 0) found on session 54 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:42:31 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:42:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:31 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0842c7ab-6937-40a6-b868-5f7a6a961da0]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:31 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Searching for a device in session 54 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:42:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NEoPHMCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:42:31 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:42:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kJQiqEyh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:42:31 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:42:31 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '23861353936313963', 'path': '/dev/sde'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861353936313963', 'path': '/dev/sde'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.552s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:42:32 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:42:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:42:32 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:42:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG nova.objects.instance [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lazy-loading 'flavor' on Instance uuid fff8f286-0baa-4865-994f-4418af3edd0a {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cbb9f0-aac2-4287-b3a8-47a37d34475d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:42:32 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 21:42:32 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:42:32 user nova-compute[74189]:   <source dev="/dev/sde"/>
Oct 25 21:42:32 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:42:32 user nova-compute[74189]:   <serial>14ce106e-394e-45a9-9538-375cfad8688a</serial>
Oct 25 21:42:32 user nova-compute[74189]: </disk>
Oct 25 21:42:32 user nova-compute[74189]:  {{(pid=74189) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef526e3-1590-4bf3-8dd0-8175ee140ac0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff] added
Oct 25 21:42:32 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb77c91c-aa78-48ab-95c9-9937edba5030]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[576d95d7-8537-4df5-985c-7adef1894932]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kJQiqEyh {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kJQiqEyh" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[52dc275a-2a7a-434d-ae7f-7a727f1726d5]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kJQiqEyh'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab60dcb-4677-4a05-bb65-92119efdb445]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6aa65f-6619-4e76-ab37-6d7ccbac6ea2]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf (non-flash)
Oct 25 21:42:32 user nova-compute[74189]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:42:32 user nova-compute[74189]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 (non-flash)
Oct 25 21:42:32 user nova-compute[74189]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a (non-flash)
Oct 25 21:42:32 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf (non-flash)
Oct 25 21:42:32 user nova-compute[74189]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:42:32 user nova-compute[74189]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 (non-flash)
Oct 25 21:42:32 user nova-compute[74189]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a (non-flash)
Oct 25 21:42:32 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50c628f-299d-4ad2-9df9-723e0f5a02e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff, portal: 172.16.0.220,3260]
Oct 25 21:42:32 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff, portal: 172.16.0.220,3260] successful.
Oct 25 21:42:32 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e93fc99-1bb5-411b-95b8-33163776ef9d]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0ac534-421f-4c2b-9fda-30a96581c265]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf (non-flash)
Oct 25 21:42:32 user nova-compute[74189]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:42:32 user nova-compute[74189]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 (non-flash)
Oct 25 21:42:32 user nova-compute[74189]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a (non-flash)
Oct 25 21:42:32 user nova-compute[74189]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff (non-flash)
Oct 25 21:42:32 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf (non-flash)
Oct 25 21:42:32 user nova-compute[74189]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:42:32 user nova-compute[74189]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 (non-flash)
Oct 25 21:42:32 user nova-compute[74189]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a (non-flash)
Oct 25 21:42:32 user nova-compute[74189]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff (non-flash)
Oct 25 21:42:32 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] HCTL ('37', '-', '-', 0) found on session 55 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3a3f33-c3c5-4b34-b328-dbda20b8e47d]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Searching for a device in session 55 and hctl ['37', '*', '*', 0] yield: None {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:42:32 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] No VIF found with MAC fa:16:3e:b8:cf:38, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:42:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-78755ad3-79ab-447e-82e5-0c96bca3713c tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "fff8f286-0baa-4865-994f-4418af3edd0a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.107s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:42:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:42:33 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Searching for a device in session 55 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:42:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kJQiqEyh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:42:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:42:33 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] <== connect_volume: return (1918ms) {'type': 'block', 'scsi_wwn': '26333633366346231', 'path': '/dev/sdf'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:42:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333633366346231', 'path': '/dev/sdf'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:42:33 user nova-compute[74189]: DEBUG nova.objects.instance [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lazy-loading 'flavor' on Instance uuid aa2b9013-4a8b-4f8d-a5dc-42842cd987a7 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:42:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 21:42:33 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:42:33 user nova-compute[74189]:   <source dev="/dev/sdf"/>
Oct 25 21:42:33 user nova-compute[74189]:   <target dev="vdc" bus="virtio"/>
Oct 25 21:42:33 user nova-compute[74189]:   <serial>5981cb48-061e-4256-ac4e-8b8529bfdaff</serial>
Oct 25 21:42:33 user nova-compute[74189]: </disk>
Oct 25 21:42:33 user nova-compute[74189]:  {{(pid=74189) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 21:42:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:42:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:42:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:42:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] No VIF found with MAC fa:16:3e:17:71:69, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:42:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d99ca314-53e6-4bc5-94c7-2f2c55658440 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.392s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:42:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:42:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Acquiring lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:42:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:42:35 user nova-compute[74189]: INFO nova.compute.manager [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Detaching volume 5981cb48-061e-4256-ac4e-8b8529bfdaff
Oct 25 21:42:35 user nova-compute[74189]: INFO nova.virt.block_device [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Attempting to driver detach volume 5981cb48-061e-4256-ac4e-8b8529bfdaff from mountpoint /dev/vdc
Oct 25 21:42:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Attempting to detach device vdc from instance aa2b9013-4a8b-4f8d-a5dc-42842cd987a7 from the persistent domain config. {{(pid=74189) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 21:42:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:42:35 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:42:35 user nova-compute[74189]:   <source dev="/dev/sdf"/>
Oct 25 21:42:35 user nova-compute[74189]:   <target dev="vdc" bus="virtio"/>
Oct 25 21:42:35 user nova-compute[74189]:   <serial>5981cb48-061e-4256-ac4e-8b8529bfdaff</serial>
Oct 25 21:42:35 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 25 21:42:35 user nova-compute[74189]: </disk>
Oct 25 21:42:35 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:42:35 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Successfully detached device vdc from instance aa2b9013-4a8b-4f8d-a5dc-42842cd987a7 from the persistent domain config.
Oct 25 21:42:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance aa2b9013-4a8b-4f8d-a5dc-42842cd987a7 from the live domain config. {{(pid=74189) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 21:42:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:42:35 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:42:35 user nova-compute[74189]:   <source dev="/dev/sdf"/>
Oct 25 21:42:35 user nova-compute[74189]:   <target dev="vdc" bus="virtio"/>
Oct 25 21:42:35 user nova-compute[74189]:   <serial>5981cb48-061e-4256-ac4e-8b8529bfdaff</serial>
Oct 25 21:42:35 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 25 21:42:35 user nova-compute[74189]: </disk>
Oct 25 21:42:35 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:42:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance aa2b9013-4a8b-4f8d-a5dc-42842cd987a7 {{(pid=74189) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 21:42:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:42:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:42:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:42:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:42:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:42:53 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:42:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Acquiring lock "be371e0c-ebc8-46f7-89eb-44b55f4adf90" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:42:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "be371e0c-ebc8-46f7-89eb-44b55f4adf90" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:42:54 user nova-compute[74189]: INFO nova.compute.manager [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Detaching volume 68cdc8db-e979-4dbc-9546-9058400e4adf
Oct 25 21:42:54 user nova-compute[74189]: INFO nova.virt.block_device [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Attempting to driver detach volume 68cdc8db-e979-4dbc-9546-9058400e4adf from mountpoint /dev/vdb
Oct 25 21:42:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Attempting to detach device vdb from instance be371e0c-ebc8-46f7-89eb-44b55f4adf90 from the persistent domain config. {{(pid=74189) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 21:42:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:42:54 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:42:54 user nova-compute[74189]:   <source dev="/dev/sdb"/>
Oct 25 21:42:54 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:42:54 user nova-compute[74189]:   <serial>68cdc8db-e979-4dbc-9546-9058400e4adf</serial>
Oct 25 21:42:54 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:42:54 user nova-compute[74189]: </disk>
Oct 25 21:42:54 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:42:54 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Successfully detached device vdb from instance be371e0c-ebc8-46f7-89eb-44b55f4adf90 from the persistent domain config.
Oct 25 21:42:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance be371e0c-ebc8-46f7-89eb-44b55f4adf90 from the live domain config. {{(pid=74189) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 21:42:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:42:54 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:42:54 user nova-compute[74189]:   <source dev="/dev/sdb"/>
Oct 25 21:42:54 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:42:54 user nova-compute[74189]:   <serial>68cdc8db-e979-4dbc-9546-9058400e4adf</serial>
Oct 25 21:42:54 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:42:54 user nova-compute[74189]: </disk>
Oct 25 21:42:54 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:42:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Acquiring lock "be371e0c-ebc8-46f7-89eb-44b55f4adf90" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:42:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance be371e0c-ebc8-46f7-89eb-44b55f4adf90 {{(pid=74189) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 21:42:56 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance aa2b9013-4a8b-4f8d-a5dc-42842cd987a7 is timed out.
Oct 25 21:42:56 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Successfully detached device vdc from instance aa2b9013-4a8b-4f8d-a5dc-42842cd987a7 from the live domain config.
Oct 25 21:42:56 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kJQiqEyh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:42:56 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:42:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e409a8-078c-4b82-aa2f-4d2f4f8be0cd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:42:56 user nova-compute[74189]: No targets found.
Oct 25 21:42:56 user nova-compute[74189]: iSNS:
Oct 25 21:42:56 user nova-compute[74189]: No targets found.
Oct 25 21:42:56 user nova-compute[74189]: STATIC:
Oct 25 21:42:56 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772
Oct 25 21:42:56 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:42:56 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:42:56 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf
Oct 25 21:42:56 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:42:56 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:42:56 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff
Oct 25 21:42:56 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:42:56 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:42:56 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29
Oct 25 21:42:56 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:42:56 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:42:56 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a
Oct 25 21:42:56 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:42:56 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:42:56 user nova-compute[74189]: FIRMWARE:
Oct 25 21:42:56 user nova-compute[74189]: No targets found.
Oct 25 21:42:56 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:42:56 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:42:56 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d72683-4554-40ad-ae41-0ac40c2b6068]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3f2000-8eab-49bb-bb57-3b7ccb18b5a6]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf (non-flash)
Oct 25 21:42:56 user nova-compute[74189]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:42:56 user nova-compute[74189]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 (non-flash)
Oct 25 21:42:56 user nova-compute[74189]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a (non-flash)
Oct 25 21:42:56 user nova-compute[74189]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff (non-flash)
Oct 25 21:42:56 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf (non-flash)
Oct 25 21:42:56 user nova-compute[74189]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:42:56 user nova-compute[74189]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 (non-flash)
Oct 25 21:42:56 user nova-compute[74189]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a (non-flash)
Oct 25 21:42:56 user nova-compute[74189]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff (non-flash)
Oct 25 21:42:56 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2e4218310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff'): ({'sdf'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Removing single pathed devices sdf {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a913f16-ae50-472c-bc80-7c1eafa13e7d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9c9553-d9ea-4c7b-8605-967fc17639fa]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Flushing IO for device /dev/sdf {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ed0f16-ca82-4322-a714-3aa8a66342b4]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee0dae2-4a19-4baf-a91f-6874976b4261]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] SCSI volumes sdf have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5905f516-3a8f-4bc3-a8da-2532f5f49cb3]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3579f6f-f5c9-4cc9-ad36-9b70b82e9168]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff, portal: 172.16.0.220,3260]
Oct 25 21:42:56 user nova-compute[74189]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff, portal: 172.16.0.220,3260] successful.
Oct 25 21:42:56 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5981cb48-061e-4256-ac4e-8b8529bfdaff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[110cca27-997e-4323-be3b-f10c9de57e5e]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] <== disconnect_volume: return (339ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:42:56 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:42:57 user nova-compute[74189]: DEBUG nova.objects.instance [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lazy-loading 'flavor' on Instance uuid aa2b9013-4a8b-4f8d-a5dc-42842cd987a7 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:42:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-54882750-64a0-4a3c-bb0f-0c76be12b825 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.930s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:42:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:42:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:43:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Acquiring lock "fff8f286-0baa-4865-994f-4418af3edd0a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:43:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "fff8f286-0baa-4865-994f-4418af3edd0a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:43:09 user nova-compute[74189]: INFO nova.compute.manager [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Detaching volume 14ce106e-394e-45a9-9538-375cfad8688a
Oct 25 21:43:09 user nova-compute[74189]: INFO nova.virt.block_device [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Attempting to driver detach volume 14ce106e-394e-45a9-9538-375cfad8688a from mountpoint /dev/vdb
Oct 25 21:43:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Attempting to detach device vdb from instance fff8f286-0baa-4865-994f-4418af3edd0a from the persistent domain config. {{(pid=74189) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 21:43:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:43:09 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:43:09 user nova-compute[74189]:   <source dev="/dev/sde"/>
Oct 25 21:43:09 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:43:09 user nova-compute[74189]:   <serial>14ce106e-394e-45a9-9538-375cfad8688a</serial>
Oct 25 21:43:09 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:43:09 user nova-compute[74189]: </disk>
Oct 25 21:43:09 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:43:09 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Successfully detached device vdb from instance fff8f286-0baa-4865-994f-4418af3edd0a from the persistent domain config.
Oct 25 21:43:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fff8f286-0baa-4865-994f-4418af3edd0a from the live domain config. {{(pid=74189) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 21:43:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:43:09 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:43:09 user nova-compute[74189]:   <source dev="/dev/sde"/>
Oct 25 21:43:09 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:43:09 user nova-compute[74189]:   <serial>14ce106e-394e-45a9-9538-375cfad8688a</serial>
Oct 25 21:43:09 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:43:09 user nova-compute[74189]: </disk>
Oct 25 21:43:09 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:43:10 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fff8f286-0baa-4865-994f-4418af3edd0a {{(pid=74189) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 21:43:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:14 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance be371e0c-ebc8-46f7-89eb-44b55f4adf90 is timed out.
Oct 25 21:43:14 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Successfully detached device vdb from instance be371e0c-ebc8-46f7-89eb-44b55f4adf90 from the live domain config.
Oct 25 21:43:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ViZjoDwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:43:14 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:43:14 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a68047-488b-4b5c-93ea-7871dcdf6428]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:43:14 user nova-compute[74189]: No targets found.
Oct 25 21:43:14 user nova-compute[74189]: iSNS:
Oct 25 21:43:14 user nova-compute[74189]: No targets found.
Oct 25 21:43:14 user nova-compute[74189]: STATIC:
Oct 25 21:43:14 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772
Oct 25 21:43:14 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:43:14 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:43:14 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf
Oct 25 21:43:14 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:43:14 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:43:14 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29
Oct 25 21:43:14 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:43:14 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:43:14 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a
Oct 25 21:43:14 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:43:14 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:43:14 user nova-compute[74189]: FIRMWARE:
Oct 25 21:43:14 user nova-compute[74189]: No targets found.
Oct 25 21:43:14 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:43:14 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:43:14 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9616736d-6741-4848-bd0f-16d381f3382c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[14eb21be-4497-45a6-bfa0-7f9def8b4403]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf (non-flash)
Oct 25 21:43:14 user nova-compute[74189]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:43:14 user nova-compute[74189]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 (non-flash)
Oct 25 21:43:14 user nova-compute[74189]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a (non-flash)
Oct 25 21:43:14 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf (non-flash)
Oct 25 21:43:14 user nova-compute[74189]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:43:14 user nova-compute[74189]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 (non-flash)
Oct 25 21:43:14 user nova-compute[74189]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a (non-flash)
Oct 25 21:43:14 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2c471ef80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf'): ({'sdb'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Removing single pathed devices sdb {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e61a4c6-cd69-4369-a991-3b1ecc97e554]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2192f46-117e-4d5f-a121-807931d7a6ec]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Flushing IO for device /dev/sdb {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c63253-5ed0-42b4-9b1a-5faf22ab3be3]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccebdb59-7d03-414b-8f12-9a4c0ab8c840]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] SCSI volumes sdb have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc35ef4-814b-4f07-972d-9095be52cfbf]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:43:14 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:15 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[451618f3-8945-4a3b-9061-cd4325ee99de]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:43:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf, portal: 172.16.0.220,3260]
Oct 25 21:43:15 user nova-compute[74189]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf, portal: 172.16.0.220,3260] successful.
Oct 25 21:43:15 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:43:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:15 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:15 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[805c433c-0c79-496e-a077-150f22a0c768]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:43:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:43:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:43:15 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] <== disconnect_volume: return (317ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:43:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:43:15 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Updating instance_info_cache with network_info: [{"id": "af0547c4-bcad-40cb-9183-e3fd84c1c8fb", "address": "fa:16:3e:17:71:69", "network": {"id": "351bf1c4-8784-41c0-8b68-a939f493bc5a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1840723104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fd14dac60ad462fbaafc984745a06df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0547c4-bc", "ovs_interfaceid": "af0547c4-bcad-40cb-9183-e3fd84c1c8fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:43:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:43:15 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:43:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:43:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 21:43:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:43:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:43:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:19 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:43:19 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:43:20 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:43:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:43:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:43:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:43:20 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:43:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be371e0c-ebc8-46f7-89eb-44b55f4adf90/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be371e0c-ebc8-46f7-89eb-44b55f4adf90/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be371e0c-ebc8-46f7-89eb-44b55f4adf90/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:21 user nova-compute[74189]: DEBUG nova.objects.instance [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lazy-loading 'flavor' on Instance uuid be371e0c-ebc8-46f7-89eb-44b55f4adf90 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:43:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be371e0c-ebc8-46f7-89eb-44b55f4adf90/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f6c32444-b21f-4b75-a4e7-b3a6e7fbd4d6 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "be371e0c-ebc8-46f7-89eb-44b55f4adf90" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 27.280s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:43:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "be371e0c-ebc8-46f7-89eb-44b55f4adf90" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 27.143s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:43:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Acquiring lock "be371e0c-ebc8-46f7-89eb-44b55f4adf90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:43:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "be371e0c-ebc8-46f7-89eb-44b55f4adf90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:43:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "be371e0c-ebc8-46f7-89eb-44b55f4adf90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:43:21 user nova-compute[74189]: INFO nova.compute.manager [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Terminating instance
Oct 25 21:43:21 user nova-compute[74189]: DEBUG nova.compute.manager [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:43:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:21 user nova-compute[74189]: DEBUG nova.compute.manager [req-6a2ebf33-e2e0-4f4a-ba61-54154e697b4a req-9e7eabe7-a1cc-4d5d-9851-f9fc4eeb0c5b service nova] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Received event network-vif-unplugged-1fc98560-71c7-45c8-a806-73adbfb8f45d {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:43:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-6a2ebf33-e2e0-4f4a-ba61-54154e697b4a req-9e7eabe7-a1cc-4d5d-9851-f9fc4eeb0c5b service nova] Acquiring lock "be371e0c-ebc8-46f7-89eb-44b55f4adf90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:43:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-6a2ebf33-e2e0-4f4a-ba61-54154e697b4a req-9e7eabe7-a1cc-4d5d-9851-f9fc4eeb0c5b service nova] Lock "be371e0c-ebc8-46f7-89eb-44b55f4adf90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:43:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-6a2ebf33-e2e0-4f4a-ba61-54154e697b4a req-9e7eabe7-a1cc-4d5d-9851-f9fc4eeb0c5b service nova] Lock "be371e0c-ebc8-46f7-89eb-44b55f4adf90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:43:21 user nova-compute[74189]: DEBUG nova.compute.manager [req-6a2ebf33-e2e0-4f4a-ba61-54154e697b4a req-9e7eabe7-a1cc-4d5d-9851-f9fc4eeb0c5b service nova] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] No waiting events found dispatching network-vif-unplugged-1fc98560-71c7-45c8-a806-73adbfb8f45d {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:43:21 user nova-compute[74189]: DEBUG nova.compute.manager [req-6a2ebf33-e2e0-4f4a-ba61-54154e697b4a req-9e7eabe7-a1cc-4d5d-9851-f9fc4eeb0c5b service nova] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Received event network-vif-unplugged-1fc98560-71c7-45c8-a806-73adbfb8f45d for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:43:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:22 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Instance destroyed successfully.
Oct 25 21:43:22 user nova-compute[74189]: DEBUG nova.objects.instance [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lazy-loading 'resources' on Instance uuid be371e0c-ebc8-46f7-89eb-44b55f4adf90 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:39:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-728248414',display_name='tempest-VolumesSnapshotTestJSON-instance-728248414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-728248414',id=43,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLNvrD7cNC0znB/JStHbg5w1s0p85TDVnh16HyymtMUj8QEi29pXB+GfgaDsbQytlBKx08I/7eYfq5KrTaKm0G/Lyd5BlljsfQktZMxTaKjPmzIQYApSzKagLPxbjyFSQ==',key_name='tempest-keypair-1532088590',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:39:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff1b56c6086e4a41bf9a98b96101531e',ramdisk_id='',reservation_id='r-rer817bm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1589464160',owner_user_name='tempest-VolumesSnapshotTestJSON-1589464160-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:39:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bcb3eebd1e04f0b978238f4eeeec2de',uuid=be371e0c-ebc8-46f7-89eb-44b55f4adf90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1fc98560-71c7-45c8-a806-73adbfb8f45d", "address": "fa:16:3e:e4:f6:a2", "network": {"id": "27a00d33-61db-45a8-a945-cd8514be6344", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1691303850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff1b56c6086e4a41bf9a98b96101531e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc98560-71", "ovs_interfaceid": "1fc98560-71c7-45c8-a806-73adbfb8f45d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Converting VIF {"id": "1fc98560-71c7-45c8-a806-73adbfb8f45d", "address": "fa:16:3e:e4:f6:a2", "network": {"id": "27a00d33-61db-45a8-a945-cd8514be6344", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1691303850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff1b56c6086e4a41bf9a98b96101531e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc98560-71", "ovs_interfaceid": "1fc98560-71c7-45c8-a806-73adbfb8f45d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:f6:a2,bridge_name='br-int',has_traffic_filtering=True,id=1fc98560-71c7-45c8-a806-73adbfb8f45d,network=Network(27a00d33-61db-45a8-a945-cd8514be6344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fc98560-71') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG os_vif [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:f6:a2,bridge_name='br-int',has_traffic_filtering=True,id=1fc98560-71c7-45c8-a806-73adbfb8f45d,network=Network(27a00d33-61db-45a8-a945-cd8514be6344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fc98560-71') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1fc98560-71, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=72021f36-8d8e-42dc-a66f-066fc52caf8e) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:43:22 user nova-compute[74189]: INFO os_vif [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:f6:a2,bridge_name='br-int',has_traffic_filtering=True,id=1fc98560-71c7-45c8-a806-73adbfb8f45d,network=Network(27a00d33-61db-45a8-a945-cd8514be6344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fc98560-71')
Oct 25 21:43:22 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ViZjoDwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:43:22 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:43:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad8e3ba-fb40-4251-a2fb-b7d211593dc7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:43:22 user nova-compute[74189]: No targets found.
Oct 25 21:43:22 user nova-compute[74189]: iSNS:
Oct 25 21:43:22 user nova-compute[74189]: No targets found.
Oct 25 21:43:22 user nova-compute[74189]: STATIC:
Oct 25 21:43:22 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772
Oct 25 21:43:22 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:43:22 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:43:22 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29
Oct 25 21:43:22 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:43:22 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:43:22 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a
Oct 25 21:43:22 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:43:22 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:43:22 user nova-compute[74189]: FIRMWARE:
Oct 25 21:43:22 user nova-compute[74189]: No targets found.
Oct 25 21:43:22 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:43:22 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:43:22 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68cdc8db-e979-4dbc-9546-9058400e4adf', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0e4341-256c-4919-ba0d-b2b1f0949018]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcc3a30-5444-47d9-a9d5-07f886267545]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:43:22 user nova-compute[74189]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 (non-flash)
Oct 25 21:43:22 user nova-compute[74189]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a (non-flash)
Oct 25 21:43:22 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:43:22 user nova-compute[74189]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 (non-flash)
Oct 25 21:43:22 user nova-compute[74189]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a (non-flash)
Oct 25 21:43:22 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2e43e8e50>, {}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Disconnecting from: [] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.075s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] <== disconnect_volume: return (78ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:43:22 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Deleting instance files /opt/stack/data/nova/instances/be371e0c-ebc8-46f7-89eb-44b55f4adf90_del
Oct 25 21:43:22 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Deletion of /opt/stack/data/nova/instances/be371e0c-ebc8-46f7-89eb-44b55f4adf90_del complete
Oct 25 21:43:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:22 user nova-compute[74189]: INFO nova.compute.manager [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Took 1.01 seconds to destroy the instance on the hypervisor.
Oct 25 21:43:22 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:23 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:43:23 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Took 0.79 seconds to deallocate network for instance.
Oct 25 21:43:23 user nova-compute[74189]: WARNING nova.volume.cinder [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Attachment 1c5f22f6-cc87-441f-96b3-a3ccef60886d does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 1c5f22f6-cc87-441f-96b3-a3ccef60886d. (HTTP 404) (Request-ID: req-0c632e55-8743-461c-9c4d-9ab3b82b1f67)
Oct 25 21:43:23 user nova-compute[74189]: INFO nova.compute.manager [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Took 0.06 seconds to detach 1 volumes for instance.
Oct 25 21:43:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2b9013-4a8b-4f8d-a5dc-42842cd987a7/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:43:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:43:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2b9013-4a8b-4f8d-a5dc-42842cd987a7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2b9013-4a8b-4f8d-a5dc-42842cd987a7/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:23 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:43:23 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:43:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:43:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2b9013-4a8b-4f8d-a5dc-42842cd987a7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:43:23 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Deleted allocations for instance be371e0c-ebc8-46f7-89eb-44b55f4adf90
Oct 25 21:43:24 user nova-compute[74189]: DEBUG nova.compute.manager [req-8229b5b1-1964-40e0-a8c0-9189fdc01b54 req-d6516c2c-d5e5-4064-9354-f82e5a13c132 service nova] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Received event network-vif-plugged-1fc98560-71c7-45c8-a806-73adbfb8f45d {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:43:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8229b5b1-1964-40e0-a8c0-9189fdc01b54 req-d6516c2c-d5e5-4064-9354-f82e5a13c132 service nova] Acquiring lock "be371e0c-ebc8-46f7-89eb-44b55f4adf90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:43:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8229b5b1-1964-40e0-a8c0-9189fdc01b54 req-d6516c2c-d5e5-4064-9354-f82e5a13c132 service nova] Lock "be371e0c-ebc8-46f7-89eb-44b55f4adf90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:43:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8229b5b1-1964-40e0-a8c0-9189fdc01b54 req-d6516c2c-d5e5-4064-9354-f82e5a13c132 service nova] Lock "be371e0c-ebc8-46f7-89eb-44b55f4adf90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:43:24 user nova-compute[74189]: DEBUG nova.compute.manager [req-8229b5b1-1964-40e0-a8c0-9189fdc01b54 req-d6516c2c-d5e5-4064-9354-f82e5a13c132 service nova] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] No waiting events found dispatching network-vif-plugged-1fc98560-71c7-45c8-a806-73adbfb8f45d {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:43:24 user nova-compute[74189]: WARNING nova.compute.manager [req-8229b5b1-1964-40e0-a8c0-9189fdc01b54 req-d6516c2c-d5e5-4064-9354-f82e5a13c132 service nova] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Received unexpected event network-vif-plugged-1fc98560-71c7-45c8-a806-73adbfb8f45d for instance with vm_state deleted and task_state None.
Oct 25 21:43:24 user nova-compute[74189]: DEBUG nova.compute.manager [req-8229b5b1-1964-40e0-a8c0-9189fdc01b54 req-d6516c2c-d5e5-4064-9354-f82e5a13c132 service nova] [instance: be371e0c-ebc8-46f7-89eb-44b55f4adf90] Received event network-vif-deleted-1fc98560-71c7-45c8-a806-73adbfb8f45d {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:43:24 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:43:24 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:43:24 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=8203MB free_disk=24.950103759765625GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:43:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:43:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:43:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-627d92d2-2a9a-42e3-a19c-bfd43046a3f5 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "be371e0c-ebc8-46f7-89eb-44b55f4adf90" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.783s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:43:24 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:43:24 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3da14c0a-31a8-4fe3-bd5a-49378680af50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:43:24 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance aa2b9013-4a8b-4f8d-a5dc-42842cd987a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:43:24 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 915a1d25-6499-4d3e-9edd-5f3cfd487bac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:43:24 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance fff8f286-0baa-4865-994f-4418af3edd0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:43:24 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:43:24 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:43:24 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:43:24 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:43:24 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:43:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.358s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:43:25 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:43:25 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:43:25 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:43:25 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:43:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Acquiring lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:43:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:43:25 user nova-compute[74189]: INFO nova.compute.manager [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Detaching volume 0ddb81d0-cc03-4175-ae74-e6a70fd02772
Oct 25 21:43:26 user nova-compute[74189]: INFO nova.virt.block_device [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Attempting to driver detach volume 0ddb81d0-cc03-4175-ae74-e6a70fd02772 from mountpoint /dev/vdb
Oct 25 21:43:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Attempting to detach device vdb from instance aa2b9013-4a8b-4f8d-a5dc-42842cd987a7 from the persistent domain config. {{(pid=74189) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 21:43:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:43:26 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:43:26 user nova-compute[74189]:   <source dev="/dev/sdd"/>
Oct 25 21:43:26 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:43:26 user nova-compute[74189]:   <serial>0ddb81d0-cc03-4175-ae74-e6a70fd02772</serial>
Oct 25 21:43:26 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:43:26 user nova-compute[74189]: </disk>
Oct 25 21:43:26 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:43:26 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Successfully detached device vdb from instance aa2b9013-4a8b-4f8d-a5dc-42842cd987a7 from the persistent domain config.
Oct 25 21:43:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance aa2b9013-4a8b-4f8d-a5dc-42842cd987a7 from the live domain config. {{(pid=74189) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 21:43:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:43:26 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:43:26 user nova-compute[74189]:   <source dev="/dev/sdd"/>
Oct 25 21:43:26 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:43:26 user nova-compute[74189]:   <serial>0ddb81d0-cc03-4175-ae74-e6a70fd02772</serial>
Oct 25 21:43:26 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:43:26 user nova-compute[74189]: </disk>
Oct 25 21:43:26 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:43:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance aa2b9013-4a8b-4f8d-a5dc-42842cd987a7 {{(pid=74189) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 21:43:26 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:43:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:30 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fff8f286-0baa-4865-994f-4418af3edd0a is timed out.
Oct 25 21:43:30 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Successfully detached device vdb from instance fff8f286-0baa-4865-994f-4418af3edd0a from the live domain config.
Oct 25 21:43:30 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NEoPHMCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:43:30 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:43:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f849bbc-1ed8-4f07-8317-5dacff5196b4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:43:30 user nova-compute[74189]: No targets found.
Oct 25 21:43:30 user nova-compute[74189]: iSNS:
Oct 25 21:43:30 user nova-compute[74189]: No targets found.
Oct 25 21:43:30 user nova-compute[74189]: STATIC:
Oct 25 21:43:30 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772
Oct 25 21:43:30 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:43:30 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:43:30 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29
Oct 25 21:43:30 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:43:30 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:43:30 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a
Oct 25 21:43:30 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:43:30 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:43:30 user nova-compute[74189]: FIRMWARE:
Oct 25 21:43:30 user nova-compute[74189]: No targets found.
Oct 25 21:43:30 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:43:30 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:43:30 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6578b5db-458f-4bf5-bd08-465231a9a42c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7d6788-dbef-4be4-9ccc-d9a8a32b2893]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:43:30 user nova-compute[74189]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 (non-flash)
Oct 25 21:43:30 user nova-compute[74189]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a (non-flash)
Oct 25 21:43:30 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:43:30 user nova-compute[74189]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 (non-flash)
Oct 25 21:43:30 user nova-compute[74189]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a (non-flash)
Oct 25 21:43:30 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2c471f5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a'): ({'sde'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Removing single pathed devices sde {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a7f845-6baf-42d7-a07c-ec6a4caab5bd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[573f43a8-1e7b-4309-8b5a-aecfbc9988e2]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Flushing IO for device /dev/sde {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b3e2ee-fc82-4622-8eb0-94a7563e456f]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab09517c-93c3-42ee-839d-caee9622536a]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] SCSI volumes sde have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[92592079-03d2-459d-b9b8-7590eacfa33d]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd85dcad-6870-4037-ab8b-657e3043757d]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a, portal: 172.16.0.220,3260]
Oct 25 21:43:30 user nova-compute[74189]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a, portal: 172.16.0.220,3260] successful.
Oct 25 21:43:30 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14ce106e-394e-45a9-9538-375cfad8688a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[30837e06-c59a-4766-bd39-766b08b5418c]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] <== disconnect_volume: return (305ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:43:30 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:43:31 user nova-compute[74189]: DEBUG nova.objects.instance [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lazy-loading 'flavor' on Instance uuid fff8f286-0baa-4865-994f-4418af3edd0a {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:43:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ca367158-b58a-4d5a-bf5f-570a82b44102 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "fff8f286-0baa-4865-994f-4418af3edd0a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.962s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:43:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:32 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:43:32 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:43:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Acquiring lock "38919a8d-2c62-4d4d-83e2-97b69409155d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:43:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lock "38919a8d-2c62-4d4d-83e2-97b69409155d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:43:37 user nova-compute[74189]: DEBUG nova.compute.manager [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:43:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:43:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:43:37 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:43:37 user nova-compute[74189]: INFO nova.compute.claims [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Claim successful on node user
Oct 25 21:43:37 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:43:37 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:43:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.313s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:43:37 user nova-compute[74189]: DEBUG nova.compute.manager [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:43:37 user nova-compute[74189]: DEBUG nova.compute.manager [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:43:37 user nova-compute[74189]: DEBUG nova.network.neutron [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:43:37 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:43:37 user nova-compute[74189]: DEBUG nova.compute.manager [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:43:37 user nova-compute[74189]: DEBUG nova.policy [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '06898f18a73c449c95fea8ee727741f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba950bd71349a2bfac732f770a9731', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:43:37 user nova-compute[74189]: DEBUG nova.compute.manager [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:43:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:43:37 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Creating image(s)
Oct 25 21:43:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Acquiring lock "/opt/stack/data/nova/instances/38919a8d-2c62-4d4d-83e2-97b69409155d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:43:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lock "/opt/stack/data/nova/instances/38919a8d-2c62-4d4d-83e2-97b69409155d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:43:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lock "/opt/stack/data/nova/instances/38919a8d-2c62-4d4d-83e2-97b69409155d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:43:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.175s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:43:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:43:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.195s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/38919a8d-2c62-4d4d-83e2-97b69409155d/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:38 user nova-compute[74189]: DEBUG nova.network.neutron [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Successfully created port: 2744e70f-bf6d-4f88-a193-03350965a6ef {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:43:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/38919a8d-2c62-4d4d-83e2-97b69409155d/disk 1073741824" returned: 0 in 0.058s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:43:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.197s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:38 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Checking if we can resize image /opt/stack/data/nova/instances/38919a8d-2c62-4d4d-83e2-97b69409155d/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:43:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38919a8d-2c62-4d4d-83e2-97b69409155d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38919a8d-2c62-4d4d-83e2-97b69409155d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:38 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Cannot resize image /opt/stack/data/nova/instances/38919a8d-2c62-4d4d-83e2-97b69409155d/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:43:38 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:43:38 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Ensure instance console log exists: /opt/stack/data/nova/instances/38919a8d-2c62-4d4d-83e2-97b69409155d/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:43:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:43:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:43:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:43:38 user nova-compute[74189]: DEBUG nova.network.neutron [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Successfully updated port: 2744e70f-bf6d-4f88-a193-03350965a6ef {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:43:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Acquiring lock "refresh_cache-38919a8d-2c62-4d4d-83e2-97b69409155d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:43:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Acquired lock "refresh_cache-38919a8d-2c62-4d4d-83e2-97b69409155d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:43:38 user nova-compute[74189]: DEBUG nova.network.neutron [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:43:38 user nova-compute[74189]: DEBUG nova.compute.manager [req-7e83e0f2-8c97-413f-a0fb-644382ac2d78 req-02a33b46-0529-4fb1-b172-3c0a91b9d91e service nova] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Received event network-changed-2744e70f-bf6d-4f88-a193-03350965a6ef {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:43:38 user nova-compute[74189]: DEBUG nova.compute.manager [req-7e83e0f2-8c97-413f-a0fb-644382ac2d78 req-02a33b46-0529-4fb1-b172-3c0a91b9d91e service nova] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Refreshing instance network info cache due to event network-changed-2744e70f-bf6d-4f88-a193-03350965a6ef. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:43:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7e83e0f2-8c97-413f-a0fb-644382ac2d78 req-02a33b46-0529-4fb1-b172-3c0a91b9d91e service nova] Acquiring lock "refresh_cache-38919a8d-2c62-4d4d-83e2-97b69409155d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG nova.network.neutron [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG nova.network.neutron [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Updating instance_info_cache with network_info: [{"id": "2744e70f-bf6d-4f88-a193-03350965a6ef", "address": "fa:16:3e:3c:31:dd", "network": {"id": "9fd8198e-7326-4533-a88c-c4ca629214d6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-40841454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9ba950bd71349a2bfac732f770a9731", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2744e70f-bf", "ovs_interfaceid": "2744e70f-bf6d-4f88-a193-03350965a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Releasing lock "refresh_cache-38919a8d-2c62-4d4d-83e2-97b69409155d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG nova.compute.manager [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Instance network_info: |[{"id": "2744e70f-bf6d-4f88-a193-03350965a6ef", "address": "fa:16:3e:3c:31:dd", "network": {"id": "9fd8198e-7326-4533-a88c-c4ca629214d6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-40841454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9ba950bd71349a2bfac732f770a9731", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2744e70f-bf", "ovs_interfaceid": "2744e70f-bf6d-4f88-a193-03350965a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7e83e0f2-8c97-413f-a0fb-644382ac2d78 req-02a33b46-0529-4fb1-b172-3c0a91b9d91e service nova] Acquired lock "refresh_cache-38919a8d-2c62-4d4d-83e2-97b69409155d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG nova.network.neutron [req-7e83e0f2-8c97-413f-a0fb-644382ac2d78 req-02a33b46-0529-4fb1-b172-3c0a91b9d91e service nova] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Refreshing network info cache for port 2744e70f-bf6d-4f88-a193-03350965a6ef {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Start _get_guest_xml network_info=[{"id": "2744e70f-bf6d-4f88-a193-03350965a6ef", "address": "fa:16:3e:3c:31:dd", "network": {"id": "9fd8198e-7326-4533-a88c-c4ca629214d6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-40841454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9ba950bd71349a2bfac732f770a9731", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2744e70f-bf", "ovs_interfaceid": "2744e70f-bf6d-4f88-a193-03350965a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:39 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:43:39 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:43:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:43:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1010013500',display_name='tempest-VolumesActionsTest-instance-1010013500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1010013500',id=46,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9ba950bd71349a2bfac732f770a9731',ramdisk_id='',reservation_id='r-ed3r9g61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-159377188',owner_user_name='tempest-VolumesActionsTest-159377188-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:43:38Z,user_data=None,user_id='06898f18a73c449c95fea8ee727741f0',uuid=38919a8d-2c62-4d4d-83e2-97b69409155d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2744e70f-bf6d-4f88-a193-03350965a6ef", "address": "fa:16:3e:3c:31:dd", "network": {"id": "9fd8198e-7326-4533-a88c-c4ca629214d6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-40841454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9ba950bd71349a2bfac732f770a9731", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2744e70f-bf", "ovs_interfaceid": "2744e70f-bf6d-4f88-a193-03350965a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Converting VIF {"id": "2744e70f-bf6d-4f88-a193-03350965a6ef", "address": "fa:16:3e:3c:31:dd", "network": {"id": "9fd8198e-7326-4533-a88c-c4ca629214d6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-40841454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9ba950bd71349a2bfac732f770a9731", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2744e70f-bf", "ovs_interfaceid": "2744e70f-bf6d-4f88-a193-03350965a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:31:dd,bridge_name='br-int',has_traffic_filtering=True,id=2744e70f-bf6d-4f88-a193-03350965a6ef,network=Network(9fd8198e-7326-4533-a88c-c4ca629214d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2744e70f-bf') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG nova.objects.instance [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lazy-loading 'pci_devices' on Instance uuid 38919a8d-2c62-4d4d-83e2-97b69409155d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:43:39 user nova-compute[74189]:   <uuid>38919a8d-2c62-4d4d-83e2-97b69409155d</uuid>
Oct 25 21:43:39 user nova-compute[74189]:   <name>instance-0000002e</name>
Oct 25 21:43:39 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:43:39 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:43:39 user nova-compute[74189]:   <metadata>
Oct 25 21:43:39 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:43:39 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:43:39 user nova-compute[74189]:       <nova:name>tempest-VolumesActionsTest-instance-1010013500</nova:name>
Oct 25 21:43:39 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:43:39</nova:creationTime>
Oct 25 21:43:39 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:43:39 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:43:39 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:43:39 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:43:39 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:43:39 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:43:39 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:43:39 user nova-compute[74189]:       <nova:owner>
Oct 25 21:43:39 user nova-compute[74189]:         <nova:user uuid="06898f18a73c449c95fea8ee727741f0">tempest-VolumesActionsTest-159377188-project-member</nova:user>
Oct 25 21:43:39 user nova-compute[74189]:         <nova:project uuid="e9ba950bd71349a2bfac732f770a9731">tempest-VolumesActionsTest-159377188</nova:project>
Oct 25 21:43:39 user nova-compute[74189]:       </nova:owner>
Oct 25 21:43:39 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:43:39 user nova-compute[74189]:       <nova:ports>
Oct 25 21:43:39 user nova-compute[74189]:         <nova:port uuid="2744e70f-bf6d-4f88-a193-03350965a6ef">
Oct 25 21:43:39 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 25 21:43:39 user nova-compute[74189]:         </nova:port>
Oct 25 21:43:39 user nova-compute[74189]:       </nova:ports>
Oct 25 21:43:39 user nova-compute[74189]:     </nova:instance>
Oct 25 21:43:39 user nova-compute[74189]:   </metadata>
Oct 25 21:43:39 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:43:39 user nova-compute[74189]:     <system>
Oct 25 21:43:39 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:43:39 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:43:39 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:43:39 user nova-compute[74189]:       <entry name="serial">38919a8d-2c62-4d4d-83e2-97b69409155d</entry>
Oct 25 21:43:39 user nova-compute[74189]:       <entry name="uuid">38919a8d-2c62-4d4d-83e2-97b69409155d</entry>
Oct 25 21:43:39 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:43:39 user nova-compute[74189]:     </system>
Oct 25 21:43:39 user nova-compute[74189]:   </sysinfo>
Oct 25 21:43:39 user nova-compute[74189]:   <os>
Oct 25 21:43:39 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:43:39 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:43:39 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:43:39 user nova-compute[74189]:   </os>
Oct 25 21:43:39 user nova-compute[74189]:   <features>
Oct 25 21:43:39 user nova-compute[74189]:     <acpi/>
Oct 25 21:43:39 user nova-compute[74189]:     <apic/>
Oct 25 21:43:39 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:43:39 user nova-compute[74189]:   </features>
Oct 25 21:43:39 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:43:39 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:43:39 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:43:39 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:43:39 user nova-compute[74189]:   </clock>
Oct 25 21:43:39 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:43:39 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:43:39 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:43:39 user nova-compute[74189]:   </cpu>
Oct 25 21:43:39 user nova-compute[74189]:   <devices>
Oct 25 21:43:39 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:43:39 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:43:39 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/38919a8d-2c62-4d4d-83e2-97b69409155d/disk"/>
Oct 25 21:43:39 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:43:39 user nova-compute[74189]:     </disk>
Oct 25 21:43:39 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:43:39 user nova-compute[74189]:       <mac address="fa:16:3e:3c:31:dd"/>
Oct 25 21:43:39 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:43:39 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:43:39 user nova-compute[74189]:       <target dev="tap2744e70f-bf"/>
Oct 25 21:43:39 user nova-compute[74189]:     </interface>
Oct 25 21:43:39 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:43:39 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/38919a8d-2c62-4d4d-83e2-97b69409155d/console.log" append="off"/>
Oct 25 21:43:39 user nova-compute[74189]:     </serial>
Oct 25 21:43:39 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:43:39 user nova-compute[74189]:     <video>
Oct 25 21:43:39 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:43:39 user nova-compute[74189]:     </video>
Oct 25 21:43:39 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:43:39 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:43:39 user nova-compute[74189]:     </rng>
Oct 25 21:43:39 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:43:39 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:43:39 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:43:39 user nova-compute[74189]:     </memballoon>
Oct 25 21:43:39 user nova-compute[74189]:   </devices>
Oct 25 21:43:39 user nova-compute[74189]: </domain>
Oct 25 21:43:39 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:43:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1010013500',display_name='tempest-VolumesActionsTest-instance-1010013500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1010013500',id=46,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9ba950bd71349a2bfac732f770a9731',ramdisk_id='',reservation_id='r-ed3r9g61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-159377188',owner_user_name='tempest-VolumesActionsTest-159377188-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:43:38Z,user_data=None,user_id='06898f18a73c449c95fea8ee727741f0',uuid=38919a8d-2c62-4d4d-83e2-97b69409155d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2744e70f-bf6d-4f88-a193-03350965a6ef", "address": "fa:16:3e:3c:31:dd", "network": {"id": "9fd8198e-7326-4533-a88c-c4ca629214d6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-40841454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9ba950bd71349a2bfac732f770a9731", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2744e70f-bf", "ovs_interfaceid": "2744e70f-bf6d-4f88-a193-03350965a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Converting VIF {"id": "2744e70f-bf6d-4f88-a193-03350965a6ef", "address": "fa:16:3e:3c:31:dd", "network": {"id": "9fd8198e-7326-4533-a88c-c4ca629214d6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-40841454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9ba950bd71349a2bfac732f770a9731", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2744e70f-bf", "ovs_interfaceid": "2744e70f-bf6d-4f88-a193-03350965a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:31:dd,bridge_name='br-int',has_traffic_filtering=True,id=2744e70f-bf6d-4f88-a193-03350965a6ef,network=Network(9fd8198e-7326-4533-a88c-c4ca629214d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2744e70f-bf') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG os_vif [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:31:dd,bridge_name='br-int',has_traffic_filtering=True,id=2744e70f-bf6d-4f88-a193-03350965a6ef,network=Network(9fd8198e-7326-4533-a88c-c4ca629214d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2744e70f-bf') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7fc04d07-b6e7-5ed7-a3e1-8b213b7f122c', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2744e70f-bf, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2744e70f-bf, col_values=(('qos', UUID('0a0d1013-fcfd-4426-ac05-d752ba67c64e')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2744e70f-bf, col_values=(('external_ids', {'iface-id': '2744e70f-bf6d-4f88-a193-03350965a6ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:31:dd', 'vm-uuid': '38919a8d-2c62-4d4d-83e2-97b69409155d'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:39 user nova-compute[74189]: INFO os_vif [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:31:dd,bridge_name='br-int',has_traffic_filtering=True,id=2744e70f-bf6d-4f88-a193-03350965a6ef,network=Network(9fd8198e-7326-4533-a88c-c4ca629214d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2744e70f-bf')
Oct 25 21:43:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] No VIF found with MAC fa:16:3e:3c:31:dd, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG nova.network.neutron [req-7e83e0f2-8c97-413f-a0fb-644382ac2d78 req-02a33b46-0529-4fb1-b172-3c0a91b9d91e service nova] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Updated VIF entry in instance network info cache for port 2744e70f-bf6d-4f88-a193-03350965a6ef. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG nova.network.neutron [req-7e83e0f2-8c97-413f-a0fb-644382ac2d78 req-02a33b46-0529-4fb1-b172-3c0a91b9d91e service nova] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Updating instance_info_cache with network_info: [{"id": "2744e70f-bf6d-4f88-a193-03350965a6ef", "address": "fa:16:3e:3c:31:dd", "network": {"id": "9fd8198e-7326-4533-a88c-c4ca629214d6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-40841454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9ba950bd71349a2bfac732f770a9731", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2744e70f-bf", "ovs_interfaceid": "2744e70f-bf6d-4f88-a193-03350965a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:43:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7e83e0f2-8c97-413f-a0fb-644382ac2d78 req-02a33b46-0529-4fb1-b172-3c0a91b9d91e service nova] Releasing lock "refresh_cache-38919a8d-2c62-4d4d-83e2-97b69409155d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:43:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:41 user nova-compute[74189]: DEBUG nova.compute.manager [req-c547d7e5-996f-4838-997e-b202f38b74b4 req-1ac0d0c2-a76c-42f1-b305-5d41c5967a45 service nova] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Received event network-vif-plugged-2744e70f-bf6d-4f88-a193-03350965a6ef {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:43:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c547d7e5-996f-4838-997e-b202f38b74b4 req-1ac0d0c2-a76c-42f1-b305-5d41c5967a45 service nova] Acquiring lock "38919a8d-2c62-4d4d-83e2-97b69409155d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:43:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c547d7e5-996f-4838-997e-b202f38b74b4 req-1ac0d0c2-a76c-42f1-b305-5d41c5967a45 service nova] Lock "38919a8d-2c62-4d4d-83e2-97b69409155d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:43:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c547d7e5-996f-4838-997e-b202f38b74b4 req-1ac0d0c2-a76c-42f1-b305-5d41c5967a45 service nova] Lock "38919a8d-2c62-4d4d-83e2-97b69409155d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:43:41 user nova-compute[74189]: DEBUG nova.compute.manager [req-c547d7e5-996f-4838-997e-b202f38b74b4 req-1ac0d0c2-a76c-42f1-b305-5d41c5967a45 service nova] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] No waiting events found dispatching network-vif-plugged-2744e70f-bf6d-4f88-a193-03350965a6ef {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:43:41 user nova-compute[74189]: WARNING nova.compute.manager [req-c547d7e5-996f-4838-997e-b202f38b74b4 req-1ac0d0c2-a76c-42f1-b305-5d41c5967a45 service nova] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Received unexpected event network-vif-plugged-2744e70f-bf6d-4f88-a193-03350965a6ef for instance with vm_state building and task_state spawning.
Oct 25 21:43:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:43 user nova-compute[74189]: DEBUG nova.compute.manager [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:43:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:43:43 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Instance spawned successfully.
Oct 25 21:43:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:43:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:43:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:43:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:43:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:43:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:43:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:43:43 user nova-compute[74189]: DEBUG nova.compute.manager [req-f47e5653-b30d-45a4-aac6-2e378fbf1491 req-d899c499-a3bb-460b-b63b-16bd1f5eea1f service nova] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Received event network-vif-plugged-2744e70f-bf6d-4f88-a193-03350965a6ef {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:43:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f47e5653-b30d-45a4-aac6-2e378fbf1491 req-d899c499-a3bb-460b-b63b-16bd1f5eea1f service nova] Acquiring lock "38919a8d-2c62-4d4d-83e2-97b69409155d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:43:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f47e5653-b30d-45a4-aac6-2e378fbf1491 req-d899c499-a3bb-460b-b63b-16bd1f5eea1f service nova] Lock "38919a8d-2c62-4d4d-83e2-97b69409155d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:43:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f47e5653-b30d-45a4-aac6-2e378fbf1491 req-d899c499-a3bb-460b-b63b-16bd1f5eea1f service nova] Lock "38919a8d-2c62-4d4d-83e2-97b69409155d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:43:43 user nova-compute[74189]: DEBUG nova.compute.manager [req-f47e5653-b30d-45a4-aac6-2e378fbf1491 req-d899c499-a3bb-460b-b63b-16bd1f5eea1f service nova] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] No waiting events found dispatching network-vif-plugged-2744e70f-bf6d-4f88-a193-03350965a6ef {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:43:43 user nova-compute[74189]: WARNING nova.compute.manager [req-f47e5653-b30d-45a4-aac6-2e378fbf1491 req-d899c499-a3bb-460b-b63b-16bd1f5eea1f service nova] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Received unexpected event network-vif-plugged-2744e70f-bf6d-4f88-a193-03350965a6ef for instance with vm_state building and task_state spawning.
Oct 25 21:43:43 user nova-compute[74189]: INFO nova.compute.manager [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Took 5.30 seconds to spawn the instance on the hypervisor.
Oct 25 21:43:43 user nova-compute[74189]: DEBUG nova.compute.manager [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:43:43 user nova-compute[74189]: INFO nova.compute.manager [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Took 5.94 seconds to build instance.
Oct 25 21:43:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b795ff96-99e2-466a-a27e-908de37cefd9 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lock "38919a8d-2c62-4d4d-83e2-97b69409155d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.034s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:43:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:46 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance aa2b9013-4a8b-4f8d-a5dc-42842cd987a7 is timed out.
Oct 25 21:43:46 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Successfully detached device vdb from instance aa2b9013-4a8b-4f8d-a5dc-42842cd987a7 from the live domain config.
Oct 25 21:43:46 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KRCXqEkQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:43:46 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:43:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2316619-dd93-4020-96a1-1dfc6a36de7d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:43:46 user nova-compute[74189]: No targets found.
Oct 25 21:43:46 user nova-compute[74189]: iSNS:
Oct 25 21:43:46 user nova-compute[74189]: No targets found.
Oct 25 21:43:46 user nova-compute[74189]: STATIC:
Oct 25 21:43:46 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772
Oct 25 21:43:46 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:43:46 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:43:46 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29
Oct 25 21:43:46 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:43:46 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:43:46 user nova-compute[74189]: FIRMWARE:
Oct 25 21:43:46 user nova-compute[74189]: No targets found.
Oct 25 21:43:46 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:43:46 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:43:46 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6148e0c9-8ea0-4252-94f7-d9b99e1597ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8138d2-1cbd-456e-820f-f4074a63b3a8]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:43:46 user nova-compute[74189]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 (non-flash)
Oct 25 21:43:46 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:43:46 user nova-compute[74189]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 (non-flash)
Oct 25 21:43:46 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2e43e9480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772'): ({'sdd'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Removing single pathed devices sdd {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0865a51-c01c-4d51-bf4b-c48e1e506e79]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde7a914-9f2b-437a-9ca0-9b596ff88305]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Flushing IO for device /dev/sdd {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0405aa0f-9b48-4ff7-b29c-2b2bb8ed5ac0]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d997d73c-797a-4c67-aaaf-4dab983bc212]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] SCSI volumes sdd have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ca857d-8b3f-4b96-8031-70171f0e3ca3]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[815647d6-8640-4342-ba48-e4bf33d16ccf]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772, portal: 172.16.0.220,3260]
Oct 25 21:43:46 user nova-compute[74189]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772, portal: 172.16.0.220,3260] successful.
Oct 25 21:43:46 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddb81d0-cc03-4175-ae74-e6a70fd02772 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[411ef3f8-399c-4b09-98c7-d0b9545f1e38]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] <== disconnect_volume: return (389ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:43:46 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:43:47 user nova-compute[74189]: DEBUG nova.objects.instance [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lazy-loading 'flavor' on Instance uuid aa2b9013-4a8b-4f8d-a5dc-42842cd987a7 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:43:48 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-cf9e1596-eb12-4621-b3f0-dd00914cdd52 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.036s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:43:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:43:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:43:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 21:43:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:43:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:43:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:54 user nova-compute[74189]: INFO nova.compute.manager [None req-30fe4693-7da0-4072-98c6-79f4fe3e3aeb tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Unrescuing
Oct 25 21:43:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-30fe4693-7da0-4072-98c6-79f4fe3e3aeb tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "refresh_cache-915a1d25-6499-4d3e-9edd-5f3cfd487bac" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:43:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-30fe4693-7da0-4072-98c6-79f4fe3e3aeb tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquired lock "refresh_cache-915a1d25-6499-4d3e-9edd-5f3cfd487bac" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:43:54 user nova-compute[74189]: DEBUG nova.network.neutron [None req-30fe4693-7da0-4072-98c6-79f4fe3e3aeb tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:43:55 user nova-compute[74189]: DEBUG nova.network.neutron [None req-30fe4693-7da0-4072-98c6-79f4fe3e3aeb tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Updating instance_info_cache with network_info: [{"id": "d8084804-8e6e-4787-b331-96822b5ed349", "address": "fa:16:3e:1c:bf:ba", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8084804-8e", "ovs_interfaceid": "d8084804-8e6e-4787-b331-96822b5ed349", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:43:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-30fe4693-7da0-4072-98c6-79f4fe3e3aeb tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Releasing lock "refresh_cache-915a1d25-6499-4d3e-9edd-5f3cfd487bac" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:43:55 user nova-compute[74189]: DEBUG nova.objects.instance [None req-30fe4693-7da0-4072-98c6-79f4fe3e3aeb tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lazy-loading 'flavor' on Instance uuid 915a1d25-6499-4d3e-9edd-5f3cfd487bac {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:43:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:55 user nova-compute[74189]: DEBUG nova.compute.manager [req-90efe147-4049-4727-923e-d538dc3ed039 req-c7b6d271-26bb-4d51-80c9-6d7cc285345c service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Received event network-vif-unplugged-d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:43:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-90efe147-4049-4727-923e-d538dc3ed039 req-c7b6d271-26bb-4d51-80c9-6d7cc285345c service nova] Acquiring lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:43:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-90efe147-4049-4727-923e-d538dc3ed039 req-c7b6d271-26bb-4d51-80c9-6d7cc285345c service nova] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:43:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-90efe147-4049-4727-923e-d538dc3ed039 req-c7b6d271-26bb-4d51-80c9-6d7cc285345c service nova] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:43:55 user nova-compute[74189]: DEBUG nova.compute.manager [req-90efe147-4049-4727-923e-d538dc3ed039 req-c7b6d271-26bb-4d51-80c9-6d7cc285345c service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] No waiting events found dispatching network-vif-unplugged-d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:43:55 user nova-compute[74189]: WARNING nova.compute.manager [req-90efe147-4049-4727-923e-d538dc3ed039 req-c7b6d271-26bb-4d51-80c9-6d7cc285345c service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Received unexpected event network-vif-unplugged-d8084804-8e6e-4787-b331-96822b5ed349 for instance with vm_state rescued and task_state unrescuing.
Oct 25 21:43:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:56 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Instance destroyed successfully.
Oct 25 21:43:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-af03966d-2869-4891-a5b2-066f35c0764f req-c1d01b0f-62c2-451f-8c48-968bf117254e service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Received event network-vif-plugged-d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:43:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-af03966d-2869-4891-a5b2-066f35c0764f req-c1d01b0f-62c2-451f-8c48-968bf117254e service nova] Acquiring lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:43:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-af03966d-2869-4891-a5b2-066f35c0764f req-c1d01b0f-62c2-451f-8c48-968bf117254e service nova] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:43:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-af03966d-2869-4891-a5b2-066f35c0764f req-c1d01b0f-62c2-451f-8c48-968bf117254e service nova] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:43:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-af03966d-2869-4891-a5b2-066f35c0764f req-c1d01b0f-62c2-451f-8c48-968bf117254e service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] No waiting events found dispatching network-vif-plugged-d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:43:57 user nova-compute[74189]: WARNING nova.compute.manager [req-af03966d-2869-4891-a5b2-066f35c0764f req-c1d01b0f-62c2-451f-8c48-968bf117254e service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Received unexpected event network-vif-plugged-d8084804-8e6e-4787-b331-96822b5ed349 for instance with vm_state rescued and task_state unrescuing.
Oct 25 21:43:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:43:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-65ae8e58-c0a4-44cc-8fb6-dabfdc2247db req-26b11b3b-867b-4edc-a39b-68c6520ca877 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Received event network-vif-plugged-d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:43:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-65ae8e58-c0a4-44cc-8fb6-dabfdc2247db req-26b11b3b-867b-4edc-a39b-68c6520ca877 service nova] Acquiring lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:43:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-65ae8e58-c0a4-44cc-8fb6-dabfdc2247db req-26b11b3b-867b-4edc-a39b-68c6520ca877 service nova] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:43:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-65ae8e58-c0a4-44cc-8fb6-dabfdc2247db req-26b11b3b-867b-4edc-a39b-68c6520ca877 service nova] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:43:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-65ae8e58-c0a4-44cc-8fb6-dabfdc2247db req-26b11b3b-867b-4edc-a39b-68c6520ca877 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] No waiting events found dispatching network-vif-plugged-d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:43:59 user nova-compute[74189]: WARNING nova.compute.manager [req-65ae8e58-c0a4-44cc-8fb6-dabfdc2247db req-26b11b3b-867b-4edc-a39b-68c6520ca877 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Received unexpected event network-vif-plugged-d8084804-8e6e-4787-b331-96822b5ed349 for instance with vm_state rescued and task_state unrescuing.
Oct 25 21:43:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-65ae8e58-c0a4-44cc-8fb6-dabfdc2247db req-26b11b3b-867b-4edc-a39b-68c6520ca877 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Received event network-vif-plugged-d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:43:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-65ae8e58-c0a4-44cc-8fb6-dabfdc2247db req-26b11b3b-867b-4edc-a39b-68c6520ca877 service nova] Acquiring lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:43:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-65ae8e58-c0a4-44cc-8fb6-dabfdc2247db req-26b11b3b-867b-4edc-a39b-68c6520ca877 service nova] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:43:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-65ae8e58-c0a4-44cc-8fb6-dabfdc2247db req-26b11b3b-867b-4edc-a39b-68c6520ca877 service nova] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:43:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-65ae8e58-c0a4-44cc-8fb6-dabfdc2247db req-26b11b3b-867b-4edc-a39b-68c6520ca877 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] No waiting events found dispatching network-vif-plugged-d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:43:59 user nova-compute[74189]: WARNING nova.compute.manager [req-65ae8e58-c0a4-44cc-8fb6-dabfdc2247db req-26b11b3b-867b-4edc-a39b-68c6520ca877 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Received unexpected event network-vif-plugged-d8084804-8e6e-4787-b331-96822b5ed349 for instance with vm_state rescued and task_state unrescuing.
Oct 25 21:44:00 user nova-compute[74189]: DEBUG nova.compute.manager [None req-30fe4693-7da0-4072-98c6-79f4fe3e3aeb tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:44:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Acquiring lock "fff8f286-0baa-4865-994f-4418af3edd0a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:44:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "fff8f286-0baa-4865-994f-4418af3edd0a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:44:05 user nova-compute[74189]: DEBUG nova.objects.instance [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lazy-loading 'flavor' on Instance uuid fff8f286-0baa-4865-994f-4418af3edd0a {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:44:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "fff8f286-0baa-4865-994f-4418af3edd0a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:44:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Acquiring lock "fff8f286-0baa-4865-994f-4418af3edd0a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:44:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "fff8f286-0baa-4865-994f-4418af3edd0a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:44:06 user nova-compute[74189]: INFO nova.compute.manager [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Attaching volume 4daf3b61-e1fd-449f-a934-b0eca49fd77a to /dev/vdb
Oct 25 21:44:06 user nova-compute[74189]: DEBUG os_brick.utils [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:44:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:06 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae93ab0-952b-442b-a728-424105b6c1c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:44:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:06 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07cac58-0794-4123-aeb1-42f35c7cc5e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:44:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:06 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[be491c28-7e42-4fd8-a5be-cd60ea2e47f9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:44:06 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9d8df3-160c-45b2-bb15-d23426a9d427]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:44:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:44:06 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:44:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:06 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:44:06 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:44:06 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de17af1-788d-4450-994f-e5219b13233c]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:44:06 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:44:06 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:44:06 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:44:06 user nova-compute[74189]: DEBUG os_brick.utils [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:44:06 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Updating existing volume attachment record: feb50e37-61c0-4905-bead-11afa42af502 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:44:09 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:09 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:14 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:44:14 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:44:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-915a1d25-6499-4d3e-9edd-5f3cfd487bac" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:44:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-915a1d25-6499-4d3e-9edd-5f3cfd487bac" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:44:14 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:44:15 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Updating instance_info_cache with network_info: [{"id": "d8084804-8e6e-4787-b331-96822b5ed349", "address": "fa:16:3e:1c:bf:ba", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8084804-8e", "ovs_interfaceid": "d8084804-8e6e-4787-b331-96822b5ed349", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:44:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-915a1d25-6499-4d3e-9edd-5f3cfd487bac" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:44:15 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:44:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-759e4f09-29f7-4d26-af17-8fa0750eb900 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Acquiring lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:44:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-759e4f09-29f7-4d26-af17-8fa0750eb900 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:44:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-759e4f09-29f7-4d26-af17-8fa0750eb900 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Acquiring lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:44:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-759e4f09-29f7-4d26-af17-8fa0750eb900 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:44:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-759e4f09-29f7-4d26-af17-8fa0750eb900 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:44:16 user nova-compute[74189]: INFO nova.compute.manager [None req-759e4f09-29f7-4d26-af17-8fa0750eb900 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Terminating instance
Oct 25 21:44:16 user nova-compute[74189]: DEBUG nova.compute.manager [None req-759e4f09-29f7-4d26-af17-8fa0750eb900 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:44:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:16 user nova-compute[74189]: DEBUG nova.compute.manager [req-3ef3fa48-5f4f-4cd6-be56-01f62d776a6a req-658868d8-0121-4fbe-848a-c63d84588d6c service nova] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Received event network-vif-unplugged-af0547c4-bcad-40cb-9183-e3fd84c1c8fb {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:44:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3ef3fa48-5f4f-4cd6-be56-01f62d776a6a req-658868d8-0121-4fbe-848a-c63d84588d6c service nova] Acquiring lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:44:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3ef3fa48-5f4f-4cd6-be56-01f62d776a6a req-658868d8-0121-4fbe-848a-c63d84588d6c service nova] Lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:44:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3ef3fa48-5f4f-4cd6-be56-01f62d776a6a req-658868d8-0121-4fbe-848a-c63d84588d6c service nova] Lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:44:16 user nova-compute[74189]: DEBUG nova.compute.manager [req-3ef3fa48-5f4f-4cd6-be56-01f62d776a6a req-658868d8-0121-4fbe-848a-c63d84588d6c service nova] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] No waiting events found dispatching network-vif-unplugged-af0547c4-bcad-40cb-9183-e3fd84c1c8fb {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:44:16 user nova-compute[74189]: DEBUG nova.compute.manager [req-3ef3fa48-5f4f-4cd6-be56-01f62d776a6a req-658868d8-0121-4fbe-848a-c63d84588d6c service nova] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Received event network-vif-unplugged-af0547c4-bcad-40cb-9183-e3fd84c1c8fb for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:44:17 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Instance destroyed successfully.
Oct 25 21:44:17 user nova-compute[74189]: DEBUG nova.objects.instance [None req-759e4f09-29f7-4d26-af17-8fa0750eb900 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lazy-loading 'resources' on Instance uuid aa2b9013-4a8b-4f8d-a5dc-42842cd987a7 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:44:17 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-759e4f09-29f7-4d26-af17-8fa0750eb900 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:39:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1924991693',display_name='tempest-TestServerVolumeAttachmentScenario-server-1924991693',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1924991693',id=42,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJzy3QIcz8k3OVVIWxk7bFwWXBb8/E2yS9Xnh6AxVBze0e54/ByCoah9dg99Lso7vVuwyC2sd5GDnIv0CbCcQPalhmgtkQGD/cYZz84EY1lkZcZN0/eulifAfNtvBLgzZA==',key_name='tempest-keypair-1564393999',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:39:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3fd14dac60ad462fbaafc984745a06df',ramdisk_id='',reservation_id='r-u1brobqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-661451565',owner_user_name='tempest-TestServerVolumeAttachmentScenario-661451565-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:39:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d969f9eb4da9460bac75c7c54c3d27d9',uuid=aa2b9013-4a8b-4f8d-a5dc-42842cd987a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af0547c4-bcad-40cb-9183-e3fd84c1c8fb", "address": "fa:16:3e:17:71:69", "network": {"id": "351bf1c4-8784-41c0-8b68-a939f493bc5a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1840723104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fd14dac60ad462fbaafc984745a06df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0547c4-bc", "ovs_interfaceid": "af0547c4-bcad-40cb-9183-e3fd84c1c8fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:44:17 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-759e4f09-29f7-4d26-af17-8fa0750eb900 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Converting VIF {"id": "af0547c4-bcad-40cb-9183-e3fd84c1c8fb", "address": "fa:16:3e:17:71:69", "network": {"id": "351bf1c4-8784-41c0-8b68-a939f493bc5a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1840723104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fd14dac60ad462fbaafc984745a06df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0547c4-bc", "ovs_interfaceid": "af0547c4-bcad-40cb-9183-e3fd84c1c8fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:44:17 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-759e4f09-29f7-4d26-af17-8fa0750eb900 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:71:69,bridge_name='br-int',has_traffic_filtering=True,id=af0547c4-bcad-40cb-9183-e3fd84c1c8fb,network=Network(351bf1c4-8784-41c0-8b68-a939f493bc5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf0547c4-bc') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:44:17 user nova-compute[74189]: DEBUG os_vif [None req-759e4f09-29f7-4d26-af17-8fa0750eb900 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:71:69,bridge_name='br-int',has_traffic_filtering=True,id=af0547c4-bcad-40cb-9183-e3fd84c1c8fb,network=Network(351bf1c4-8784-41c0-8b68-a939f493bc5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf0547c4-bc') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:44:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf0547c4-bc, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:44:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:44:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ee31ddc-95d1-4cd4-8294-8e33c624eb1f) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:44:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:44:17 user nova-compute[74189]: INFO os_vif [None req-759e4f09-29f7-4d26-af17-8fa0750eb900 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:71:69,bridge_name='br-int',has_traffic_filtering=True,id=af0547c4-bcad-40cb-9183-e3fd84c1c8fb,network=Network(351bf1c4-8784-41c0-8b68-a939f493bc5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf0547c4-bc')
Oct 25 21:44:17 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-759e4f09-29f7-4d26-af17-8fa0750eb900 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Deleting instance files /opt/stack/data/nova/instances/aa2b9013-4a8b-4f8d-a5dc-42842cd987a7_del
Oct 25 21:44:17 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-759e4f09-29f7-4d26-af17-8fa0750eb900 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Deletion of /opt/stack/data/nova/instances/aa2b9013-4a8b-4f8d-a5dc-42842cd987a7_del complete
Oct 25 21:44:17 user nova-compute[74189]: INFO nova.compute.manager [None req-759e4f09-29f7-4d26-af17-8fa0750eb900 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 25 21:44:17 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-759e4f09-29f7-4d26-af17-8fa0750eb900 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:44:17 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:44:17 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:44:18 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:44:18 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Took 0.91 seconds to deallocate network for instance.
Oct 25 21:44:18 user nova-compute[74189]: DEBUG nova.compute.manager [req-5ee73468-bad6-48a8-b395-83ba73054714 req-4afd4d13-06f1-403e-aaa4-1e404b07cb39 service nova] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Received event network-vif-deleted-af0547c4-bcad-40cb-9183-e3fd84c1c8fb {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:44:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-759e4f09-29f7-4d26-af17-8fa0750eb900 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:44:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-759e4f09-29f7-4d26-af17-8fa0750eb900 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:44:18 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-759e4f09-29f7-4d26-af17-8fa0750eb900 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:44:18 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-759e4f09-29f7-4d26-af17-8fa0750eb900 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:44:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-759e4f09-29f7-4d26-af17-8fa0750eb900 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:44:18 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-759e4f09-29f7-4d26-af17-8fa0750eb900 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Deleted allocations for instance aa2b9013-4a8b-4f8d-a5dc-42842cd987a7
Oct 25 21:44:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-759e4f09-29f7-4d26-af17-8fa0750eb900 tempest-TestServerVolumeAttachmentScenario-661451565 tempest-TestServerVolumeAttachmentScenario-661451565-project-member] Lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.307s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:44:18 user nova-compute[74189]: DEBUG nova.compute.manager [req-d2c4f19a-4d61-492a-b24d-a8c4496fb1da req-23b5614a-5260-4b48-a357-57b9d3fee9fe service nova] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Received event network-vif-plugged-af0547c4-bcad-40cb-9183-e3fd84c1c8fb {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:44:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d2c4f19a-4d61-492a-b24d-a8c4496fb1da req-23b5614a-5260-4b48-a357-57b9d3fee9fe service nova] Acquiring lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:44:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d2c4f19a-4d61-492a-b24d-a8c4496fb1da req-23b5614a-5260-4b48-a357-57b9d3fee9fe service nova] Lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:44:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d2c4f19a-4d61-492a-b24d-a8c4496fb1da req-23b5614a-5260-4b48-a357-57b9d3fee9fe service nova] Lock "aa2b9013-4a8b-4f8d-a5dc-42842cd987a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:44:18 user nova-compute[74189]: DEBUG nova.compute.manager [req-d2c4f19a-4d61-492a-b24d-a8c4496fb1da req-23b5614a-5260-4b48-a357-57b9d3fee9fe service nova] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] No waiting events found dispatching network-vif-plugged-af0547c4-bcad-40cb-9183-e3fd84c1c8fb {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:44:18 user nova-compute[74189]: WARNING nova.compute.manager [req-d2c4f19a-4d61-492a-b24d-a8c4496fb1da req-23b5614a-5260-4b48-a357-57b9d3fee9fe service nova] [instance: aa2b9013-4a8b-4f8d-a5dc-42842cd987a7] Received unexpected event network-vif-plugged-af0547c4-bcad-40cb-9183-e3fd84c1c8fb for instance with vm_state deleted and task_state None.
Oct 25 21:44:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:19 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:44:19 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:44:21 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:44:21 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:44:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:44:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:44:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:44:21 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:44:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38919a8d-2c62-4d4d-83e2-97b69409155d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38919a8d-2c62-4d4d-83e2-97b69409155d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38919a8d-2c62-4d4d-83e2-97b69409155d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38919a8d-2c62-4d4d-83e2-97b69409155d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:44:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:24 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:44:24 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:44:24 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=8136MB free_disk=24.973007202148438GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:44:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:44:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:44:24 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:44:24 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3da14c0a-31a8-4fe3-bd5a-49378680af50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:44:24 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 915a1d25-6499-4d3e-9edd-5f3cfd487bac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:44:24 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance fff8f286-0baa-4865-994f-4418af3edd0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:44:24 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 38919a8d-2c62-4d4d-83e2-97b69409155d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:44:24 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:44:24 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tcDGXrUv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:44:25 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:44:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:44:25 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:44:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:44:25 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:44:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3d2923-1164-4c90-ab0b-6123ace971ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:44:25 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b08769b-f131-4071-b414-771c0e5fc8f1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a] added
Oct 25 21:44:25 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dc49c6-92a3-457c-9e87-cd7730d0b213]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ee92f1-60e2-4965-9c6c-c24749ac041c]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tcDGXrUv {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tcDGXrUv" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4155960-e0d6-4a50-b9fe-ba1da8951c3f]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tcDGXrUv'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[199e9963-f3be-4da0-8ee5-0e8f8d6c7ab4]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f92211-fc74-498e-9e89-de05884b4d73]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:44:25 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:44:25 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.381s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19f3cdc-96a8-42b6-acd0-47144107a4e4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a, portal: 172.16.0.220,3260]
Oct 25 21:44:25 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a, portal: 172.16.0.220,3260] successful.
Oct 25 21:44:25 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[59748e9e-3223-4a19-9964-6e9ea3e91675]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d84e74-0cf6-4ea2-bff3-b9976e2c8abb]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:44:25 user nova-compute[74189]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a (non-flash)
Oct 25 21:44:25 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:44:25 user nova-compute[74189]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a (non-flash)
Oct 25 21:44:25 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8638dff9-18cc-4fe8-8153-74973516a8b0]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:44:25 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tcDGXrUv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:44:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:44:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23037663664356434', 'path': '/dev/sdb'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:44:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037663664356434', 'path': '/dev/sdb'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:44:26 user nova-compute[74189]: DEBUG nova.objects.instance [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lazy-loading 'flavor' on Instance uuid fff8f286-0baa-4865-994f-4418af3edd0a {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:44:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 21:44:26 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:44:26 user nova-compute[74189]:   <source dev="/dev/sdb"/>
Oct 25 21:44:26 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:44:26 user nova-compute[74189]:   <serial>4daf3b61-e1fd-449f-a934-b0eca49fd77a</serial>
Oct 25 21:44:26 user nova-compute[74189]: </disk>
Oct 25 21:44:26 user nova-compute[74189]:  {{(pid=74189) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 21:44:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:44:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:44:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] No VIF found with MAC fa:16:3e:b8:cf:38, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:44:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-dc513638-cb00-4f5f-abad-582def3a9b24 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "fff8f286-0baa-4865-994f-4418af3edd0a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.892s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:44:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:28 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:44:28 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:44:28 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:44:28 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:44:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Acquiring lock "fff8f286-0baa-4865-994f-4418af3edd0a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:44:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "fff8f286-0baa-4865-994f-4418af3edd0a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:44:29 user nova-compute[74189]: INFO nova.compute.manager [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Detaching volume 4daf3b61-e1fd-449f-a934-b0eca49fd77a
Oct 25 21:44:29 user nova-compute[74189]: INFO nova.virt.block_device [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Attempting to driver detach volume 4daf3b61-e1fd-449f-a934-b0eca49fd77a from mountpoint /dev/vdb
Oct 25 21:44:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Attempting to detach device vdb from instance fff8f286-0baa-4865-994f-4418af3edd0a from the persistent domain config. {{(pid=74189) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 21:44:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:44:29 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:44:29 user nova-compute[74189]:   <source dev="/dev/sdb"/>
Oct 25 21:44:29 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:44:29 user nova-compute[74189]:   <serial>4daf3b61-e1fd-449f-a934-b0eca49fd77a</serial>
Oct 25 21:44:29 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:44:29 user nova-compute[74189]: </disk>
Oct 25 21:44:29 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:44:29 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Successfully detached device vdb from instance fff8f286-0baa-4865-994f-4418af3edd0a from the persistent domain config.
Oct 25 21:44:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fff8f286-0baa-4865-994f-4418af3edd0a from the live domain config. {{(pid=74189) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 21:44:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:44:29 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:44:29 user nova-compute[74189]:   <source dev="/dev/sdb"/>
Oct 25 21:44:29 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:44:29 user nova-compute[74189]:   <serial>4daf3b61-e1fd-449f-a934-b0eca49fd77a</serial>
Oct 25 21:44:29 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:44:29 user nova-compute[74189]: </disk>
Oct 25 21:44:29 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:44:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fff8f286-0baa-4865-994f-4418af3edd0a {{(pid=74189) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 21:44:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Acquiring lock "14e9c813-2486-4840-b18c-65ca237a8ebf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:44:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "14e9c813-2486-4840-b18c-65ca237a8ebf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:44:32 user nova-compute[74189]: DEBUG nova.compute.manager [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:44:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:44:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:44:32 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:44:32 user nova-compute[74189]: INFO nova.compute.claims [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Claim successful on node user
Oct 25 21:44:32 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:44:32 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:44:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.319s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:44:32 user nova-compute[74189]: DEBUG nova.compute.manager [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:44:32 user nova-compute[74189]: DEBUG nova.compute.manager [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:44:32 user nova-compute[74189]: DEBUG nova.network.neutron [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:44:32 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:44:32 user nova-compute[74189]: DEBUG nova.compute.manager [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:44:32 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:44:32 user nova-compute[74189]: DEBUG nova.policy [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2bcb3eebd1e04f0b978238f4eeeec2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1b56c6086e4a41bf9a98b96101531e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:44:32 user nova-compute[74189]: DEBUG nova.compute.manager [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:44:32 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:44:32 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Creating image(s)
Oct 25 21:44:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Acquiring lock "/opt/stack/data/nova/instances/14e9c813-2486-4840-b18c-65ca237a8ebf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:44:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "/opt/stack/data/nova/instances/14e9c813-2486-4840-b18c-65ca237a8ebf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:44:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "/opt/stack/data/nova/instances/14e9c813-2486-4840-b18c-65ca237a8ebf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:44:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.178s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:44:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:44:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.192s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/14e9c813-2486-4840-b18c-65ca237a8ebf/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/14e9c813-2486-4840-b18c-65ca237a8ebf/disk 1073741824" returned: 0 in 0.056s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:44:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:33 user nova-compute[74189]: DEBUG nova.network.neutron [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Successfully created port: e9e74d39-f7ae-498a-932c-65c2639a3efe {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:44:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.173s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:33 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Checking if we can resize image /opt/stack/data/nova/instances/14e9c813-2486-4840-b18c-65ca237a8ebf/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:44:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e9c813-2486-4840-b18c-65ca237a8ebf/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e9c813-2486-4840-b18c-65ca237a8ebf/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:33 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Cannot resize image /opt/stack/data/nova/instances/14e9c813-2486-4840-b18c-65ca237a8ebf/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:44:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:44:33 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Ensure instance console log exists: /opt/stack/data/nova/instances/14e9c813-2486-4840-b18c-65ca237a8ebf/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:44:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:44:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:44:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:44:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:34 user nova-compute[74189]: DEBUG nova.network.neutron [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Successfully updated port: e9e74d39-f7ae-498a-932c-65c2639a3efe {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:44:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Acquiring lock "refresh_cache-14e9c813-2486-4840-b18c-65ca237a8ebf" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:44:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Acquired lock "refresh_cache-14e9c813-2486-4840-b18c-65ca237a8ebf" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:44:34 user nova-compute[74189]: DEBUG nova.network.neutron [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:44:34 user nova-compute[74189]: DEBUG nova.compute.manager [req-403659f2-b772-47ae-942c-35225ff5d06e req-863a8e71-d9e6-4dff-b7bf-fcdba8e4aa77 service nova] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Received event network-changed-e9e74d39-f7ae-498a-932c-65c2639a3efe {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:44:34 user nova-compute[74189]: DEBUG nova.compute.manager [req-403659f2-b772-47ae-942c-35225ff5d06e req-863a8e71-d9e6-4dff-b7bf-fcdba8e4aa77 service nova] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Refreshing instance network info cache due to event network-changed-e9e74d39-f7ae-498a-932c-65c2639a3efe. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:44:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-403659f2-b772-47ae-942c-35225ff5d06e req-863a8e71-d9e6-4dff-b7bf-fcdba8e4aa77 service nova] Acquiring lock "refresh_cache-14e9c813-2486-4840-b18c-65ca237a8ebf" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:44:34 user nova-compute[74189]: DEBUG nova.network.neutron [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.network.neutron [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Updating instance_info_cache with network_info: [{"id": "e9e74d39-f7ae-498a-932c-65c2639a3efe", "address": "fa:16:3e:6a:f3:d2", "network": {"id": "27a00d33-61db-45a8-a945-cd8514be6344", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1691303850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff1b56c6086e4a41bf9a98b96101531e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e74d39-f7", "ovs_interfaceid": "e9e74d39-f7ae-498a-932c-65c2639a3efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Releasing lock "refresh_cache-14e9c813-2486-4840-b18c-65ca237a8ebf" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.compute.manager [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Instance network_info: |[{"id": "e9e74d39-f7ae-498a-932c-65c2639a3efe", "address": "fa:16:3e:6a:f3:d2", "network": {"id": "27a00d33-61db-45a8-a945-cd8514be6344", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1691303850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff1b56c6086e4a41bf9a98b96101531e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e74d39-f7", "ovs_interfaceid": "e9e74d39-f7ae-498a-932c-65c2639a3efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-403659f2-b772-47ae-942c-35225ff5d06e req-863a8e71-d9e6-4dff-b7bf-fcdba8e4aa77 service nova] Acquired lock "refresh_cache-14e9c813-2486-4840-b18c-65ca237a8ebf" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.network.neutron [req-403659f2-b772-47ae-942c-35225ff5d06e req-863a8e71-d9e6-4dff-b7bf-fcdba8e4aa77 service nova] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Refreshing network info cache for port e9e74d39-f7ae-498a-932c-65c2639a3efe {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Start _get_guest_xml network_info=[{"id": "e9e74d39-f7ae-498a-932c-65c2639a3efe", "address": "fa:16:3e:6a:f3:d2", "network": {"id": "27a00d33-61db-45a8-a945-cd8514be6344", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1691303850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff1b56c6086e4a41bf9a98b96101531e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e74d39-f7", "ovs_interfaceid": "e9e74d39-f7ae-498a-932c-65c2639a3efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:44:35 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:44:35 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:44:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-927101518',display_name='tempest-VolumesSnapshotTestJSON-instance-927101518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-927101518',id=47,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvLozy56V7NoN54maH8tEM07IYGPsiXZ+3W72iTT4Lw3qaA1tPfPonSePZ5GraD33OOK3FEgGEwNEcge8a1Im6Jo9rVFDEOkZ5u2p9y/myjN40F6YKsTZor2bIYYU46hg==',key_name='tempest-keypair-1094911281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff1b56c6086e4a41bf9a98b96101531e',ramdisk_id='',reservation_id='r-6ei9oiv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1589464160',owner_user_name='tempest-VolumesSnapshotTestJSON-1589464160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:44:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bcb3eebd1e04f0b978238f4eeeec2de',uuid=14e9c813-2486-4840-b18c-65ca237a8ebf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9e74d39-f7ae-498a-932c-65c2639a3efe", "address": "fa:16:3e:6a:f3:d2", "network": {"id": "27a00d33-61db-45a8-a945-cd8514be6344", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1691303850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff1b56c6086e4a41bf9a98b96101531e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e74d39-f7", "ovs_interfaceid": "e9e74d39-f7ae-498a-932c-65c2639a3efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Converting VIF {"id": "e9e74d39-f7ae-498a-932c-65c2639a3efe", "address": "fa:16:3e:6a:f3:d2", "network": {"id": "27a00d33-61db-45a8-a945-cd8514be6344", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1691303850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff1b56c6086e4a41bf9a98b96101531e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e74d39-f7", "ovs_interfaceid": "e9e74d39-f7ae-498a-932c-65c2639a3efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:f3:d2,bridge_name='br-int',has_traffic_filtering=True,id=e9e74d39-f7ae-498a-932c-65c2639a3efe,network=Network(27a00d33-61db-45a8-a945-cd8514be6344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9e74d39-f7') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.objects.instance [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lazy-loading 'pci_devices' on Instance uuid 14e9c813-2486-4840-b18c-65ca237a8ebf {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Acquiring lock "0b5d04c5-dfae-42de-84b9-2fab02e3d679" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "0b5d04c5-dfae-42de-84b9-2fab02e3d679" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:44:35 user nova-compute[74189]:   <uuid>14e9c813-2486-4840-b18c-65ca237a8ebf</uuid>
Oct 25 21:44:35 user nova-compute[74189]:   <name>instance-0000002f</name>
Oct 25 21:44:35 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:44:35 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:44:35 user nova-compute[74189]:   <metadata>
Oct 25 21:44:35 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:44:35 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:44:35 user nova-compute[74189]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-927101518</nova:name>
Oct 25 21:44:35 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:44:35</nova:creationTime>
Oct 25 21:44:35 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:44:35 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:44:35 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:44:35 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:44:35 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:44:35 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:44:35 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:44:35 user nova-compute[74189]:       <nova:owner>
Oct 25 21:44:35 user nova-compute[74189]:         <nova:user uuid="2bcb3eebd1e04f0b978238f4eeeec2de">tempest-VolumesSnapshotTestJSON-1589464160-project-member</nova:user>
Oct 25 21:44:35 user nova-compute[74189]:         <nova:project uuid="ff1b56c6086e4a41bf9a98b96101531e">tempest-VolumesSnapshotTestJSON-1589464160</nova:project>
Oct 25 21:44:35 user nova-compute[74189]:       </nova:owner>
Oct 25 21:44:35 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:44:35 user nova-compute[74189]:       <nova:ports>
Oct 25 21:44:35 user nova-compute[74189]:         <nova:port uuid="e9e74d39-f7ae-498a-932c-65c2639a3efe">
Oct 25 21:44:35 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 25 21:44:35 user nova-compute[74189]:         </nova:port>
Oct 25 21:44:35 user nova-compute[74189]:       </nova:ports>
Oct 25 21:44:35 user nova-compute[74189]:     </nova:instance>
Oct 25 21:44:35 user nova-compute[74189]:   </metadata>
Oct 25 21:44:35 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:44:35 user nova-compute[74189]:     <system>
Oct 25 21:44:35 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:44:35 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:44:35 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:44:35 user nova-compute[74189]:       <entry name="serial">14e9c813-2486-4840-b18c-65ca237a8ebf</entry>
Oct 25 21:44:35 user nova-compute[74189]:       <entry name="uuid">14e9c813-2486-4840-b18c-65ca237a8ebf</entry>
Oct 25 21:44:35 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:44:35 user nova-compute[74189]:     </system>
Oct 25 21:44:35 user nova-compute[74189]:   </sysinfo>
Oct 25 21:44:35 user nova-compute[74189]:   <os>
Oct 25 21:44:35 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:44:35 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:44:35 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:44:35 user nova-compute[74189]:   </os>
Oct 25 21:44:35 user nova-compute[74189]:   <features>
Oct 25 21:44:35 user nova-compute[74189]:     <acpi/>
Oct 25 21:44:35 user nova-compute[74189]:     <apic/>
Oct 25 21:44:35 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:44:35 user nova-compute[74189]:   </features>
Oct 25 21:44:35 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:44:35 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:44:35 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:44:35 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:44:35 user nova-compute[74189]:   </clock>
Oct 25 21:44:35 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:44:35 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:44:35 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:44:35 user nova-compute[74189]:   </cpu>
Oct 25 21:44:35 user nova-compute[74189]:   <devices>
Oct 25 21:44:35 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:44:35 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:44:35 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/14e9c813-2486-4840-b18c-65ca237a8ebf/disk"/>
Oct 25 21:44:35 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:44:35 user nova-compute[74189]:     </disk>
Oct 25 21:44:35 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:44:35 user nova-compute[74189]:       <mac address="fa:16:3e:6a:f3:d2"/>
Oct 25 21:44:35 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:44:35 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:44:35 user nova-compute[74189]:       <target dev="tape9e74d39-f7"/>
Oct 25 21:44:35 user nova-compute[74189]:     </interface>
Oct 25 21:44:35 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:44:35 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/14e9c813-2486-4840-b18c-65ca237a8ebf/console.log" append="off"/>
Oct 25 21:44:35 user nova-compute[74189]:     </serial>
Oct 25 21:44:35 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:44:35 user nova-compute[74189]:     <video>
Oct 25 21:44:35 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:44:35 user nova-compute[74189]:     </video>
Oct 25 21:44:35 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:44:35 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:44:35 user nova-compute[74189]:     </rng>
Oct 25 21:44:35 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:44:35 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:44:35 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:44:35 user nova-compute[74189]:     </memballoon>
Oct 25 21:44:35 user nova-compute[74189]:   </devices>
Oct 25 21:44:35 user nova-compute[74189]: </domain>
Oct 25 21:44:35 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:44:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-927101518',display_name='tempest-VolumesSnapshotTestJSON-instance-927101518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-927101518',id=47,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvLozy56V7NoN54maH8tEM07IYGPsiXZ+3W72iTT4Lw3qaA1tPfPonSePZ5GraD33OOK3FEgGEwNEcge8a1Im6Jo9rVFDEOkZ5u2p9y/myjN40F6YKsTZor2bIYYU46hg==',key_name='tempest-keypair-1094911281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff1b56c6086e4a41bf9a98b96101531e',ramdisk_id='',reservation_id='r-6ei9oiv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1589464160',owner_user_name='tempest-VolumesSnapshotTestJSON-1589464160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:44:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bcb3eebd1e04f0b978238f4eeeec2de',uuid=14e9c813-2486-4840-b18c-65ca237a8ebf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9e74d39-f7ae-498a-932c-65c2639a3efe", "address": "fa:16:3e:6a:f3:d2", "network": {"id": "27a00d33-61db-45a8-a945-cd8514be6344", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1691303850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff1b56c6086e4a41bf9a98b96101531e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e74d39-f7", "ovs_interfaceid": "e9e74d39-f7ae-498a-932c-65c2639a3efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Converting VIF {"id": "e9e74d39-f7ae-498a-932c-65c2639a3efe", "address": "fa:16:3e:6a:f3:d2", "network": {"id": "27a00d33-61db-45a8-a945-cd8514be6344", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1691303850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff1b56c6086e4a41bf9a98b96101531e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e74d39-f7", "ovs_interfaceid": "e9e74d39-f7ae-498a-932c-65c2639a3efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:f3:d2,bridge_name='br-int',has_traffic_filtering=True,id=e9e74d39-f7ae-498a-932c-65c2639a3efe,network=Network(27a00d33-61db-45a8-a945-cd8514be6344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9e74d39-f7') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG os_vif [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:f3:d2,bridge_name='br-int',has_traffic_filtering=True,id=e9e74d39-f7ae-498a-932c-65c2639a3efe,network=Network(27a00d33-61db-45a8-a945-cd8514be6344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9e74d39-f7') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a0583e3-a7b6-5ad0-84f2-fb2ec7b48279', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.compute.manager [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9e74d39-f7, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape9e74d39-f7, col_values=(('qos', UUID('66613e6d-cca5-4f8d-a7c8-b29306009c2f')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape9e74d39-f7, col_values=(('external_ids', {'iface-id': 'e9e74d39-f7ae-498a-932c-65c2639a3efe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:f3:d2', 'vm-uuid': '14e9c813-2486-4840-b18c-65ca237a8ebf'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:35 user nova-compute[74189]: INFO os_vif [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:f3:d2,bridge_name='br-int',has_traffic_filtering=True,id=e9e74d39-f7ae-498a-932c-65c2639a3efe,network=Network(27a00d33-61db-45a8-a945-cd8514be6344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9e74d39-f7')
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] No VIF found with MAC fa:16:3e:6a:f3:d2, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:44:35 user nova-compute[74189]: INFO nova.compute.claims [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Claim successful on node user
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.network.neutron [req-403659f2-b772-47ae-942c-35225ff5d06e req-863a8e71-d9e6-4dff-b7bf-fcdba8e4aa77 service nova] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Updated VIF entry in instance network info cache for port e9e74d39-f7ae-498a-932c-65c2639a3efe. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.network.neutron [req-403659f2-b772-47ae-942c-35225ff5d06e req-863a8e71-d9e6-4dff-b7bf-fcdba8e4aa77 service nova] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Updating instance_info_cache with network_info: [{"id": "e9e74d39-f7ae-498a-932c-65c2639a3efe", "address": "fa:16:3e:6a:f3:d2", "network": {"id": "27a00d33-61db-45a8-a945-cd8514be6344", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1691303850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff1b56c6086e4a41bf9a98b96101531e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e74d39-f7", "ovs_interfaceid": "e9e74d39-f7ae-498a-932c-65c2639a3efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-403659f2-b772-47ae-942c-35225ff5d06e req-863a8e71-d9e6-4dff-b7bf-fcdba8e4aa77 service nova] Releasing lock "refresh_cache-14e9c813-2486-4840-b18c-65ca237a8ebf" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.compute.manager [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.compute.manager [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.network.neutron [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:44:35 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.compute.manager [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.policy [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ea97d3b6a27a4b569c04e26aa6043289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6a19ad6e8249abbe10137bdad65ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.compute.manager [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:44:35 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Creating image(s)
Oct 25 21:44:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Acquiring lock "/opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "/opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "/opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:44:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.189s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:44:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:44:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.175s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk 1073741824" returned: 0 in 0.060s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:44:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.208s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:36 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:44:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:36 user nova-compute[74189]: DEBUG nova.network.neutron [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Successfully created port: e05cb4c8-e712-4628-9d3d-a72653f19860 {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:44:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:36 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Cannot resize image /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:44:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:44:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Ensure instance console log exists: /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:44:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:44:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:44:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.network.neutron [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Successfully updated port: e05cb4c8-e712-4628-9d3d-a72653f19860 {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Acquiring lock "refresh_cache-0b5d04c5-dfae-42de-84b9-2fab02e3d679" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Acquired lock "refresh_cache-0b5d04c5-dfae-42de-84b9-2fab02e3d679" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.network.neutron [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.compute.manager [req-ffac9c48-2b14-488f-bafe-94a532726e54 req-d901831f-f963-4a3c-8515-3ed411f7c4ff service nova] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Received event network-changed-e05cb4c8-e712-4628-9d3d-a72653f19860 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.compute.manager [req-ffac9c48-2b14-488f-bafe-94a532726e54 req-d901831f-f963-4a3c-8515-3ed411f7c4ff service nova] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Refreshing instance network info cache due to event network-changed-e05cb4c8-e712-4628-9d3d-a72653f19860. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ffac9c48-2b14-488f-bafe-94a532726e54 req-d901831f-f963-4a3c-8515-3ed411f7c4ff service nova] Acquiring lock "refresh_cache-0b5d04c5-dfae-42de-84b9-2fab02e3d679" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.network.neutron [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.compute.manager [req-7916f081-f9ad-42cb-ab0d-649525192347 req-c8bb8d34-ecc9-4e71-ae93-060030bff1a0 service nova] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Received event network-vif-plugged-e9e74d39-f7ae-498a-932c-65c2639a3efe {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7916f081-f9ad-42cb-ab0d-649525192347 req-c8bb8d34-ecc9-4e71-ae93-060030bff1a0 service nova] Acquiring lock "14e9c813-2486-4840-b18c-65ca237a8ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7916f081-f9ad-42cb-ab0d-649525192347 req-c8bb8d34-ecc9-4e71-ae93-060030bff1a0 service nova] Lock "14e9c813-2486-4840-b18c-65ca237a8ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7916f081-f9ad-42cb-ab0d-649525192347 req-c8bb8d34-ecc9-4e71-ae93-060030bff1a0 service nova] Lock "14e9c813-2486-4840-b18c-65ca237a8ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.compute.manager [req-7916f081-f9ad-42cb-ab0d-649525192347 req-c8bb8d34-ecc9-4e71-ae93-060030bff1a0 service nova] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] No waiting events found dispatching network-vif-plugged-e9e74d39-f7ae-498a-932c-65c2639a3efe {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:44:37 user nova-compute[74189]: WARNING nova.compute.manager [req-7916f081-f9ad-42cb-ab0d-649525192347 req-c8bb8d34-ecc9-4e71-ae93-060030bff1a0 service nova] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Received unexpected event network-vif-plugged-e9e74d39-f7ae-498a-932c-65c2639a3efe for instance with vm_state building and task_state spawning.
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.network.neutron [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Updating instance_info_cache with network_info: [{"id": "e05cb4c8-e712-4628-9d3d-a72653f19860", "address": "fa:16:3e:dc:d9:66", "network": {"id": "d2a72b33-1451-4343-a1ac-3e7cb75ec083", "bridge": "br-int", "label": "tempest-TestStampPattern-234506410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6a19ad6e8249abbe10137bdad65ca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05cb4c8-e7", "ovs_interfaceid": "e05cb4c8-e712-4628-9d3d-a72653f19860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Releasing lock "refresh_cache-0b5d04c5-dfae-42de-84b9-2fab02e3d679" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.compute.manager [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Instance network_info: |[{"id": "e05cb4c8-e712-4628-9d3d-a72653f19860", "address": "fa:16:3e:dc:d9:66", "network": {"id": "d2a72b33-1451-4343-a1ac-3e7cb75ec083", "bridge": "br-int", "label": "tempest-TestStampPattern-234506410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6a19ad6e8249abbe10137bdad65ca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05cb4c8-e7", "ovs_interfaceid": "e05cb4c8-e712-4628-9d3d-a72653f19860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ffac9c48-2b14-488f-bafe-94a532726e54 req-d901831f-f963-4a3c-8515-3ed411f7c4ff service nova] Acquired lock "refresh_cache-0b5d04c5-dfae-42de-84b9-2fab02e3d679" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.network.neutron [req-ffac9c48-2b14-488f-bafe-94a532726e54 req-d901831f-f963-4a3c-8515-3ed411f7c4ff service nova] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Refreshing network info cache for port e05cb4c8-e712-4628-9d3d-a72653f19860 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Start _get_guest_xml network_info=[{"id": "e05cb4c8-e712-4628-9d3d-a72653f19860", "address": "fa:16:3e:dc:d9:66", "network": {"id": "d2a72b33-1451-4343-a1ac-3e7cb75ec083", "bridge": "br-int", "label": "tempest-TestStampPattern-234506410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6a19ad6e8249abbe10137bdad65ca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05cb4c8-e7", "ovs_interfaceid": "e05cb4c8-e712-4628-9d3d-a72653f19860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:44:37 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:44:37 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:44:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1759054533',display_name='tempest-TestStampPattern-server-1759054533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1759054533',id=48,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQ9OkIshA11eGvW1QoEDYUze94CFpHLxzzrnPEgQ/2cw2YykkRNKJSJN8zmNNN6ley6mlQwKcYrckjb4ee76GPcAhjB40Ypfxi0u4ciFrGvjcvOeYKwMAfqYUHhAHDRpA==',key_name='tempest-TestStampPattern-1702097735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e6a19ad6e8249abbe10137bdad65ca6',ramdisk_id='',reservation_id='r-kwikn0nu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-367314632',owner_user_name='tempest-TestStampPattern-367314632-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:44:36Z,user_data=None,user_id='ea97d3b6a27a4b569c04e26aa6043289',uuid=0b5d04c5-dfae-42de-84b9-2fab02e3d679,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e05cb4c8-e712-4628-9d3d-a72653f19860", "address": "fa:16:3e:dc:d9:66", "network": {"id": "d2a72b33-1451-4343-a1ac-3e7cb75ec083", "bridge": "br-int", "label": "tempest-TestStampPattern-234506410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6a19ad6e8249abbe10137bdad65ca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05cb4c8-e7", "ovs_interfaceid": "e05cb4c8-e712-4628-9d3d-a72653f19860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Converting VIF {"id": "e05cb4c8-e712-4628-9d3d-a72653f19860", "address": "fa:16:3e:dc:d9:66", "network": {"id": "d2a72b33-1451-4343-a1ac-3e7cb75ec083", "bridge": "br-int", "label": "tempest-TestStampPattern-234506410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6a19ad6e8249abbe10137bdad65ca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05cb4c8-e7", "ovs_interfaceid": "e05cb4c8-e712-4628-9d3d-a72653f19860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:d9:66,bridge_name='br-int',has_traffic_filtering=True,id=e05cb4c8-e712-4628-9d3d-a72653f19860,network=Network(d2a72b33-1451-4343-a1ac-3e7cb75ec083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape05cb4c8-e7') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.objects.instance [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b5d04c5-dfae-42de-84b9-2fab02e3d679 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:44:37 user nova-compute[74189]:   <uuid>0b5d04c5-dfae-42de-84b9-2fab02e3d679</uuid>
Oct 25 21:44:37 user nova-compute[74189]:   <name>instance-00000030</name>
Oct 25 21:44:37 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:44:37 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:44:37 user nova-compute[74189]:   <metadata>
Oct 25 21:44:37 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:44:37 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:44:37 user nova-compute[74189]:       <nova:name>tempest-TestStampPattern-server-1759054533</nova:name>
Oct 25 21:44:37 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:44:37</nova:creationTime>
Oct 25 21:44:37 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:44:37 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:44:37 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:44:37 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:44:37 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:44:37 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:44:37 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:44:37 user nova-compute[74189]:       <nova:owner>
Oct 25 21:44:37 user nova-compute[74189]:         <nova:user uuid="ea97d3b6a27a4b569c04e26aa6043289">tempest-TestStampPattern-367314632-project-member</nova:user>
Oct 25 21:44:37 user nova-compute[74189]:         <nova:project uuid="6e6a19ad6e8249abbe10137bdad65ca6">tempest-TestStampPattern-367314632</nova:project>
Oct 25 21:44:37 user nova-compute[74189]:       </nova:owner>
Oct 25 21:44:37 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:44:37 user nova-compute[74189]:       <nova:ports>
Oct 25 21:44:37 user nova-compute[74189]:         <nova:port uuid="e05cb4c8-e712-4628-9d3d-a72653f19860">
Oct 25 21:44:37 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 21:44:37 user nova-compute[74189]:         </nova:port>
Oct 25 21:44:37 user nova-compute[74189]:       </nova:ports>
Oct 25 21:44:37 user nova-compute[74189]:     </nova:instance>
Oct 25 21:44:37 user nova-compute[74189]:   </metadata>
Oct 25 21:44:37 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:44:37 user nova-compute[74189]:     <system>
Oct 25 21:44:37 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:44:37 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:44:37 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:44:37 user nova-compute[74189]:       <entry name="serial">0b5d04c5-dfae-42de-84b9-2fab02e3d679</entry>
Oct 25 21:44:37 user nova-compute[74189]:       <entry name="uuid">0b5d04c5-dfae-42de-84b9-2fab02e3d679</entry>
Oct 25 21:44:37 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:44:37 user nova-compute[74189]:     </system>
Oct 25 21:44:37 user nova-compute[74189]:   </sysinfo>
Oct 25 21:44:37 user nova-compute[74189]:   <os>
Oct 25 21:44:37 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:44:37 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:44:37 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:44:37 user nova-compute[74189]:   </os>
Oct 25 21:44:37 user nova-compute[74189]:   <features>
Oct 25 21:44:37 user nova-compute[74189]:     <acpi/>
Oct 25 21:44:37 user nova-compute[74189]:     <apic/>
Oct 25 21:44:37 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:44:37 user nova-compute[74189]:   </features>
Oct 25 21:44:37 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:44:37 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:44:37 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:44:37 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:44:37 user nova-compute[74189]:   </clock>
Oct 25 21:44:37 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:44:37 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:44:37 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:44:37 user nova-compute[74189]:   </cpu>
Oct 25 21:44:37 user nova-compute[74189]:   <devices>
Oct 25 21:44:37 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:44:37 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:44:37 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk"/>
Oct 25 21:44:37 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:44:37 user nova-compute[74189]:     </disk>
Oct 25 21:44:37 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:44:37 user nova-compute[74189]:       <mac address="fa:16:3e:dc:d9:66"/>
Oct 25 21:44:37 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:44:37 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:44:37 user nova-compute[74189]:       <target dev="tape05cb4c8-e7"/>
Oct 25 21:44:37 user nova-compute[74189]:     </interface>
Oct 25 21:44:37 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:44:37 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/console.log" append="off"/>
Oct 25 21:44:37 user nova-compute[74189]:     </serial>
Oct 25 21:44:37 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:44:37 user nova-compute[74189]:     <video>
Oct 25 21:44:37 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:44:37 user nova-compute[74189]:     </video>
Oct 25 21:44:37 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:44:37 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:44:37 user nova-compute[74189]:     </rng>
Oct 25 21:44:37 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:44:37 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:44:37 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:44:37 user nova-compute[74189]:     </memballoon>
Oct 25 21:44:37 user nova-compute[74189]:   </devices>
Oct 25 21:44:37 user nova-compute[74189]: </domain>
Oct 25 21:44:37 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:44:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1759054533',display_name='tempest-TestStampPattern-server-1759054533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1759054533',id=48,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQ9OkIshA11eGvW1QoEDYUze94CFpHLxzzrnPEgQ/2cw2YykkRNKJSJN8zmNNN6ley6mlQwKcYrckjb4ee76GPcAhjB40Ypfxi0u4ciFrGvjcvOeYKwMAfqYUHhAHDRpA==',key_name='tempest-TestStampPattern-1702097735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e6a19ad6e8249abbe10137bdad65ca6',ramdisk_id='',reservation_id='r-kwikn0nu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-367314632',owner_user_name='tempest-TestStampPattern-367314632-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:44:36Z,user_data=None,user_id='ea97d3b6a27a4b569c04e26aa6043289',uuid=0b5d04c5-dfae-42de-84b9-2fab02e3d679,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e05cb4c8-e712-4628-9d3d-a72653f19860", "address": "fa:16:3e:dc:d9:66", "network": {"id": "d2a72b33-1451-4343-a1ac-3e7cb75ec083", "bridge": "br-int", "label": "tempest-TestStampPattern-234506410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6a19ad6e8249abbe10137bdad65ca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05cb4c8-e7", "ovs_interfaceid": "e05cb4c8-e712-4628-9d3d-a72653f19860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Converting VIF {"id": "e05cb4c8-e712-4628-9d3d-a72653f19860", "address": "fa:16:3e:dc:d9:66", "network": {"id": "d2a72b33-1451-4343-a1ac-3e7cb75ec083", "bridge": "br-int", "label": "tempest-TestStampPattern-234506410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6a19ad6e8249abbe10137bdad65ca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05cb4c8-e7", "ovs_interfaceid": "e05cb4c8-e712-4628-9d3d-a72653f19860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:d9:66,bridge_name='br-int',has_traffic_filtering=True,id=e05cb4c8-e712-4628-9d3d-a72653f19860,network=Network(d2a72b33-1451-4343-a1ac-3e7cb75ec083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape05cb4c8-e7') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG os_vif [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:d9:66,bridge_name='br-int',has_traffic_filtering=True,id=e05cb4c8-e712-4628-9d3d-a72653f19860,network=Network(d2a72b33-1451-4343-a1ac-3e7cb75ec083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape05cb4c8-e7') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c844f08f-09d6-5e88-b050-2a3df9433ae0', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape05cb4c8-e7, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape05cb4c8-e7, col_values=(('qos', UUID('444ff821-99e5-4264-a8e0-24f276dd7e62')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape05cb4c8-e7, col_values=(('external_ids', {'iface-id': 'e05cb4c8-e712-4628-9d3d-a72653f19860', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:d9:66', 'vm-uuid': '0b5d04c5-dfae-42de-84b9-2fab02e3d679'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:37 user nova-compute[74189]: INFO os_vif [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:d9:66,bridge_name='br-int',has_traffic_filtering=True,id=e05cb4c8-e712-4628-9d3d-a72653f19860,network=Network(d2a72b33-1451-4343-a1ac-3e7cb75ec083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape05cb4c8-e7')
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:44:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] No VIF found with MAC fa:16:3e:dc:d9:66, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:44:38 user nova-compute[74189]: DEBUG nova.network.neutron [req-ffac9c48-2b14-488f-bafe-94a532726e54 req-d901831f-f963-4a3c-8515-3ed411f7c4ff service nova] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Updated VIF entry in instance network info cache for port e05cb4c8-e712-4628-9d3d-a72653f19860. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:44:38 user nova-compute[74189]: DEBUG nova.network.neutron [req-ffac9c48-2b14-488f-bafe-94a532726e54 req-d901831f-f963-4a3c-8515-3ed411f7c4ff service nova] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Updating instance_info_cache with network_info: [{"id": "e05cb4c8-e712-4628-9d3d-a72653f19860", "address": "fa:16:3e:dc:d9:66", "network": {"id": "d2a72b33-1451-4343-a1ac-3e7cb75ec083", "bridge": "br-int", "label": "tempest-TestStampPattern-234506410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6a19ad6e8249abbe10137bdad65ca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05cb4c8-e7", "ovs_interfaceid": "e05cb4c8-e712-4628-9d3d-a72653f19860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:44:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ffac9c48-2b14-488f-bafe-94a532726e54 req-d901831f-f963-4a3c-8515-3ed411f7c4ff service nova] Releasing lock "refresh_cache-0b5d04c5-dfae-42de-84b9-2fab02e3d679" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:44:38 user nova-compute[74189]: DEBUG nova.compute.manager [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:44:38 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:44:38 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Instance spawned successfully.
Oct 25 21:44:38 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:44:38 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:44:38 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:44:38 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:44:38 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:44:38 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:44:38 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:44:38 user nova-compute[74189]: INFO nova.compute.manager [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Took 5.91 seconds to spawn the instance on the hypervisor.
Oct 25 21:44:38 user nova-compute[74189]: DEBUG nova.compute.manager [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:44:38 user nova-compute[74189]: INFO nova.compute.manager [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Took 6.57 seconds to build instance.
Oct 25 21:44:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-05f3c3b6-e1ac-472e-84b0-f61d460f73d1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "14e9c813-2486-4840-b18c-65ca237a8ebf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.668s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:44:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:39 user nova-compute[74189]: DEBUG nova.compute.manager [req-ebe41970-b072-495c-a3e8-a14304e0f2d6 req-958fdaca-d76a-4f6c-95dc-e0d1d39164c4 service nova] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Received event network-vif-plugged-e05cb4c8-e712-4628-9d3d-a72653f19860 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:44:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ebe41970-b072-495c-a3e8-a14304e0f2d6 req-958fdaca-d76a-4f6c-95dc-e0d1d39164c4 service nova] Acquiring lock "0b5d04c5-dfae-42de-84b9-2fab02e3d679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:44:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ebe41970-b072-495c-a3e8-a14304e0f2d6 req-958fdaca-d76a-4f6c-95dc-e0d1d39164c4 service nova] Lock "0b5d04c5-dfae-42de-84b9-2fab02e3d679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:44:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ebe41970-b072-495c-a3e8-a14304e0f2d6 req-958fdaca-d76a-4f6c-95dc-e0d1d39164c4 service nova] Lock "0b5d04c5-dfae-42de-84b9-2fab02e3d679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:44:39 user nova-compute[74189]: DEBUG nova.compute.manager [req-ebe41970-b072-495c-a3e8-a14304e0f2d6 req-958fdaca-d76a-4f6c-95dc-e0d1d39164c4 service nova] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] No waiting events found dispatching network-vif-plugged-e05cb4c8-e712-4628-9d3d-a72653f19860 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:44:39 user nova-compute[74189]: WARNING nova.compute.manager [req-ebe41970-b072-495c-a3e8-a14304e0f2d6 req-958fdaca-d76a-4f6c-95dc-e0d1d39164c4 service nova] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Received unexpected event network-vif-plugged-e05cb4c8-e712-4628-9d3d-a72653f19860 for instance with vm_state building and task_state spawning.
Oct 25 21:44:39 user nova-compute[74189]: DEBUG nova.compute.manager [req-64ee8ae3-06c1-43ba-a951-e024cfc8eed7 req-c7edf1f7-e806-485e-be8e-dd3be9f982ca service nova] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Received event network-vif-plugged-e9e74d39-f7ae-498a-932c-65c2639a3efe {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:44:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-64ee8ae3-06c1-43ba-a951-e024cfc8eed7 req-c7edf1f7-e806-485e-be8e-dd3be9f982ca service nova] Acquiring lock "14e9c813-2486-4840-b18c-65ca237a8ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:44:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-64ee8ae3-06c1-43ba-a951-e024cfc8eed7 req-c7edf1f7-e806-485e-be8e-dd3be9f982ca service nova] Lock "14e9c813-2486-4840-b18c-65ca237a8ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:44:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-64ee8ae3-06c1-43ba-a951-e024cfc8eed7 req-c7edf1f7-e806-485e-be8e-dd3be9f982ca service nova] Lock "14e9c813-2486-4840-b18c-65ca237a8ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:44:39 user nova-compute[74189]: DEBUG nova.compute.manager [req-64ee8ae3-06c1-43ba-a951-e024cfc8eed7 req-c7edf1f7-e806-485e-be8e-dd3be9f982ca service nova] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] No waiting events found dispatching network-vif-plugged-e9e74d39-f7ae-498a-932c-65c2639a3efe {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:44:39 user nova-compute[74189]: WARNING nova.compute.manager [req-64ee8ae3-06c1-43ba-a951-e024cfc8eed7 req-c7edf1f7-e806-485e-be8e-dd3be9f982ca service nova] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Received unexpected event network-vif-plugged-e9e74d39-f7ae-498a-932c-65c2639a3efe for instance with vm_state active and task_state None.
Oct 25 21:44:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:41 user nova-compute[74189]: DEBUG nova.compute.manager [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:44:41 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:44:41 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Instance spawned successfully.
Oct 25 21:44:41 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:44:41 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:44:41 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:44:41 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:44:41 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:44:41 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:44:41 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:44:41 user nova-compute[74189]: DEBUG nova.compute.manager [req-cbb49967-d235-4b5a-9715-4e8d6ce854cb req-27439e78-6c60-45cd-bcb1-6826916e61c7 service nova] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Received event network-vif-plugged-e05cb4c8-e712-4628-9d3d-a72653f19860 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:44:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-cbb49967-d235-4b5a-9715-4e8d6ce854cb req-27439e78-6c60-45cd-bcb1-6826916e61c7 service nova] Acquiring lock "0b5d04c5-dfae-42de-84b9-2fab02e3d679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:44:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-cbb49967-d235-4b5a-9715-4e8d6ce854cb req-27439e78-6c60-45cd-bcb1-6826916e61c7 service nova] Lock "0b5d04c5-dfae-42de-84b9-2fab02e3d679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:44:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-cbb49967-d235-4b5a-9715-4e8d6ce854cb req-27439e78-6c60-45cd-bcb1-6826916e61c7 service nova] Lock "0b5d04c5-dfae-42de-84b9-2fab02e3d679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:44:41 user nova-compute[74189]: DEBUG nova.compute.manager [req-cbb49967-d235-4b5a-9715-4e8d6ce854cb req-27439e78-6c60-45cd-bcb1-6826916e61c7 service nova] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] No waiting events found dispatching network-vif-plugged-e05cb4c8-e712-4628-9d3d-a72653f19860 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:44:41 user nova-compute[74189]: WARNING nova.compute.manager [req-cbb49967-d235-4b5a-9715-4e8d6ce854cb req-27439e78-6c60-45cd-bcb1-6826916e61c7 service nova] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Received unexpected event network-vif-plugged-e05cb4c8-e712-4628-9d3d-a72653f19860 for instance with vm_state building and task_state spawning.
Oct 25 21:44:41 user nova-compute[74189]: INFO nova.compute.manager [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Took 5.67 seconds to spawn the instance on the hypervisor.
Oct 25 21:44:41 user nova-compute[74189]: DEBUG nova.compute.manager [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:44:41 user nova-compute[74189]: INFO nova.compute.manager [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Took 6.46 seconds to build instance.
Oct 25 21:44:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-4cdec5a6-c6a0-4cb6-99bb-b312742103e8 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "0b5d04c5-dfae-42de-84b9-2fab02e3d679" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.577s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:44:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:49 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fff8f286-0baa-4865-994f-4418af3edd0a is timed out.
Oct 25 21:44:49 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Successfully detached device vdb from instance fff8f286-0baa-4865-994f-4418af3edd0a from the live domain config.
Oct 25 21:44:49 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:44:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tcDGXrUv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:44:49 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:44:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:44:49 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:44:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b332165-b46f-4832-ae9d-400ef1e0f2cd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:44:50 user nova-compute[74189]: No targets found.
Oct 25 21:44:50 user nova-compute[74189]: iSNS:
Oct 25 21:44:50 user nova-compute[74189]: No targets found.
Oct 25 21:44:50 user nova-compute[74189]: STATIC:
Oct 25 21:44:50 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a
Oct 25 21:44:50 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:44:50 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:44:50 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29
Oct 25 21:44:50 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:44:50 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:44:50 user nova-compute[74189]: FIRMWARE:
Oct 25 21:44:50 user nova-compute[74189]: No targets found.
Oct 25 21:44:50 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:44:50 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:44:50 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[12748156-7b62-4297-a49f-22ad104148ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd611a0-e397-4d4b-8e03-a6da4e0bc1a8]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:44:50 user nova-compute[74189]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a (non-flash)
Oct 25 21:44:50 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:44:50 user nova-compute[74189]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a (non-flash)
Oct 25 21:44:50 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2e475c160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a'): ({'sdb'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Removing single pathed devices sdb {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b354d793-282d-4eac-adaf-e37e54874ab3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[508cf077-0a91-4854-87f2-03a4be2f85ef]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Flushing IO for device /dev/sdb {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e03bfaf-916f-4cc3-98ea-0355b7ddb47c]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcce51c6-1dd9-4db6-9b5d-9d3ac9ae22a0]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] SCSI volumes sdb have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[39050d34-469f-4be2-a379-31b00edc965c]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2211ca49-f3df-4581-a1e8-12161500ca24]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a, portal: 172.16.0.220,3260]
Oct 25 21:44:50 user nova-compute[74189]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a, portal: 172.16.0.220,3260] successful.
Oct 25 21:44:50 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3b61-e1fd-449f-a934-b0eca49fd77a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6913217-70ef-4f6d-b052-1c5d4f7d983a]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] <== disconnect_volume: return (310ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:44:50 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:44:51 user nova-compute[74189]: DEBUG nova.objects.instance [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lazy-loading 'flavor' on Instance uuid fff8f286-0baa-4865-994f-4418af3edd0a {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:44:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5ec50d41-5fe0-4d35-83ce-cbbf1e525e6a tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "fff8f286-0baa-4865-994f-4418af3edd0a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.899s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:44:52 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:44:52 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:52 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 21:44:52 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:44:52 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:44:52 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:44:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:09 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:12 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:16 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:45:16 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:45:16 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Rebuilding the list of instances to heal {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 21:45:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:45:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:45:17 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:45:17 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lazy-loading 'info_cache' on Instance uuid 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:45:17 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Updating instance_info_cache with network_info: [{"id": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "address": "fa:16:3e:5d:2c:57", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d0e911-b6", "ovs_interfaceid": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:45:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:45:17 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:45:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:45:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 21:45:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:45:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:45:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:20 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:45:20 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:45:21 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:45:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:45:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:45:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:45:21 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:45:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:45:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:45:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:45:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:45:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:45:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:45:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:45:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:45:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38919a8d-2c62-4d4d-83e2-97b69409155d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:45:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:45:22 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38919a8d-2c62-4d4d-83e2-97b69409155d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:45:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38919a8d-2c62-4d4d-83e2-97b69409155d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:45:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38919a8d-2c62-4d4d-83e2-97b69409155d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:45:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:45:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:45:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:45:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:45:23 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:45:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:45:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:45:23 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:45:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:45:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:45:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:45:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:45:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:45:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:45:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:45:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:45:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:45:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e9c813-2486-4840-b18c-65ca237a8ebf/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:45:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e9c813-2486-4840-b18c-65ca237a8ebf/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:45:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e9c813-2486-4840-b18c-65ca237a8ebf/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:45:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e9c813-2486-4840-b18c-65ca237a8ebf/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:45:25 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:45:25 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:45:25 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=7909MB free_disk=24.904937744140625GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:45:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:45:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:45:25 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:45:25 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3da14c0a-31a8-4fe3-bd5a-49378680af50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:45:25 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 915a1d25-6499-4d3e-9edd-5f3cfd487bac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:45:25 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance fff8f286-0baa-4865-994f-4418af3edd0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:45:25 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 38919a8d-2c62-4d4d-83e2-97b69409155d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:45:25 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 14e9c813-2486-4840-b18c-65ca237a8ebf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:45:25 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 0b5d04c5-dfae-42de-84b9-2fab02e3d679 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:45:25 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:45:25 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:45:25 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:45:25 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:45:25 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:45:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.410s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:45:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Acquiring lock "fff8f286-0baa-4865-994f-4418af3edd0a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:45:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "fff8f286-0baa-4865-994f-4418af3edd0a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:45:26 user nova-compute[74189]: DEBUG nova.objects.instance [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lazy-loading 'flavor' on Instance uuid fff8f286-0baa-4865-994f-4418af3edd0a {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:45:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "fff8f286-0baa-4865-994f-4418af3edd0a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:45:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Acquiring lock "fff8f286-0baa-4865-994f-4418af3edd0a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:45:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "fff8f286-0baa-4865-994f-4418af3edd0a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:45:26 user nova-compute[74189]: INFO nova.compute.manager [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Attaching volume b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f to /dev/vdb
Oct 25 21:45:26 user nova-compute[74189]: DEBUG os_brick.utils [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:45:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:45:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:45:26 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8914192-c35f-4bb4-98ec-300157744e83]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:45:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:45:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:45:26 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1c5fb8-edf7-4757-af6d-e15d7592c837]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:45:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:45:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:45:26 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0749d097-041b-4417-a2e7-a4c8319ffff8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:45:26 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23392c4-ba03-47fe-a1dd-2551219a42b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:45:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:45:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:45:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:45:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:45:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:45:26 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:45:26 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7c58a8-cc09-415c-88fd-6056281e8ff3]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:45:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:45:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:45:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:45:26 user nova-compute[74189]: DEBUG os_brick.utils [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:45:26 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Updating existing volume attachment record: 5f4a62ad-a93c-42c8-991c-fc820b9f636e {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:45:27 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:45:27 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:45:27 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:45:27 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:45:27 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:45:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-34915dec-21b8-46c2-9e63-b71366fdb921 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Acquiring lock "38919a8d-2c62-4d4d-83e2-97b69409155d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:45:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-34915dec-21b8-46c2-9e63-b71366fdb921 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lock "38919a8d-2c62-4d4d-83e2-97b69409155d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:45:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-34915dec-21b8-46c2-9e63-b71366fdb921 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Acquiring lock "38919a8d-2c62-4d4d-83e2-97b69409155d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:45:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-34915dec-21b8-46c2-9e63-b71366fdb921 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lock "38919a8d-2c62-4d4d-83e2-97b69409155d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:45:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-34915dec-21b8-46c2-9e63-b71366fdb921 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lock "38919a8d-2c62-4d4d-83e2-97b69409155d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:45:27 user nova-compute[74189]: INFO nova.compute.manager [None req-34915dec-21b8-46c2-9e63-b71366fdb921 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Terminating instance
Oct 25 21:45:27 user nova-compute[74189]: DEBUG nova.compute.manager [None req-34915dec-21b8-46c2-9e63-b71366fdb921 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:45:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:28 user nova-compute[74189]: DEBUG nova.compute.manager [req-a10d2318-e2cf-4367-b38c-ed72315ee7ed req-bbb9390d-d60b-41db-a5f8-ff94eecf7f57 service nova] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Received event network-vif-unplugged-2744e70f-bf6d-4f88-a193-03350965a6ef {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:45:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a10d2318-e2cf-4367-b38c-ed72315ee7ed req-bbb9390d-d60b-41db-a5f8-ff94eecf7f57 service nova] Acquiring lock "38919a8d-2c62-4d4d-83e2-97b69409155d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:45:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a10d2318-e2cf-4367-b38c-ed72315ee7ed req-bbb9390d-d60b-41db-a5f8-ff94eecf7f57 service nova] Lock "38919a8d-2c62-4d4d-83e2-97b69409155d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:45:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a10d2318-e2cf-4367-b38c-ed72315ee7ed req-bbb9390d-d60b-41db-a5f8-ff94eecf7f57 service nova] Lock "38919a8d-2c62-4d4d-83e2-97b69409155d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:45:28 user nova-compute[74189]: DEBUG nova.compute.manager [req-a10d2318-e2cf-4367-b38c-ed72315ee7ed req-bbb9390d-d60b-41db-a5f8-ff94eecf7f57 service nova] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] No waiting events found dispatching network-vif-unplugged-2744e70f-bf6d-4f88-a193-03350965a6ef {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:45:28 user nova-compute[74189]: DEBUG nova.compute.manager [req-a10d2318-e2cf-4367-b38c-ed72315ee7ed req-bbb9390d-d60b-41db-a5f8-ff94eecf7f57 service nova] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Received event network-vif-unplugged-2744e70f-bf6d-4f88-a193-03350965a6ef for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:45:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:28 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Instance destroyed successfully.
Oct 25 21:45:28 user nova-compute[74189]: DEBUG nova.objects.instance [None req-34915dec-21b8-46c2-9e63-b71366fdb921 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lazy-loading 'resources' on Instance uuid 38919a8d-2c62-4d4d-83e2-97b69409155d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:45:28 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-34915dec-21b8-46c2-9e63-b71366fdb921 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:43:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1010013500',display_name='tempest-VolumesActionsTest-instance-1010013500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1010013500',id=46,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:43:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e9ba950bd71349a2bfac732f770a9731',ramdisk_id='',reservation_id='r-ed3r9g61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-159377188',owner_user_name='tempest-VolumesActionsTest-159377188-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:43:43Z,user_data=None,user_id='06898f18a73c449c95fea8ee727741f0',uuid=38919a8d-2c62-4d4d-83e2-97b69409155d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2744e70f-bf6d-4f88-a193-03350965a6ef", "address": "fa:16:3e:3c:31:dd", "network": {"id": "9fd8198e-7326-4533-a88c-c4ca629214d6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-40841454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9ba950bd71349a2bfac732f770a9731", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2744e70f-bf", "ovs_interfaceid": "2744e70f-bf6d-4f88-a193-03350965a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:45:28 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-34915dec-21b8-46c2-9e63-b71366fdb921 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Converting VIF {"id": "2744e70f-bf6d-4f88-a193-03350965a6ef", "address": "fa:16:3e:3c:31:dd", "network": {"id": "9fd8198e-7326-4533-a88c-c4ca629214d6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-40841454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9ba950bd71349a2bfac732f770a9731", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2744e70f-bf", "ovs_interfaceid": "2744e70f-bf6d-4f88-a193-03350965a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:45:28 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-34915dec-21b8-46c2-9e63-b71366fdb921 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:31:dd,bridge_name='br-int',has_traffic_filtering=True,id=2744e70f-bf6d-4f88-a193-03350965a6ef,network=Network(9fd8198e-7326-4533-a88c-c4ca629214d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2744e70f-bf') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:45:28 user nova-compute[74189]: DEBUG os_vif [None req-34915dec-21b8-46c2-9e63-b71366fdb921 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:31:dd,bridge_name='br-int',has_traffic_filtering=True,id=2744e70f-bf6d-4f88-a193-03350965a6ef,network=Network(9fd8198e-7326-4533-a88c-c4ca629214d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2744e70f-bf') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:45:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2744e70f-bf, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:45:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:45:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0a0d1013-fcfd-4426-ac05-d752ba67c64e) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:45:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:28 user nova-compute[74189]: INFO os_vif [None req-34915dec-21b8-46c2-9e63-b71366fdb921 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:31:dd,bridge_name='br-int',has_traffic_filtering=True,id=2744e70f-bf6d-4f88-a193-03350965a6ef,network=Network(9fd8198e-7326-4533-a88c-c4ca629214d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2744e70f-bf')
Oct 25 21:45:28 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-34915dec-21b8-46c2-9e63-b71366fdb921 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Deleting instance files /opt/stack/data/nova/instances/38919a8d-2c62-4d4d-83e2-97b69409155d_del
Oct 25 21:45:28 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-34915dec-21b8-46c2-9e63-b71366fdb921 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Deletion of /opt/stack/data/nova/instances/38919a8d-2c62-4d4d-83e2-97b69409155d_del complete
Oct 25 21:45:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:28 user nova-compute[74189]: INFO nova.compute.manager [None req-34915dec-21b8-46c2-9e63-b71366fdb921 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 25 21:45:28 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-34915dec-21b8-46c2-9e63-b71366fdb921 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:45:28 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:45:28 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:45:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:29 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:45:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:29 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Took 0.57 seconds to deallocate network for instance.
Oct 25 21:45:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-2c71877d-88e8-48a5-a464-e240cec85d88 req-b32169b8-d59e-44eb-8859-738a44f806ea service nova] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Received event network-vif-deleted-2744e70f-bf6d-4f88-a193-03350965a6ef {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:45:29 user nova-compute[74189]: INFO nova.compute.manager [req-2c71877d-88e8-48a5-a464-e240cec85d88 req-b32169b8-d59e-44eb-8859-738a44f806ea service nova] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Neutron deleted interface 2744e70f-bf6d-4f88-a193-03350965a6ef; detaching it from the instance and deleting it from the info cache
Oct 25 21:45:29 user nova-compute[74189]: DEBUG nova.network.neutron [req-2c71877d-88e8-48a5-a464-e240cec85d88 req-b32169b8-d59e-44eb-8859-738a44f806ea service nova] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:45:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-2c71877d-88e8-48a5-a464-e240cec85d88 req-b32169b8-d59e-44eb-8859-738a44f806ea service nova] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Detach interface failed, port_id=2744e70f-bf6d-4f88-a193-03350965a6ef, reason: Instance 38919a8d-2c62-4d4d-83e2-97b69409155d could not be found. {{(pid=74189) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 21:45:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-34915dec-21b8-46c2-9e63-b71366fdb921 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:45:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-34915dec-21b8-46c2-9e63-b71366fdb921 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:45:29 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-34915dec-21b8-46c2-9e63-b71366fdb921 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:45:29 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-34915dec-21b8-46c2-9e63-b71366fdb921 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:45:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-34915dec-21b8-46c2-9e63-b71366fdb921 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:45:29 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-34915dec-21b8-46c2-9e63-b71366fdb921 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Deleted allocations for instance 38919a8d-2c62-4d4d-83e2-97b69409155d
Oct 25 21:45:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-34915dec-21b8-46c2-9e63-b71366fdb921 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lock "38919a8d-2c62-4d4d-83e2-97b69409155d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.991s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:45:30 user nova-compute[74189]: DEBUG nova.compute.manager [req-811d0428-0a3d-4c0e-b8a1-b351cafb0c3d req-57f2d5ff-60e3-4235-81b6-90b28fbe2244 service nova] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Received event network-vif-plugged-2744e70f-bf6d-4f88-a193-03350965a6ef {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:45:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-811d0428-0a3d-4c0e-b8a1-b351cafb0c3d req-57f2d5ff-60e3-4235-81b6-90b28fbe2244 service nova] Acquiring lock "38919a8d-2c62-4d4d-83e2-97b69409155d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:45:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-811d0428-0a3d-4c0e-b8a1-b351cafb0c3d req-57f2d5ff-60e3-4235-81b6-90b28fbe2244 service nova] Lock "38919a8d-2c62-4d4d-83e2-97b69409155d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:45:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-811d0428-0a3d-4c0e-b8a1-b351cafb0c3d req-57f2d5ff-60e3-4235-81b6-90b28fbe2244 service nova] Lock "38919a8d-2c62-4d4d-83e2-97b69409155d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:45:30 user nova-compute[74189]: DEBUG nova.compute.manager [req-811d0428-0a3d-4c0e-b8a1-b351cafb0c3d req-57f2d5ff-60e3-4235-81b6-90b28fbe2244 service nova] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] No waiting events found dispatching network-vif-plugged-2744e70f-bf6d-4f88-a193-03350965a6ef {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:45:30 user nova-compute[74189]: WARNING nova.compute.manager [req-811d0428-0a3d-4c0e-b8a1-b351cafb0c3d req-57f2d5ff-60e3-4235-81b6-90b28fbe2244 service nova] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Received unexpected event network-vif-plugged-2744e70f-bf6d-4f88-a193-03350965a6ef for instance with vm_state deleted and task_state None.
Oct 25 21:45:30 user nova-compute[74189]: DEBUG nova.compute.manager [req-811d0428-0a3d-4c0e-b8a1-b351cafb0c3d req-57f2d5ff-60e3-4235-81b6-90b28fbe2244 service nova] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Received event network-vif-plugged-2744e70f-bf6d-4f88-a193-03350965a6ef {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:45:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-811d0428-0a3d-4c0e-b8a1-b351cafb0c3d req-57f2d5ff-60e3-4235-81b6-90b28fbe2244 service nova] Acquiring lock "38919a8d-2c62-4d4d-83e2-97b69409155d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:45:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-811d0428-0a3d-4c0e-b8a1-b351cafb0c3d req-57f2d5ff-60e3-4235-81b6-90b28fbe2244 service nova] Lock "38919a8d-2c62-4d4d-83e2-97b69409155d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:45:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-811d0428-0a3d-4c0e-b8a1-b351cafb0c3d req-57f2d5ff-60e3-4235-81b6-90b28fbe2244 service nova] Lock "38919a8d-2c62-4d4d-83e2-97b69409155d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:45:30 user nova-compute[74189]: DEBUG nova.compute.manager [req-811d0428-0a3d-4c0e-b8a1-b351cafb0c3d req-57f2d5ff-60e3-4235-81b6-90b28fbe2244 service nova] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] No waiting events found dispatching network-vif-plugged-2744e70f-bf6d-4f88-a193-03350965a6ef {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:45:30 user nova-compute[74189]: WARNING nova.compute.manager [req-811d0428-0a3d-4c0e-b8a1-b351cafb0c3d req-57f2d5ff-60e3-4235-81b6-90b28fbe2244 service nova] [instance: 38919a8d-2c62-4d4d-83e2-97b69409155d] Received unexpected event network-vif-plugged-2744e70f-bf6d-4f88-a193-03350965a6ef for instance with vm_state deleted and task_state None.
Oct 25 21:45:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:32 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:45:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:33 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:45:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:45:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:45:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umGcWklA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:45:43 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:45:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:45:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:45:43 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:45:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:45:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:45:43 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:45:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:45:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:45:43 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e867b5-bd68-4f9e-bc91-749a4d8e927b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:45:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:45:43 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:45:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8cf76b-7824-4fce-b7ac-61be3dd0db3f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f] added
Oct 25 21:45:44 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75d8d87-1c25-430b-a4b0-38c57a020e7c]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ace6c9-00b9-451a-99ee-9be5b126d4b8]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v umGcWklA {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v umGcWklA" returned: 0 in 0.026s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d42d519-3ed9-4e30-a79f-cb7e5348b213]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'umGcWklA'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae8f8c0-f6de-41be-a19c-638317362e74]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eccac2d-c6d1-4471-91d0-4a608b8e3a75]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:45:44 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:45:44 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e21a9d-2ead-4336-8d8a-054021513e7d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f, portal: 172.16.0.220,3260]
Oct 25 21:45:44 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f, portal: 172.16.0.220,3260] successful.
Oct 25 21:45:44 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9769d4fe-7f9b-4c16-b23e-d1cc73fad5c0]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df0d0e8-93cc-499f-a57a-52db63c87297]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:45:44 user nova-compute[74189]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f (non-flash)
Oct 25 21:45:44 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:45:44 user nova-compute[74189]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f (non-flash)
Oct 25 21:45:44 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e226915-eb0d-48c9-8873-3d07c6e71de8]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:45:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umGcWklA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:45:45 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:45:45 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26562623837666462', 'path': '/dev/sdb'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:45:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562623837666462', 'path': '/dev/sdb'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:45:45 user nova-compute[74189]: DEBUG nova.objects.instance [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lazy-loading 'flavor' on Instance uuid fff8f286-0baa-4865-994f-4418af3edd0a {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:45:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 21:45:45 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:45:45 user nova-compute[74189]:   <source dev="/dev/sdb"/>
Oct 25 21:45:45 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:45:45 user nova-compute[74189]:   <serial>b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f</serial>
Oct 25 21:45:45 user nova-compute[74189]: </disk>
Oct 25 21:45:45 user nova-compute[74189]:  {{(pid=74189) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 21:45:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:45:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:45:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] No VIF found with MAC fa:16:3e:b8:cf:38, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:45:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-13eb27a5-28f4-4662-a60e-7df4d31e3e2e tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "fff8f286-0baa-4865-994f-4418af3edd0a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.633s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:45:47 user nova-compute[74189]: DEBUG nova.compute.manager [req-74d2c31b-4ca0-4bd1-9648-376147379a54 req-6b2c704d-dd25-40dc-89b2-ed0fc92937d6 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Received event network-changed-d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:45:47 user nova-compute[74189]: DEBUG nova.compute.manager [req-74d2c31b-4ca0-4bd1-9648-376147379a54 req-6b2c704d-dd25-40dc-89b2-ed0fc92937d6 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Refreshing instance network info cache due to event network-changed-d8084804-8e6e-4787-b331-96822b5ed349. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:45:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-74d2c31b-4ca0-4bd1-9648-376147379a54 req-6b2c704d-dd25-40dc-89b2-ed0fc92937d6 service nova] Acquiring lock "refresh_cache-915a1d25-6499-4d3e-9edd-5f3cfd487bac" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:45:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-74d2c31b-4ca0-4bd1-9648-376147379a54 req-6b2c704d-dd25-40dc-89b2-ed0fc92937d6 service nova] Acquired lock "refresh_cache-915a1d25-6499-4d3e-9edd-5f3cfd487bac" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:45:47 user nova-compute[74189]: DEBUG nova.network.neutron [req-74d2c31b-4ca0-4bd1-9648-376147379a54 req-6b2c704d-dd25-40dc-89b2-ed0fc92937d6 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Refreshing network info cache for port d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:45:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:45:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:45:47 user nova-compute[74189]: INFO nova.compute.manager [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Detaching volume 9db1c721-ba3e-4493-8658-9d7ec0a8bc29
Oct 25 21:45:48 user nova-compute[74189]: DEBUG nova.network.neutron [req-74d2c31b-4ca0-4bd1-9648-376147379a54 req-6b2c704d-dd25-40dc-89b2-ed0fc92937d6 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Updated VIF entry in instance network info cache for port d8084804-8e6e-4787-b331-96822b5ed349. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:45:48 user nova-compute[74189]: DEBUG nova.network.neutron [req-74d2c31b-4ca0-4bd1-9648-376147379a54 req-6b2c704d-dd25-40dc-89b2-ed0fc92937d6 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Updating instance_info_cache with network_info: [{"id": "d8084804-8e6e-4787-b331-96822b5ed349", "address": "fa:16:3e:1c:bf:ba", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8084804-8e", "ovs_interfaceid": "d8084804-8e6e-4787-b331-96822b5ed349", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:45:48 user nova-compute[74189]: INFO nova.virt.block_device [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Attempting to driver detach volume 9db1c721-ba3e-4493-8658-9d7ec0a8bc29 from mountpoint /dev/vdb
Oct 25 21:45:48 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-74d2c31b-4ca0-4bd1-9648-376147379a54 req-6b2c704d-dd25-40dc-89b2-ed0fc92937d6 service nova] Releasing lock "refresh_cache-915a1d25-6499-4d3e-9edd-5f3cfd487bac" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:45:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Attempting to detach device vdb from instance 915a1d25-6499-4d3e-9edd-5f3cfd487bac from the persistent domain config. {{(pid=74189) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 21:45:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:45:48 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:45:48 user nova-compute[74189]:   <source dev="/dev/sdc"/>
Oct 25 21:45:48 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:45:48 user nova-compute[74189]:   <serial>9db1c721-ba3e-4493-8658-9d7ec0a8bc29</serial>
Oct 25 21:45:48 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:45:48 user nova-compute[74189]: </disk>
Oct 25 21:45:48 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:45:48 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Successfully detached device vdb from instance 915a1d25-6499-4d3e-9edd-5f3cfd487bac from the persistent domain config.
Oct 25 21:45:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 915a1d25-6499-4d3e-9edd-5f3cfd487bac from the live domain config. {{(pid=74189) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 21:45:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:45:48 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:45:48 user nova-compute[74189]:   <source dev="/dev/sdc"/>
Oct 25 21:45:48 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:45:48 user nova-compute[74189]:   <serial>9db1c721-ba3e-4493-8658-9d7ec0a8bc29</serial>
Oct 25 21:45:48 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:45:48 user nova-compute[74189]: </disk>
Oct 25 21:45:48 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:45:48 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Acquiring lock "fff8f286-0baa-4865-994f-4418af3edd0a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:45:48 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "fff8f286-0baa-4865-994f-4418af3edd0a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:45:48 user nova-compute[74189]: INFO nova.compute.manager [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Detaching volume b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f
Oct 25 21:45:48 user nova-compute[74189]: INFO nova.virt.block_device [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Attempting to driver detach volume b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f from mountpoint /dev/vdb
Oct 25 21:45:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Attempting to detach device vdb from instance fff8f286-0baa-4865-994f-4418af3edd0a from the persistent domain config. {{(pid=74189) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 21:45:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:45:48 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:45:48 user nova-compute[74189]:   <source dev="/dev/sdb"/>
Oct 25 21:45:48 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:45:48 user nova-compute[74189]:   <serial>b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f</serial>
Oct 25 21:45:48 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:45:48 user nova-compute[74189]: </disk>
Oct 25 21:45:48 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:45:48 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Successfully detached device vdb from instance fff8f286-0baa-4865-994f-4418af3edd0a from the persistent domain config.
Oct 25 21:45:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fff8f286-0baa-4865-994f-4418af3edd0a from the live domain config. {{(pid=74189) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 21:45:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:45:48 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:45:48 user nova-compute[74189]:   <source dev="/dev/sdb"/>
Oct 25 21:45:48 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:45:48 user nova-compute[74189]:   <serial>b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f</serial>
Oct 25 21:45:48 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:45:48 user nova-compute[74189]: </disk>
Oct 25 21:45:48 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:45:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 915a1d25-6499-4d3e-9edd-5f3cfd487bac {{(pid=74189) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 21:45:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:45:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 21:45:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:45:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:45:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:49 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fff8f286-0baa-4865-994f-4418af3edd0a {{(pid=74189) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 21:45:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:49 user nova-compute[74189]: DEBUG nova.compute.manager [req-608bae13-770b-406e-85e4-3a6c790f98d9 req-46bac667-ad36-4d7d-80f5-d717a4de597e service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Received event network-changed-d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:45:49 user nova-compute[74189]: DEBUG nova.compute.manager [req-608bae13-770b-406e-85e4-3a6c790f98d9 req-46bac667-ad36-4d7d-80f5-d717a4de597e service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Refreshing instance network info cache due to event network-changed-d8084804-8e6e-4787-b331-96822b5ed349. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:45:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-608bae13-770b-406e-85e4-3a6c790f98d9 req-46bac667-ad36-4d7d-80f5-d717a4de597e service nova] Acquiring lock "refresh_cache-915a1d25-6499-4d3e-9edd-5f3cfd487bac" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:45:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-608bae13-770b-406e-85e4-3a6c790f98d9 req-46bac667-ad36-4d7d-80f5-d717a4de597e service nova] Acquired lock "refresh_cache-915a1d25-6499-4d3e-9edd-5f3cfd487bac" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:45:49 user nova-compute[74189]: DEBUG nova.network.neutron [req-608bae13-770b-406e-85e4-3a6c790f98d9 req-46bac667-ad36-4d7d-80f5-d717a4de597e service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Refreshing network info cache for port d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:45:49 user nova-compute[74189]: DEBUG nova.network.neutron [req-608bae13-770b-406e-85e4-3a6c790f98d9 req-46bac667-ad36-4d7d-80f5-d717a4de597e service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Updated VIF entry in instance network info cache for port d8084804-8e6e-4787-b331-96822b5ed349. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:45:49 user nova-compute[74189]: DEBUG nova.network.neutron [req-608bae13-770b-406e-85e4-3a6c790f98d9 req-46bac667-ad36-4d7d-80f5-d717a4de597e service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Updating instance_info_cache with network_info: [{"id": "d8084804-8e6e-4787-b331-96822b5ed349", "address": "fa:16:3e:1c:bf:ba", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8084804-8e", "ovs_interfaceid": "d8084804-8e6e-4787-b331-96822b5ed349", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:45:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-608bae13-770b-406e-85e4-3a6c790f98d9 req-46bac667-ad36-4d7d-80f5-d717a4de597e service nova] Releasing lock "refresh_cache-915a1d25-6499-4d3e-9edd-5f3cfd487bac" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:45:53 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:45:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:45:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 21:45:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:45:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:45:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:46:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 21:46:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:46:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:46:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:08 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 915a1d25-6499-4d3e-9edd-5f3cfd487bac is timed out.
Oct 25 21:46:08 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Successfully detached device vdb from instance 915a1d25-6499-4d3e-9edd-5f3cfd487bac from the live domain config.
Oct 25 21:46:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tCHFjSMp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:46:08 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:46:08 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[84846deb-69be-46e8-adff-7a1f272e2882]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:46:08 user nova-compute[74189]: No targets found.
Oct 25 21:46:08 user nova-compute[74189]: iSNS:
Oct 25 21:46:08 user nova-compute[74189]: No targets found.
Oct 25 21:46:08 user nova-compute[74189]: STATIC:
Oct 25 21:46:08 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29
Oct 25 21:46:08 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:46:08 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:46:08 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f
Oct 25 21:46:08 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:46:08 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:46:08 user nova-compute[74189]: FIRMWARE:
Oct 25 21:46:08 user nova-compute[74189]: No targets found.
Oct 25 21:46:08 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:46:08 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:46:08 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec86f6e0-ee87-420d-86e6-bea85cb5a558]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd31818f-90c4-4537-a0e4-cd9df420bb57]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:46:08 user nova-compute[74189]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f (non-flash)
Oct 25 21:46:08 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 (non-flash)
Oct 25 21:46:08 user nova-compute[74189]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f (non-flash)
Oct 25 21:46:08 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2c471e3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29'): ({'sdc'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Removing single pathed devices sdc {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.055s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f833824-4a4c-4192-8bf6-3dceda8677d6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea07bef-22e3-4823-a23c-a91d6c3b0c5d]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Flushing IO for device /dev/sdc {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[438347e5-7597-4b90-acab-57a92857cbac]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0b2517-2016-428f-8001-6472c30ea9df]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] SCSI volumes sdc have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4039744-89f7-49fd-aedf-c0e5ed0153c3]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[28265c07-a3eb-4926-9248-f985222a333c]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29, portal: 172.16.0.220,3260]
Oct 25 21:46:08 user nova-compute[74189]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29, portal: 172.16.0.220,3260] successful.
Oct 25 21:46:08 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9db1c721-ba3e-4493-8658-9d7ec0a8bc29 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe54d99-771d-45ad-a05a-477be58f17b2]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] <== disconnect_volume: return (328ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:46:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:46:09 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fff8f286-0baa-4865-994f-4418af3edd0a is timed out.
Oct 25 21:46:09 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Successfully detached device vdb from instance fff8f286-0baa-4865-994f-4418af3edd0a from the live domain config.
Oct 25 21:46:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umGcWklA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:46:09 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:46:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fcdc80-1dd3-4f14-ae12-b5fbed67015d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:46:09 user nova-compute[74189]: No targets found.
Oct 25 21:46:09 user nova-compute[74189]: iSNS:
Oct 25 21:46:09 user nova-compute[74189]: No targets found.
Oct 25 21:46:09 user nova-compute[74189]: STATIC:
Oct 25 21:46:09 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f
Oct 25 21:46:09 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:46:09 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:46:09 user nova-compute[74189]: FIRMWARE:
Oct 25 21:46:09 user nova-compute[74189]: No targets found.
Oct 25 21:46:09 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:46:09 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:46:09 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b0c41e-f2f4-4e2b-a073-1c7dd160654d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5f3517-5545-44df-9c66-918d99c1d957]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f (non-flash)
Oct 25 21:46:09 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f (non-flash)
Oct 25 21:46:09 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe30463f5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f'): ({'sdb'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Removing single pathed devices sdb {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4510a569-0294-4768-b9da-ae8acd5c18a8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[36585a0d-5e0e-48d8-8fca-148f5b96624c]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Flushing IO for device /dev/sdb {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0c4e4e-6c6a-448c-b1a7-dfff5faaea47]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ed3b72-3ae7-4629-967b-176063e333b2]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] SCSI volumes sdb have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ed7543-8cb5-4e7d-86a0-b5b4379100a5]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb0a1e8-930e-45b5-9651-7553efda7d99]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f, portal: 172.16.0.220,3260]
Oct 25 21:46:09 user nova-compute[74189]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f, portal: 172.16.0.220,3260] successful.
Oct 25 21:46:09 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ab5cce-ccab-4aba-ae9f-dfb1d725e51f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[211cf0c1-86ba-4202-a938-7a40646ea0d4]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] <== disconnect_volume: return (282ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG nova.objects.instance [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lazy-loading 'flavor' on Instance uuid 915a1d25-6499-4d3e-9edd-5f3cfd487bac {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:46:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9546e51c-46f3-4265-a1cc-3583e66a6af7 tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.892s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:46:10 user nova-compute[74189]: DEBUG nova.objects.instance [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lazy-loading 'flavor' on Instance uuid fff8f286-0baa-4865-994f-4418af3edd0a {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:46:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-47797886-59dc-4056-a501-809bb42fdaf9 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "fff8f286-0baa-4865-994f-4418af3edd0a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.755s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:46:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:46:17 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:46:17 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:46:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-3da14c0a-31a8-4fe3-bd5a-49378680af50" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:46:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-3da14c0a-31a8-4fe3-bd5a-49378680af50" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:46:17 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:46:18 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Updating instance_info_cache with network_info: [{"id": "a5e7898d-caba-49d7-8310-630beb75bf21", "address": "fa:16:3e:9d:7f:d0", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5e7898d-ca", "ovs_interfaceid": "a5e7898d-caba-49d7-8310-630beb75bf21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:46:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-3da14c0a-31a8-4fe3-bd5a-49378680af50" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:46:18 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:46:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Acquiring lock "b3899ed2-d7b4-465b-b512-569898cc46d2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:46:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lock "b3899ed2-d7b4-465b-b512-569898cc46d2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:46:19 user nova-compute[74189]: DEBUG nova.compute.manager [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:46:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:46:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:46:19 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:46:19 user nova-compute[74189]: INFO nova.compute.claims [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Claim successful on node user
Oct 25 21:46:19 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:46:20 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:46:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.376s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:46:20 user nova-compute[74189]: DEBUG nova.compute.manager [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:46:20 user nova-compute[74189]: DEBUG nova.compute.manager [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:46:20 user nova-compute[74189]: DEBUG nova.network.neutron [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:46:20 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:46:20 user nova-compute[74189]: DEBUG nova.compute.manager [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:46:20 user nova-compute[74189]: DEBUG nova.policy [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '06898f18a73c449c95fea8ee727741f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba950bd71349a2bfac732f770a9731', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:46:20 user nova-compute[74189]: DEBUG nova.compute.manager [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:46:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:46:20 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Creating image(s)
Oct 25 21:46:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Acquiring lock "/opt/stack/data/nova/instances/b3899ed2-d7b4-465b-b512-569898cc46d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:46:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lock "/opt/stack/data/nova/instances/b3899ed2-d7b4-465b-b512-569898cc46d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:46:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lock "/opt/stack/data/nova/instances/b3899ed2-d7b4-465b-b512-569898cc46d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:46:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.187s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:46:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:46:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.171s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/b3899ed2-d7b4-465b-b512-569898cc46d2/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/b3899ed2-d7b4-465b-b512-569898cc46d2/disk 1073741824" returned: 0 in 0.059s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:46:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:20 user nova-compute[74189]: DEBUG nova.network.neutron [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Successfully created port: a432e177-4407-4899-8954-9728927b40e0 {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:46:20 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:46:20 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:46:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.194s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:20 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b3899ed2-d7b4-465b-b512-569898cc46d2/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:46:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3899ed2-d7b4-465b-b512-569898cc46d2/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3899ed2-d7b4-465b-b512-569898cc46d2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Cannot resize image /opt/stack/data/nova/instances/b3899ed2-d7b4-465b-b512-569898cc46d2/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Ensure instance console log exists: /opt/stack/data/nova/instances/b3899ed2-d7b4-465b-b512-569898cc46d2/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.network.neutron [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Successfully updated port: a432e177-4407-4899-8954-9728927b40e0 {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Acquiring lock "refresh_cache-b3899ed2-d7b4-465b-b512-569898cc46d2" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Acquired lock "refresh_cache-b3899ed2-d7b4-465b-b512-569898cc46d2" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.network.neutron [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.compute.manager [req-3a95933f-2dfa-4c3f-8244-cb3fee3efa49 req-d028b75c-13c0-4f0e-a49b-5cf6c060d7ce service nova] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Received event network-changed-a432e177-4407-4899-8954-9728927b40e0 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.compute.manager [req-3a95933f-2dfa-4c3f-8244-cb3fee3efa49 req-d028b75c-13c0-4f0e-a49b-5cf6c060d7ce service nova] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Refreshing instance network info cache due to event network-changed-a432e177-4407-4899-8954-9728927b40e0. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3a95933f-2dfa-4c3f-8244-cb3fee3efa49 req-d028b75c-13c0-4f0e-a49b-5cf6c060d7ce service nova] Acquiring lock "refresh_cache-b3899ed2-d7b4-465b-b512-569898cc46d2" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.network.neutron [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.network.neutron [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Updating instance_info_cache with network_info: [{"id": "a432e177-4407-4899-8954-9728927b40e0", "address": "fa:16:3e:3a:ba:54", "network": {"id": "9fd8198e-7326-4533-a88c-c4ca629214d6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-40841454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9ba950bd71349a2bfac732f770a9731", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa432e177-44", "ovs_interfaceid": "a432e177-4407-4899-8954-9728927b40e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Releasing lock "refresh_cache-b3899ed2-d7b4-465b-b512-569898cc46d2" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.compute.manager [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Instance network_info: |[{"id": "a432e177-4407-4899-8954-9728927b40e0", "address": "fa:16:3e:3a:ba:54", "network": {"id": "9fd8198e-7326-4533-a88c-c4ca629214d6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-40841454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9ba950bd71349a2bfac732f770a9731", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa432e177-44", "ovs_interfaceid": "a432e177-4407-4899-8954-9728927b40e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3a95933f-2dfa-4c3f-8244-cb3fee3efa49 req-d028b75c-13c0-4f0e-a49b-5cf6c060d7ce service nova] Acquired lock "refresh_cache-b3899ed2-d7b4-465b-b512-569898cc46d2" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.network.neutron [req-3a95933f-2dfa-4c3f-8244-cb3fee3efa49 req-d028b75c-13c0-4f0e-a49b-5cf6c060d7ce service nova] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Refreshing network info cache for port a432e177-4407-4899-8954-9728927b40e0 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Start _get_guest_xml network_info=[{"id": "a432e177-4407-4899-8954-9728927b40e0", "address": "fa:16:3e:3a:ba:54", "network": {"id": "9fd8198e-7326-4533-a88c-c4ca629214d6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-40841454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9ba950bd71349a2bfac732f770a9731", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa432e177-44", "ovs_interfaceid": "a432e177-4407-4899-8954-9728927b40e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:46:21 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:46:21 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1389553397',display_name='tempest-VolumesActionsTest-instance-1389553397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1389553397',id=49,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9ba950bd71349a2bfac732f770a9731',ramdisk_id='',reservation_id='r-wuaozcis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-159377188',owner_user_name='tempest-VolumesActionsTest-159377188-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:46:20Z,user_data=None,user_id='06898f18a73c449c95fea8ee727741f0',uuid=b3899ed2-d7b4-465b-b512-569898cc46d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a432e177-4407-4899-8954-9728927b40e0", "address": "fa:16:3e:3a:ba:54", "network": {"id": "9fd8198e-7326-4533-a88c-c4ca629214d6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-40841454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9ba950bd71349a2bfac732f770a9731", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa432e177-44", "ovs_interfaceid": "a432e177-4407-4899-8954-9728927b40e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Converting VIF {"id": "a432e177-4407-4899-8954-9728927b40e0", "address": "fa:16:3e:3a:ba:54", "network": {"id": "9fd8198e-7326-4533-a88c-c4ca629214d6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-40841454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9ba950bd71349a2bfac732f770a9731", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa432e177-44", "ovs_interfaceid": "a432e177-4407-4899-8954-9728927b40e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ba:54,bridge_name='br-int',has_traffic_filtering=True,id=a432e177-4407-4899-8954-9728927b40e0,network=Network(9fd8198e-7326-4533-a88c-c4ca629214d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa432e177-44') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.objects.instance [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lazy-loading 'pci_devices' on Instance uuid b3899ed2-d7b4-465b-b512-569898cc46d2 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:46:21 user nova-compute[74189]:   <uuid>b3899ed2-d7b4-465b-b512-569898cc46d2</uuid>
Oct 25 21:46:21 user nova-compute[74189]:   <name>instance-00000031</name>
Oct 25 21:46:21 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:46:21 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:46:21 user nova-compute[74189]:   <metadata>
Oct 25 21:46:21 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:46:21 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:46:21 user nova-compute[74189]:       <nova:name>tempest-VolumesActionsTest-instance-1389553397</nova:name>
Oct 25 21:46:21 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:46:21</nova:creationTime>
Oct 25 21:46:21 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:46:21 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:46:21 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:46:21 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:46:21 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:46:21 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:46:21 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:46:21 user nova-compute[74189]:       <nova:owner>
Oct 25 21:46:21 user nova-compute[74189]:         <nova:user uuid="06898f18a73c449c95fea8ee727741f0">tempest-VolumesActionsTest-159377188-project-member</nova:user>
Oct 25 21:46:21 user nova-compute[74189]:         <nova:project uuid="e9ba950bd71349a2bfac732f770a9731">tempest-VolumesActionsTest-159377188</nova:project>
Oct 25 21:46:21 user nova-compute[74189]:       </nova:owner>
Oct 25 21:46:21 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:46:21 user nova-compute[74189]:       <nova:ports>
Oct 25 21:46:21 user nova-compute[74189]:         <nova:port uuid="a432e177-4407-4899-8954-9728927b40e0">
Oct 25 21:46:21 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 21:46:21 user nova-compute[74189]:         </nova:port>
Oct 25 21:46:21 user nova-compute[74189]:       </nova:ports>
Oct 25 21:46:21 user nova-compute[74189]:     </nova:instance>
Oct 25 21:46:21 user nova-compute[74189]:   </metadata>
Oct 25 21:46:21 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:46:21 user nova-compute[74189]:     <system>
Oct 25 21:46:21 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:46:21 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:46:21 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:46:21 user nova-compute[74189]:       <entry name="serial">b3899ed2-d7b4-465b-b512-569898cc46d2</entry>
Oct 25 21:46:21 user nova-compute[74189]:       <entry name="uuid">b3899ed2-d7b4-465b-b512-569898cc46d2</entry>
Oct 25 21:46:21 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:46:21 user nova-compute[74189]:     </system>
Oct 25 21:46:21 user nova-compute[74189]:   </sysinfo>
Oct 25 21:46:21 user nova-compute[74189]:   <os>
Oct 25 21:46:21 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:46:21 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:46:21 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:46:21 user nova-compute[74189]:   </os>
Oct 25 21:46:21 user nova-compute[74189]:   <features>
Oct 25 21:46:21 user nova-compute[74189]:     <acpi/>
Oct 25 21:46:21 user nova-compute[74189]:     <apic/>
Oct 25 21:46:21 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:46:21 user nova-compute[74189]:   </features>
Oct 25 21:46:21 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:46:21 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:46:21 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:46:21 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:46:21 user nova-compute[74189]:   </clock>
Oct 25 21:46:21 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:46:21 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:46:21 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:46:21 user nova-compute[74189]:   </cpu>
Oct 25 21:46:21 user nova-compute[74189]:   <devices>
Oct 25 21:46:21 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:46:21 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:46:21 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/b3899ed2-d7b4-465b-b512-569898cc46d2/disk"/>
Oct 25 21:46:21 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:46:21 user nova-compute[74189]:     </disk>
Oct 25 21:46:21 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:46:21 user nova-compute[74189]:       <mac address="fa:16:3e:3a:ba:54"/>
Oct 25 21:46:21 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:46:21 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:46:21 user nova-compute[74189]:       <target dev="tapa432e177-44"/>
Oct 25 21:46:21 user nova-compute[74189]:     </interface>
Oct 25 21:46:21 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:46:21 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/b3899ed2-d7b4-465b-b512-569898cc46d2/console.log" append="off"/>
Oct 25 21:46:21 user nova-compute[74189]:     </serial>
Oct 25 21:46:21 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:46:21 user nova-compute[74189]:     <video>
Oct 25 21:46:21 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:46:21 user nova-compute[74189]:     </video>
Oct 25 21:46:21 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:46:21 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:46:21 user nova-compute[74189]:     </rng>
Oct 25 21:46:21 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:46:21 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:46:21 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:46:21 user nova-compute[74189]:     </memballoon>
Oct 25 21:46:21 user nova-compute[74189]:   </devices>
Oct 25 21:46:21 user nova-compute[74189]: </domain>
Oct 25 21:46:21 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1389553397',display_name='tempest-VolumesActionsTest-instance-1389553397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1389553397',id=49,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9ba950bd71349a2bfac732f770a9731',ramdisk_id='',reservation_id='r-wuaozcis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-159377188',owner_user_name='tempest-VolumesActionsTest-159377188-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:46:20Z,user_data=None,user_id='06898f18a73c449c95fea8ee727741f0',uuid=b3899ed2-d7b4-465b-b512-569898cc46d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a432e177-4407-4899-8954-9728927b40e0", "address": "fa:16:3e:3a:ba:54", "network": {"id": "9fd8198e-7326-4533-a88c-c4ca629214d6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-40841454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9ba950bd71349a2bfac732f770a9731", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa432e177-44", "ovs_interfaceid": "a432e177-4407-4899-8954-9728927b40e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Converting VIF {"id": "a432e177-4407-4899-8954-9728927b40e0", "address": "fa:16:3e:3a:ba:54", "network": {"id": "9fd8198e-7326-4533-a88c-c4ca629214d6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-40841454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9ba950bd71349a2bfac732f770a9731", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa432e177-44", "ovs_interfaceid": "a432e177-4407-4899-8954-9728927b40e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ba:54,bridge_name='br-int',has_traffic_filtering=True,id=a432e177-4407-4899-8954-9728927b40e0,network=Network(9fd8198e-7326-4533-a88c-c4ca629214d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa432e177-44') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG os_vif [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ba:54,bridge_name='br-int',has_traffic_filtering=True,id=a432e177-4407-4899-8954-9728927b40e0,network=Network(9fd8198e-7326-4533-a88c-c4ca629214d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa432e177-44') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48f71550-708f-57bd-99b5-a04493868aca', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa432e177-44, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa432e177-44, col_values=(('qos', UUID('59904318-1c48-4133-9a83-508b6e2fbb46')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa432e177-44, col_values=(('external_ids', {'iface-id': 'a432e177-4407-4899-8954-9728927b40e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:ba:54', 'vm-uuid': 'b3899ed2-d7b4-465b-b512-569898cc46d2'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:46:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:21 user nova-compute[74189]: INFO os_vif [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ba:54,bridge_name='br-int',has_traffic_filtering=True,id=a432e177-4407-4899-8954-9728927b40e0,network=Network(9fd8198e-7326-4533-a88c-c4ca629214d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa432e177-44')
Oct 25 21:46:22 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:46:22 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] No VIF found with MAC fa:16:3e:3a:ba:54, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:46:22 user nova-compute[74189]: DEBUG nova.network.neutron [req-3a95933f-2dfa-4c3f-8244-cb3fee3efa49 req-d028b75c-13c0-4f0e-a49b-5cf6c060d7ce service nova] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Updated VIF entry in instance network info cache for port a432e177-4407-4899-8954-9728927b40e0. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:46:22 user nova-compute[74189]: DEBUG nova.network.neutron [req-3a95933f-2dfa-4c3f-8244-cb3fee3efa49 req-d028b75c-13c0-4f0e-a49b-5cf6c060d7ce service nova] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Updating instance_info_cache with network_info: [{"id": "a432e177-4407-4899-8954-9728927b40e0", "address": "fa:16:3e:3a:ba:54", "network": {"id": "9fd8198e-7326-4533-a88c-c4ca629214d6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-40841454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9ba950bd71349a2bfac732f770a9731", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa432e177-44", "ovs_interfaceid": "a432e177-4407-4899-8954-9728927b40e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:46:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3a95933f-2dfa-4c3f-8244-cb3fee3efa49 req-d028b75c-13c0-4f0e-a49b-5cf6c060d7ce service nova] Releasing lock "refresh_cache-b3899ed2-d7b4-465b-b512-569898cc46d2" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:46:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:23 user nova-compute[74189]: DEBUG nova.compute.manager [req-d384c775-fc45-4339-ab72-b84ca1d035cc req-6f33beb8-cbaa-43a9-88b8-0fe9676fb746 service nova] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Received event network-vif-plugged-a432e177-4407-4899-8954-9728927b40e0 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:46:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d384c775-fc45-4339-ab72-b84ca1d035cc req-6f33beb8-cbaa-43a9-88b8-0fe9676fb746 service nova] Acquiring lock "b3899ed2-d7b4-465b-b512-569898cc46d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:46:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d384c775-fc45-4339-ab72-b84ca1d035cc req-6f33beb8-cbaa-43a9-88b8-0fe9676fb746 service nova] Lock "b3899ed2-d7b4-465b-b512-569898cc46d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:46:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d384c775-fc45-4339-ab72-b84ca1d035cc req-6f33beb8-cbaa-43a9-88b8-0fe9676fb746 service nova] Lock "b3899ed2-d7b4-465b-b512-569898cc46d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:46:23 user nova-compute[74189]: DEBUG nova.compute.manager [req-d384c775-fc45-4339-ab72-b84ca1d035cc req-6f33beb8-cbaa-43a9-88b8-0fe9676fb746 service nova] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] No waiting events found dispatching network-vif-plugged-a432e177-4407-4899-8954-9728927b40e0 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:46:23 user nova-compute[74189]: WARNING nova.compute.manager [req-d384c775-fc45-4339-ab72-b84ca1d035cc req-6f33beb8-cbaa-43a9-88b8-0fe9676fb746 service nova] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Received unexpected event network-vif-plugged-a432e177-4407-4899-8954-9728927b40e0 for instance with vm_state building and task_state spawning.
Oct 25 21:46:23 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:46:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:46:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:46:23 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:46:23 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG nova.compute.manager [req-64917f27-27de-4bcf-b7df-3cea00e3938b req-fd4a04fa-440e-4cb9-8999-dad1f26faeda service nova] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Received event network-changed-e9e74d39-f7ae-498a-932c-65c2639a3efe {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG nova.compute.manager [req-64917f27-27de-4bcf-b7df-3cea00e3938b req-fd4a04fa-440e-4cb9-8999-dad1f26faeda service nova] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Refreshing instance network info cache due to event network-changed-e9e74d39-f7ae-498a-932c-65c2639a3efe. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-64917f27-27de-4bcf-b7df-3cea00e3938b req-fd4a04fa-440e-4cb9-8999-dad1f26faeda service nova] Acquiring lock "refresh_cache-14e9c813-2486-4840-b18c-65ca237a8ebf" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-64917f27-27de-4bcf-b7df-3cea00e3938b req-fd4a04fa-440e-4cb9-8999-dad1f26faeda service nova] Acquired lock "refresh_cache-14e9c813-2486-4840-b18c-65ca237a8ebf" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG nova.network.neutron [req-64917f27-27de-4bcf-b7df-3cea00e3938b req-fd4a04fa-440e-4cb9-8999-dad1f26faeda service nova] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Refreshing network info cache for port e9e74d39-f7ae-498a-932c-65c2639a3efe {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3899ed2-d7b4-465b-b512-569898cc46d2/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Acquiring lock "14e9c813-2486-4840-b18c-65ca237a8ebf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "14e9c813-2486-4840-b18c-65ca237a8ebf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG nova.objects.instance [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lazy-loading 'flavor' on Instance uuid 14e9c813-2486-4840-b18c-65ca237a8ebf {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3899ed2-d7b4-465b-b512-569898cc46d2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3899ed2-d7b4-465b-b512-569898cc46d2/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:24 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Ignoring supplied device name: /dev/vdb
Oct 25 21:46:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "14e9c813-2486-4840-b18c-65ca237a8ebf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.102s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3899ed2-d7b4-465b-b512-569898cc46d2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Acquiring lock "14e9c813-2486-4840-b18c-65ca237a8ebf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "14e9c813-2486-4840-b18c-65ca237a8ebf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:46:24 user nova-compute[74189]: INFO nova.compute.manager [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Attaching volume 735274f9-b4e1-4d2c-ac64-809a9aca8d08 to /dev/vdb
Oct 25 21:46:24 user nova-compute[74189]: DEBUG nova.network.neutron [req-64917f27-27de-4bcf-b7df-3cea00e3938b req-fd4a04fa-440e-4cb9-8999-dad1f26faeda service nova] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Updated VIF entry in instance network info cache for port e9e74d39-f7ae-498a-932c-65c2639a3efe. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG nova.network.neutron [req-64917f27-27de-4bcf-b7df-3cea00e3938b req-fd4a04fa-440e-4cb9-8999-dad1f26faeda service nova] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Updating instance_info_cache with network_info: [{"id": "e9e74d39-f7ae-498a-932c-65c2639a3efe", "address": "fa:16:3e:6a:f3:d2", "network": {"id": "27a00d33-61db-45a8-a945-cd8514be6344", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1691303850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff1b56c6086e4a41bf9a98b96101531e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e74d39-f7", "ovs_interfaceid": "e9e74d39-f7ae-498a-932c-65c2639a3efe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-64917f27-27de-4bcf-b7df-3cea00e3938b req-fd4a04fa-440e-4cb9-8999-dad1f26faeda service nova] Releasing lock "refresh_cache-14e9c813-2486-4840-b18c-65ca237a8ebf" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG os_brick.utils [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5a95f6-4136-4871-ac31-e3e548a5a4e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[642aac30-05a1-4520-a82a-48828c217319]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d47301c-14d8-420e-8d4a-461b87d4d35b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[738a91c5-1a13-49f8-bd5f-e5dcd3c312ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:46:24 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:46:24 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec9f988-c9ed-4fea-9bf3-07b4d2e12929]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG os_brick.utils [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Updating existing volume attachment record: 4a04124c-d491-4ae9-8c01-51c1db0c52f2 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:24 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:25 user nova-compute[74189]: DEBUG nova.compute.manager [req-6c15a1f2-9775-47ca-a628-0c67ccefd6a9 req-eea49831-0475-4b11-8c89-8d6057fae3c6 service nova] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Received event network-vif-plugged-a432e177-4407-4899-8954-9728927b40e0 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:46:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-6c15a1f2-9775-47ca-a628-0c67ccefd6a9 req-eea49831-0475-4b11-8c89-8d6057fae3c6 service nova] Acquiring lock "b3899ed2-d7b4-465b-b512-569898cc46d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:46:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-6c15a1f2-9775-47ca-a628-0c67ccefd6a9 req-eea49831-0475-4b11-8c89-8d6057fae3c6 service nova] Lock "b3899ed2-d7b4-465b-b512-569898cc46d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:46:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-6c15a1f2-9775-47ca-a628-0c67ccefd6a9 req-eea49831-0475-4b11-8c89-8d6057fae3c6 service nova] Lock "b3899ed2-d7b4-465b-b512-569898cc46d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:46:25 user nova-compute[74189]: DEBUG nova.compute.manager [req-6c15a1f2-9775-47ca-a628-0c67ccefd6a9 req-eea49831-0475-4b11-8c89-8d6057fae3c6 service nova] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] No waiting events found dispatching network-vif-plugged-a432e177-4407-4899-8954-9728927b40e0 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:46:25 user nova-compute[74189]: WARNING nova.compute.manager [req-6c15a1f2-9775-47ca-a628-0c67ccefd6a9 req-eea49831-0475-4b11-8c89-8d6057fae3c6 service nova] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Received unexpected event network-vif-plugged-a432e177-4407-4899-8954-9728927b40e0 for instance with vm_state building and task_state spawning.
Oct 25 21:46:25 user nova-compute[74189]: DEBUG nova.compute.manager [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:46:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:46:25 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Instance spawned successfully.
Oct 25 21:46:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:46:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:46:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:46:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:46:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:46:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:46:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:46:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:25 user nova-compute[74189]: INFO nova.compute.manager [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Took 5.68 seconds to spawn the instance on the hypervisor.
Oct 25 21:46:25 user nova-compute[74189]: DEBUG nova.compute.manager [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:46:26 user nova-compute[74189]: INFO nova.compute.manager [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Took 6.43 seconds to build instance.
Oct 25 21:46:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-d95bd892-c01e-46b2-8800-b18570a62a58 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lock "b3899ed2-d7b4-465b-b512-569898cc46d2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.516s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:46:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e9c813-2486-4840-b18c-65ca237a8ebf/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e9c813-2486-4840-b18c-65ca237a8ebf/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e9c813-2486-4840-b18c-65ca237a8ebf/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e9c813-2486-4840-b18c-65ca237a8ebf/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-fa4a102a-17b4-496b-a9fc-05c5eda8588d req-cfc3786f-8dea-4150-8fac-0a41acf78a4b service nova] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Received event network-changed-e05cb4c8-e712-4628-9d3d-a72653f19860 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:46:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-fa4a102a-17b4-496b-a9fc-05c5eda8588d req-cfc3786f-8dea-4150-8fac-0a41acf78a4b service nova] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Refreshing instance network info cache due to event network-changed-e05cb4c8-e712-4628-9d3d-a72653f19860. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:46:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-fa4a102a-17b4-496b-a9fc-05c5eda8588d req-cfc3786f-8dea-4150-8fac-0a41acf78a4b service nova] Acquiring lock "refresh_cache-0b5d04c5-dfae-42de-84b9-2fab02e3d679" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:46:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-fa4a102a-17b4-496b-a9fc-05c5eda8588d req-cfc3786f-8dea-4150-8fac-0a41acf78a4b service nova] Acquired lock "refresh_cache-0b5d04c5-dfae-42de-84b9-2fab02e3d679" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:46:27 user nova-compute[74189]: DEBUG nova.network.neutron [req-fa4a102a-17b4-496b-a9fc-05c5eda8588d req-cfc3786f-8dea-4150-8fac-0a41acf78a4b service nova] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Refreshing network info cache for port e05cb4c8-e712-4628-9d3d-a72653f19860 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:46:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Acquiring lock "0b5d04c5-dfae-42de-84b9-2fab02e3d679" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:46:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "0b5d04c5-dfae-42de-84b9-2fab02e3d679" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:46:27 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:46:27 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:46:27 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=8121MB free_disk=24.921432495117188GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:46:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:46:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:46:27 user nova-compute[74189]: DEBUG nova.objects.instance [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lazy-loading 'flavor' on Instance uuid 0b5d04c5-dfae-42de-84b9-2fab02e3d679 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:46:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "0b5d04c5-dfae-42de-84b9-2fab02e3d679" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.101s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3da14c0a-31a8-4fe3-bd5a-49378680af50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 915a1d25-6499-4d3e-9edd-5f3cfd487bac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance fff8f286-0baa-4865-994f-4418af3edd0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 14e9c813-2486-4840-b18c-65ca237a8ebf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 0b5d04c5-dfae-42de-84b9-2fab02e3d679 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance b3899ed2-d7b4-465b-b512-569898cc46d2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Acquiring lock "0b5d04c5-dfae-42de-84b9-2fab02e3d679" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "0b5d04c5-dfae-42de-84b9-2fab02e3d679" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:46:28 user nova-compute[74189]: INFO nova.compute.manager [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Attaching volume 5219ef1f-b2f8-4708-9566-da6bc1a52de8 to /dev/vdb
Oct 25 21:46:28 user nova-compute[74189]: DEBUG os_brick.utils [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb95672-14c9-450d-a1aa-5b2f0b26a130]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[346d82f6-c398-42f7-944d-7cbd5e474c1c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7909f8-51c1-4d36-b283-7767f2827568]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG nova.network.neutron [req-fa4a102a-17b4-496b-a9fc-05c5eda8588d req-cfc3786f-8dea-4150-8fac-0a41acf78a4b service nova] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Updated VIF entry in instance network info cache for port e05cb4c8-e712-4628-9d3d-a72653f19860. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG nova.network.neutron [req-fa4a102a-17b4-496b-a9fc-05c5eda8588d req-cfc3786f-8dea-4150-8fac-0a41acf78a4b service nova] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Updating instance_info_cache with network_info: [{"id": "e05cb4c8-e712-4628-9d3d-a72653f19860", "address": "fa:16:3e:dc:d9:66", "network": {"id": "d2a72b33-1451-4343-a1ac-3e7cb75ec083", "bridge": "br-int", "label": "tempest-TestStampPattern-234506410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6a19ad6e8249abbe10137bdad65ca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05cb4c8-e7", "ovs_interfaceid": "e05cb4c8-e712-4628-9d3d-a72653f19860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c73e5a3-9142-439b-bb27-6295eaa612ef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-fa4a102a-17b4-496b-a9fc-05c5eda8588d req-cfc3786f-8dea-4150-8fac-0a41acf78a4b service nova] Releasing lock "refresh_cache-0b5d04c5-dfae-42de-84b9-2fab02e3d679" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.523s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:46:28 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:46:28 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9336f7e-b7ac-4f13-86b4-85d206a2a347]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG os_brick.utils [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:46:28 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Updating existing volume attachment record: 9d114d1f-0887-45fb-9b36-c3ecfa6a525f {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:46:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:29 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:46:29 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:46:29 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:46:29 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:46:29 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:46:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:32 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:46:33 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:46:33 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:46:33 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Cleaning up deleted instances {{(pid=74189) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 21:46:33 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] There are 0 instances to clean {{(pid=74189) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 21:46:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:34 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:46:34 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74189) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 21:46:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-cfee6198-2028-488d-ac81-135e266eb49e tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:46:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-cfee6198-2028-488d-ac81-135e266eb49e tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:46:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-cfee6198-2028-488d-ac81-135e266eb49e tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:46:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-cfee6198-2028-488d-ac81-135e266eb49e tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:46:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-cfee6198-2028-488d-ac81-135e266eb49e tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:46:38 user nova-compute[74189]: INFO nova.compute.manager [None req-cfee6198-2028-488d-ac81-135e266eb49e tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Terminating instance
Oct 25 21:46:38 user nova-compute[74189]: DEBUG nova.compute.manager [None req-cfee6198-2028-488d-ac81-135e266eb49e tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:46:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:38 user nova-compute[74189]: DEBUG nova.compute.manager [req-f31a9fd6-891c-4d87-abd8-b32d85873cb6 req-8f635981-df99-4b8c-8cb0-d598f4b03521 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Received event network-vif-unplugged-d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:46:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f31a9fd6-891c-4d87-abd8-b32d85873cb6 req-8f635981-df99-4b8c-8cb0-d598f4b03521 service nova] Acquiring lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:46:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f31a9fd6-891c-4d87-abd8-b32d85873cb6 req-8f635981-df99-4b8c-8cb0-d598f4b03521 service nova] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:46:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f31a9fd6-891c-4d87-abd8-b32d85873cb6 req-8f635981-df99-4b8c-8cb0-d598f4b03521 service nova] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:46:38 user nova-compute[74189]: DEBUG nova.compute.manager [req-f31a9fd6-891c-4d87-abd8-b32d85873cb6 req-8f635981-df99-4b8c-8cb0-d598f4b03521 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] No waiting events found dispatching network-vif-unplugged-d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:46:38 user nova-compute[74189]: DEBUG nova.compute.manager [req-f31a9fd6-891c-4d87-abd8-b32d85873cb6 req-8f635981-df99-4b8c-8cb0-d598f4b03521 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Received event network-vif-unplugged-d8084804-8e6e-4787-b331-96822b5ed349 for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:46:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:39 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Instance destroyed successfully.
Oct 25 21:46:39 user nova-compute[74189]: DEBUG nova.objects.instance [None req-cfee6198-2028-488d-ac81-135e266eb49e tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lazy-loading 'resources' on Instance uuid 915a1d25-6499-4d3e-9edd-5f3cfd487bac {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:46:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-cfee6198-2028-488d-ac81-135e266eb49e tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1472118533',display_name='tempest-ServerRescueNegativeTestJSON-server-1472118533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1472118533',id=44,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0nf2hM/WlDG+sQ+FxLN/EMmeMuByeyGz9+k278o6v87wvvWwukeL2QOlXyvE/n9zyiGco1JHpAvDrdVaXClm1csDAdyWDdcVv33SghS4TAVXWuVSS44IvuXUNWj1aXVw==',key_name='tempest-keypair-426278292',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:42:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3df03fc18fc3467db76e336c6de78c92',ramdisk_id='',reservation_id='r-qa2hot3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-383982506',owner_user_name='tempest-ServerRescueNegativeTestJSON-383982506-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:44:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='155c948b95c64c9083da984cdf6af494',uuid=915a1d25-6499-4d3e-9edd-5f3cfd487bac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8084804-8e6e-4787-b331-96822b5ed349", "address": "fa:16:3e:1c:bf:ba", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8084804-8e", "ovs_interfaceid": "d8084804-8e6e-4787-b331-96822b5ed349", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:46:39 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-cfee6198-2028-488d-ac81-135e266eb49e tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Converting VIF {"id": "d8084804-8e6e-4787-b331-96822b5ed349", "address": "fa:16:3e:1c:bf:ba", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8084804-8e", "ovs_interfaceid": "d8084804-8e6e-4787-b331-96822b5ed349", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:46:39 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-cfee6198-2028-488d-ac81-135e266eb49e tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:bf:ba,bridge_name='br-int',has_traffic_filtering=True,id=d8084804-8e6e-4787-b331-96822b5ed349,network=Network(b496a106-2367-44dc-a788-bcd22ec98feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8084804-8e') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:46:39 user nova-compute[74189]: DEBUG os_vif [None req-cfee6198-2028-488d-ac81-135e266eb49e tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:bf:ba,bridge_name='br-int',has_traffic_filtering=True,id=d8084804-8e6e-4787-b331-96822b5ed349,network=Network(b496a106-2367-44dc-a788-bcd22ec98feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8084804-8e') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:46:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8084804-8e, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:46:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab94d5ae-5583-4678-a7d5-b6e36cc7923f) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:46:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:39 user nova-compute[74189]: INFO os_vif [None req-cfee6198-2028-488d-ac81-135e266eb49e tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:bf:ba,bridge_name='br-int',has_traffic_filtering=True,id=d8084804-8e6e-4787-b331-96822b5ed349,network=Network(b496a106-2367-44dc-a788-bcd22ec98feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8084804-8e')
Oct 25 21:46:39 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-cfee6198-2028-488d-ac81-135e266eb49e tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Deleting instance files /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac_del
Oct 25 21:46:39 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-cfee6198-2028-488d-ac81-135e266eb49e tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Deletion of /opt/stack/data/nova/instances/915a1d25-6499-4d3e-9edd-5f3cfd487bac_del complete
Oct 25 21:46:39 user nova-compute[74189]: INFO nova.compute.manager [None req-cfee6198-2028-488d-ac81-135e266eb49e tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Took 1.15 seconds to destroy the instance on the hypervisor.
Oct 25 21:46:39 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-cfee6198-2028-488d-ac81-135e266eb49e tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:46:39 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:46:39 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:46:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:40 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:46:40 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Took 1.23 seconds to deallocate network for instance.
Oct 25 21:46:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-cfee6198-2028-488d-ac81-135e266eb49e tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:46:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-cfee6198-2028-488d-ac81-135e266eb49e tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:46:41 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-cfee6198-2028-488d-ac81-135e266eb49e tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:46:41 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-cfee6198-2028-488d-ac81-135e266eb49e tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:46:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-cfee6198-2028-488d-ac81-135e266eb49e tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:46:41 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-cfee6198-2028-488d-ac81-135e266eb49e tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Deleted allocations for instance 915a1d25-6499-4d3e-9edd-5f3cfd487bac
Oct 25 21:46:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-cfee6198-2028-488d-ac81-135e266eb49e tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.893s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:46:41 user nova-compute[74189]: DEBUG nova.compute.manager [req-8a2ccf32-a3f4-4531-ade3-7d9a2750ec6b req-b1c3799b-484a-45a1-a201-5a403e211c75 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Received event network-vif-plugged-d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:46:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8a2ccf32-a3f4-4531-ade3-7d9a2750ec6b req-b1c3799b-484a-45a1-a201-5a403e211c75 service nova] Acquiring lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:46:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8a2ccf32-a3f4-4531-ade3-7d9a2750ec6b req-b1c3799b-484a-45a1-a201-5a403e211c75 service nova] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:46:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8a2ccf32-a3f4-4531-ade3-7d9a2750ec6b req-b1c3799b-484a-45a1-a201-5a403e211c75 service nova] Lock "915a1d25-6499-4d3e-9edd-5f3cfd487bac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:46:41 user nova-compute[74189]: DEBUG nova.compute.manager [req-8a2ccf32-a3f4-4531-ade3-7d9a2750ec6b req-b1c3799b-484a-45a1-a201-5a403e211c75 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] No waiting events found dispatching network-vif-plugged-d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:46:41 user nova-compute[74189]: WARNING nova.compute.manager [req-8a2ccf32-a3f4-4531-ade3-7d9a2750ec6b req-b1c3799b-484a-45a1-a201-5a403e211c75 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Received unexpected event network-vif-plugged-d8084804-8e6e-4787-b331-96822b5ed349 for instance with vm_state deleted and task_state None.
Oct 25 21:46:41 user nova-compute[74189]: DEBUG nova.compute.manager [req-8a2ccf32-a3f4-4531-ade3-7d9a2750ec6b req-b1c3799b-484a-45a1-a201-5a403e211c75 service nova] [instance: 915a1d25-6499-4d3e-9edd-5f3cfd487bac] Received event network-vif-deleted-d8084804-8e6e-4787-b331-96822b5ed349 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:46:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:46:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CMOzvXUm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:46:43 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:46:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:46:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:46:43 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:46:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:46:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:46:43 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:46:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:43 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1088883-ecd2-464b-8d21-66fffe4282e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:46:43 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:46:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:43 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6826caa-7237-4ae6-9724-80a761e70ac6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08] added
Oct 25 21:46:43 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:46:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:43 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5954657-0ac2-4d6f-a911-05384a2a27b0]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:46:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:43 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[65138690-7db1-4a05-9381-f05264103d93]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:46:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CMOzvXUm {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CMOzvXUm" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:43 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2100c1d2-80a8-4aae-97e5-acde10295c18]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CMOzvXUm'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:46:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Acquiring lock "fff8f286-0baa-4865-994f-4418af3edd0a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:46:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "fff8f286-0baa-4865-994f-4418af3edd0a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:46:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:43 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c63288-abfa-488a-af30-38821dcc597d]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:43 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:46:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:43 user nova-compute[74189]: DEBUG nova.objects.instance [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lazy-loading 'flavor' on Instance uuid fff8f286-0baa-4865-994f-4418af3edd0a {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f7d444-8d53-4b61-9110-755c0597394f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 21:46:44 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 21:46:44 user nova-compute[74189]:  {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:46:44 user nova-compute[74189]: WARNING os_brick.initiator.connectors.iscsi [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 21:46:44 user nova-compute[74189]: 
Oct 25 21:46:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "fff8f286-0baa-4865-994f-4418af3edd0a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd519077-76f3-4fb0-bf6d-8921308e4e81]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08, portal: 172.16.0.220,3260]
Oct 25 21:46:44 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08, portal: 172.16.0.220,3260] successful.
Oct 25 21:46:44 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0960a60-bc53-4b46-a15c-455b9e60039f]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9688b281-9640-4427-b2db-3b448fd17f22]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 (non-flash)
Oct 25 21:46:44 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 (non-flash)
Oct 25 21:46:44 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[705a3848-5e88-415e-9e6a-0cd27de82cc0]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Acquiring lock "fff8f286-0baa-4865-994f-4418af3edd0a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "fff8f286-0baa-4865-994f-4418af3edd0a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:46:44 user nova-compute[74189]: INFO nova.compute.manager [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Attaching volume f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0 to /dev/vdb
Oct 25 21:46:44 user nova-compute[74189]: DEBUG os_brick.utils [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36e8128-e33c-4e7b-9e80-b6fdf9fe7cd8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf449fc-e656-4c36-a8ed-afa22d5e4869]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ea71ff-0e52-4116-8d73-1e19f69b3d41]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c5cc1a-a5e9-46ca-9267-77e23db560bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:46:44 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:46:44 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f73f543-d770-46d6-99ed-63afa8876ece]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG os_brick.utils [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:46:44 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Updating existing volume attachment record: 1447c031-0400-4ae3-ac50-493d3f905d5f {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:46:45 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:46:45 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CMOzvXUm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:46:45 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:46:45 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26662643538663531', 'path': '/dev/sdb'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:46:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662643538663531', 'path': '/dev/sdb'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:46:45 user nova-compute[74189]: DEBUG nova.objects.instance [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lazy-loading 'flavor' on Instance uuid 14e9c813-2486-4840-b18c-65ca237a8ebf {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:46:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 21:46:45 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:46:45 user nova-compute[74189]:   <source dev="/dev/sdb"/>
Oct 25 21:46:45 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:46:45 user nova-compute[74189]:   <serial>735274f9-b4e1-4d2c-ac64-809a9aca8d08</serial>
Oct 25 21:46:45 user nova-compute[74189]: </disk>
Oct 25 21:46:45 user nova-compute[74189]:  {{(pid=74189) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 21:46:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:46:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:46:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] No VIF found with MAC fa:16:3e:6a:f3:d2, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:46:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5fa8ee8e-32ea-4a8c-ab0b-ca995e5ccb9e tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "14e9c813-2486-4840-b18c-65ca237a8ebf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.269s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsWJZbMx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:46:47 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:46:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:46:47 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:46:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:46:47 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:46:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8 -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c96c074-8a18-483c-b8a1-5e4b7cc60e02]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:46:47 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fe0516-143c-4730-a37b-12ab31abdc1c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8] added
Oct 25 21:46:47 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd7dcd7-987e-4e25-834f-fcdadf62af03]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87d7802-5cb1-4a32-bee1-b89745c1a2cf]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fsWJZbMx {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fsWJZbMx" returned: 0 in 0.026s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29ac3b3-1f77-4eba-841d-a6378646e0f4]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fsWJZbMx'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cd54c3-cda8-4628-a327-0b72404dfb71]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db08da4-dadb-4230-be98-0e23d157fbf7]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 (non-flash)
Oct 25 21:46:47 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 (non-flash)
Oct 25 21:46:47 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8 -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b21add-494d-4f70-b146-e5e6ea34e3fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8, portal: 172.16.0.220,3260]
Oct 25 21:46:47 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8, portal: 172.16.0.220,3260] successful.
Oct 25 21:46:47 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf4488f-6e8b-484e-bcb4-9948765224f0]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[00db2cfc-a17e-4f7d-b7c2-c921bf76bfc0]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 (non-flash)
Oct 25 21:46:47 user nova-compute[74189]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8 (non-flash)
Oct 25 21:46:47 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 (non-flash)
Oct 25 21:46:47 user nova-compute[74189]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8 (non-flash)
Oct 25 21:46:47 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9af9eb-d999-4b0f-8495-2eb93292fcc6]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:46:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsWJZbMx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:46:48 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:46:48 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '26533393036393466', 'path': '/dev/sdc'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:46:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533393036393466', 'path': '/dev/sdc'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:46:48 user nova-compute[74189]: DEBUG nova.objects.instance [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lazy-loading 'flavor' on Instance uuid 0b5d04c5-dfae-42de-84b9-2fab02e3d679 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:46:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 21:46:48 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:46:48 user nova-compute[74189]:   <source dev="/dev/sdc"/>
Oct 25 21:46:48 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:46:48 user nova-compute[74189]:   <serial>5219ef1f-b2f8-4708-9566-da6bc1a52de8</serial>
Oct 25 21:46:48 user nova-compute[74189]: </disk>
Oct 25 21:46:48 user nova-compute[74189]:  {{(pid=74189) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 21:46:49 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:46:49 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:46:49 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] No VIF found with MAC fa:16:3e:dc:d9:66, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:46:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c15aebb6-9602-4ea4-a113-aaf27b2a4c33 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "0b5d04c5-dfae-42de-84b9-2fab02e3d679" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.106s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:46:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Acquiring lock "0b5d04c5-dfae-42de-84b9-2fab02e3d679" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:46:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "0b5d04c5-dfae-42de-84b9-2fab02e3d679" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:46:51 user nova-compute[74189]: INFO nova.compute.manager [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Detaching volume 5219ef1f-b2f8-4708-9566-da6bc1a52de8
Oct 25 21:46:52 user nova-compute[74189]: INFO nova.virt.block_device [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Attempting to driver detach volume 5219ef1f-b2f8-4708-9566-da6bc1a52de8 from mountpoint /dev/vdb
Oct 25 21:46:52 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Attempting to detach device vdb from instance 0b5d04c5-dfae-42de-84b9-2fab02e3d679 from the persistent domain config. {{(pid=74189) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 21:46:52 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:46:52 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:46:52 user nova-compute[74189]:   <source dev="/dev/sdc"/>
Oct 25 21:46:52 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:46:52 user nova-compute[74189]:   <serial>5219ef1f-b2f8-4708-9566-da6bc1a52de8</serial>
Oct 25 21:46:52 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:46:52 user nova-compute[74189]: </disk>
Oct 25 21:46:52 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:46:52 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Successfully detached device vdb from instance 0b5d04c5-dfae-42de-84b9-2fab02e3d679 from the persistent domain config.
Oct 25 21:46:52 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0b5d04c5-dfae-42de-84b9-2fab02e3d679 from the live domain config. {{(pid=74189) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 21:46:52 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:46:52 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:46:52 user nova-compute[74189]:   <source dev="/dev/sdc"/>
Oct 25 21:46:52 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:46:52 user nova-compute[74189]:   <serial>5219ef1f-b2f8-4708-9566-da6bc1a52de8</serial>
Oct 25 21:46:52 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:46:52 user nova-compute[74189]: </disk>
Oct 25 21:46:52 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:46:52 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0b5d04c5-dfae-42de-84b9-2fab02e3d679 {{(pid=74189) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 21:46:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:46:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tkmDrZJl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:47:02 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:47:02 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:47:02 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:47:02 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:47:02 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:47:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0 -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[84388fb8-d480-42b5-9731-c285d132ded9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:47:02 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f499d4-74a5-48e6-986a-448412d13a64]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0] added
Oct 25 21:47:02 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9526da10-086e-4e3d-8126-dadab6c360ca]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[478d19a7-fcf6-4b78-8855-510e7b8fbe21]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tkmDrZJl {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tkmDrZJl" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[88de156d-d8d4-4a0a-b609-6178be82ac1b]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tkmDrZJl'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[00842990-9cd5-4e46-bab1-6d96230d6dee]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cc7e38-4852-40a6-b8bc-becbfcc0afe5]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 (non-flash)
Oct 25 21:47:02 user nova-compute[74189]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8 (non-flash)
Oct 25 21:47:02 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 (non-flash)
Oct 25 21:47:02 user nova-compute[74189]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8 (non-flash)
Oct 25 21:47:02 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0 -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[95de93bb-370a-4c44-9add-ac722f3616fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0, portal: 172.16.0.220,3260]
Oct 25 21:47:02 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0, portal: 172.16.0.220,3260] successful.
Oct 25 21:47:02 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c22ded-62d5-4d04-bd11-68803b01a94e]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e52c5c4-0b83-4d4e-a12d-4f7685b4f9df]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 (non-flash)
Oct 25 21:47:02 user nova-compute[74189]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8 (non-flash)
Oct 25 21:47:02 user nova-compute[74189]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0 (non-flash)
Oct 25 21:47:02 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 (non-flash)
Oct 25 21:47:02 user nova-compute[74189]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8 (non-flash)
Oct 25 21:47:02 user nova-compute[74189]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0 (non-flash)
Oct 25 21:47:02 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] HCTL ('35', '-', '-', 0) found on session 60 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30f7f3f-cd9d-46ce-8a85-38da891d98f0]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Searching for a device in session 60 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:47:02 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tkmDrZJl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:47:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:47:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23362366138343065', 'path': '/dev/sdd'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:47:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362366138343065', 'path': '/dev/sdd'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:47:03 user nova-compute[74189]: DEBUG nova.objects.instance [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lazy-loading 'flavor' on Instance uuid fff8f286-0baa-4865-994f-4418af3edd0a {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:47:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 21:47:03 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:47:03 user nova-compute[74189]:   <source dev="/dev/sdd"/>
Oct 25 21:47:03 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:47:03 user nova-compute[74189]:   <serial>f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0</serial>
Oct 25 21:47:03 user nova-compute[74189]: </disk>
Oct 25 21:47:03 user nova-compute[74189]:  {{(pid=74189) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 21:47:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:47:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:47:04 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] No VIF found with MAC fa:16:3e:b8:cf:38, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:47:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:47:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-8f5c67c1-143c-432f-a1bb-d36b637cdeaa tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "fff8f286-0baa-4865-994f-4418af3edd0a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.208s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:47:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Acquiring lock "fff8f286-0baa-4865-994f-4418af3edd0a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:47:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "fff8f286-0baa-4865-994f-4418af3edd0a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:47:06 user nova-compute[74189]: INFO nova.compute.manager [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Detaching volume f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0
Oct 25 21:47:06 user nova-compute[74189]: INFO nova.virt.block_device [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Attempting to driver detach volume f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0 from mountpoint /dev/vdb
Oct 25 21:47:06 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Attempting to detach device vdb from instance fff8f286-0baa-4865-994f-4418af3edd0a from the persistent domain config. {{(pid=74189) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 21:47:06 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:47:06 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:47:06 user nova-compute[74189]:   <source dev="/dev/sdd"/>
Oct 25 21:47:06 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:47:06 user nova-compute[74189]:   <serial>f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0</serial>
Oct 25 21:47:06 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:47:06 user nova-compute[74189]: </disk>
Oct 25 21:47:06 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:47:06 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Successfully detached device vdb from instance fff8f286-0baa-4865-994f-4418af3edd0a from the persistent domain config.
Oct 25 21:47:06 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fff8f286-0baa-4865-994f-4418af3edd0a from the live domain config. {{(pid=74189) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 21:47:06 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:47:06 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:47:06 user nova-compute[74189]:   <source dev="/dev/sdd"/>
Oct 25 21:47:06 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:47:06 user nova-compute[74189]:   <serial>f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0</serial>
Oct 25 21:47:06 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:47:06 user nova-compute[74189]: </disk>
Oct 25 21:47:06 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:47:06 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fff8f286-0baa-4865-994f-4418af3edd0a {{(pid=74189) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 21:47:09 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:09 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:12 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0b5d04c5-dfae-42de-84b9-2fab02e3d679 is timed out.
Oct 25 21:47:12 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Successfully detached device vdb from instance 0b5d04c5-dfae-42de-84b9-2fab02e3d679 from the live domain config.
Oct 25 21:47:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsWJZbMx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:47:12 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:47:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c315c5c-5609-44a6-a835-adc8818d5758]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:47:12 user nova-compute[74189]: No targets found.
Oct 25 21:47:12 user nova-compute[74189]: iSNS:
Oct 25 21:47:12 user nova-compute[74189]: No targets found.
Oct 25 21:47:12 user nova-compute[74189]: STATIC:
Oct 25 21:47:12 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0
Oct 25 21:47:12 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:47:12 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:47:12 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08
Oct 25 21:47:12 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:47:12 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:47:12 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8
Oct 25 21:47:12 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:47:12 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:47:12 user nova-compute[74189]: FIRMWARE:
Oct 25 21:47:12 user nova-compute[74189]: No targets found.
Oct 25 21:47:12 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:47:12 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:47:12 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb5350a-fe9c-427a-ae5d-6d9ec5112544]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b8be3b-23ae-431d-b74b-99a5a8a6a38b]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 (non-flash)
Oct 25 21:47:12 user nova-compute[74189]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8 (non-flash)
Oct 25 21:47:12 user nova-compute[74189]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0 (non-flash)
Oct 25 21:47:12 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 (non-flash)
Oct 25 21:47:12 user nova-compute[74189]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8 (non-flash)
Oct 25 21:47:12 user nova-compute[74189]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0 (non-flash)
Oct 25 21:47:12 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3042c1120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8'): ({'sdc'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Removing single pathed devices sdc {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[542f9376-1547-4e20-88e3-8808f78e252a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e53e1c9-820e-468e-9e1b-784bdb48c6fb]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Flushing IO for device /dev/sdc {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a96bc3-349d-4529-91cb-70dc3a160a03]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c2ebd6-9210-46d1-83e5-cb9df87a732a]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] SCSI volumes sdc have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[583f08c9-0f15-4c25-b77d-635d24933075]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8 -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e101b62-53cb-4ac1-a7d8-ab97a39d30f6]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8, portal: 172.16.0.220,3260]
Oct 25 21:47:12 user nova-compute[74189]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8, portal: 172.16.0.220,3260] successful.
Oct 25 21:47:12 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8 -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5219ef1f-b2f8-4708-9566-da6bc1a52de8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[af57bac7-fdbb-490e-8f16-647c3b15792d]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] <== disconnect_volume: return (311ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:47:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:47:13 user nova-compute[74189]: DEBUG nova.objects.instance [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lazy-loading 'flavor' on Instance uuid 0b5d04c5-dfae-42de-84b9-2fab02e3d679 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:47:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-01c76beb-18e7-48cf-95e0-f0488e2c1e91 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "0b5d04c5-dfae-42de-84b9-2fab02e3d679" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.902s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:47:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:19 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:47:19 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:47:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-fff8f286-0baa-4865-994f-4418af3edd0a" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:47:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-fff8f286-0baa-4865-994f-4418af3edd0a" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:47:19 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:47:20 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Updating instance_info_cache with network_info: [{"id": "7e686cf6-429d-4de6-8bfc-c57e256bd47a", "address": "fa:16:3e:b8:cf:38", "network": {"id": "0a65fa19-10fa-4360-b5f9-4faa8905e7df", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1120695373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebe8152ff7c45b8bc0df106f7e61a91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e686cf6-42", "ovs_interfaceid": "7e686cf6-429d-4de6-8bfc-c57e256bd47a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:47:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-fff8f286-0baa-4865-994f-4418af3edd0a" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:47:20 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:47:22 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:47:22 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:47:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:47:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 21:47:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:47:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:47:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:25 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:47:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:47:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:47:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:47:25 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:47:25 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3899ed2-d7b4-465b-b512-569898cc46d2/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3899ed2-d7b4-465b-b512-569898cc46d2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3899ed2-d7b4-465b-b512-569898cc46d2/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3899ed2-d7b4-465b-b512-569898cc46d2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:26 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fff8f286-0baa-4865-994f-4418af3edd0a is timed out.
Oct 25 21:47:26 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Successfully detached device vdb from instance fff8f286-0baa-4865-994f-4418af3edd0a from the live domain config.
Oct 25 21:47:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:47:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tkmDrZJl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:47:26 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:47:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:47:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:47:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:26 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:26 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd974b0a-f2cc-4e07-8fb4-68c8184cc1a1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:26 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:47:26 user nova-compute[74189]: No targets found.
Oct 25 21:47:26 user nova-compute[74189]: iSNS:
Oct 25 21:47:26 user nova-compute[74189]: No targets found.
Oct 25 21:47:26 user nova-compute[74189]: STATIC:
Oct 25 21:47:26 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0
Oct 25 21:47:26 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:47:26 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:47:26 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08
Oct 25 21:47:26 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:47:26 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:47:26 user nova-compute[74189]: FIRMWARE:
Oct 25 21:47:26 user nova-compute[74189]: No targets found.
Oct 25 21:47:26 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:47:27 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:47:27 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38df84f-f565-46cf-9ef4-7a3e4f0f8402]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dba524-5980-4ae1-bce7-3010e14f828d]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 (non-flash)
Oct 25 21:47:27 user nova-compute[74189]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0 (non-flash)
Oct 25 21:47:27 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 (non-flash)
Oct 25 21:47:27 user nova-compute[74189]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0 (non-flash)
Oct 25 21:47:27 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2e4241120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0'): ({'sdd'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Removing single pathed devices sdd {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec3edc8-f825-4ecd-b2f7-035f4faa5ecc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2638a8c9-1052-4bc1-ad15-c9daeca64f8e]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Flushing IO for device /dev/sdd {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[015e0a76-07a4-4264-a837-e9b30b504626]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[754cfa5d-3b23-4e71-9f47-f38cec1d35ea]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] SCSI volumes sdd have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[04add4b0-3c84-45e7-b55c-70ad9c345239]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0 -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb4e640-e310-4868-a2e7-7753b60104fd]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0, portal: 172.16.0.220,3260]
Oct 25 21:47:27 user nova-compute[74189]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0, portal: 172.16.0.220,3260] successful.
Oct 25 21:47:27 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0 -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4ac4bda-882b-4d2c-b8a2-dad6bf3e2df0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d5f20e-c812-45bf-bdd0-5f754c6fccec]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] <== disconnect_volume: return (347ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e9c813-2486-4840-b18c-65ca237a8ebf/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:28 user nova-compute[74189]: DEBUG nova.objects.instance [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lazy-loading 'flavor' on Instance uuid fff8f286-0baa-4865-994f-4418af3edd0a {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:47:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-67cedd04-954b-434d-8fc1-39cd743c3693 tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "fff8f286-0baa-4865-994f-4418af3edd0a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.870s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:47:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e9c813-2486-4840-b18c-65ca237a8ebf/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e9c813-2486-4840-b18c-65ca237a8ebf/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e9c813-2486-4840-b18c-65ca237a8ebf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:28 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74189) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 21:47:28 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:47:28 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:47:28 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=8241MB free_disk=24.918445587158203GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:47:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:47:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:47:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:29 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:47:29 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3da14c0a-31a8-4fe3-bd5a-49378680af50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:47:29 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance fff8f286-0baa-4865-994f-4418af3edd0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:47:29 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 14e9c813-2486-4840-b18c-65ca237a8ebf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:47:29 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 0b5d04c5-dfae-42de-84b9-2fab02e3d679 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:47:29 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance b3899ed2-d7b4-465b-b512-569898cc46d2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:47:29 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:47:29 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:47:29 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Refreshing inventories for resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 21:47:29 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Updating ProviderTree inventory for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 21:47:29 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Updating inventory in ProviderTree for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 21:47:29 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Refreshing aggregate associations for resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc, aggregates: None {{(pid=74189) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 21:47:29 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Refreshing trait associations for resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING {{(pid=74189) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 21:47:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:29 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:47:29 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:47:29 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:47:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.679s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:47:30 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:47:30 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:47:30 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:47:30 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:47:30 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:47:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:47:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Acquiring lock "14e9c813-2486-4840-b18c-65ca237a8ebf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:47:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "14e9c813-2486-4840-b18c-65ca237a8ebf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:47:34 user nova-compute[74189]: INFO nova.compute.manager [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Detaching volume 735274f9-b4e1-4d2c-ac64-809a9aca8d08
Oct 25 21:47:34 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:47:34 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:47:34 user nova-compute[74189]: INFO nova.virt.block_device [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Attempting to driver detach volume 735274f9-b4e1-4d2c-ac64-809a9aca8d08 from mountpoint /dev/vdb
Oct 25 21:47:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Attempting to detach device vdb from instance 14e9c813-2486-4840-b18c-65ca237a8ebf from the persistent domain config. {{(pid=74189) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 21:47:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:47:34 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:47:34 user nova-compute[74189]:   <source dev="/dev/sdb"/>
Oct 25 21:47:34 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:47:34 user nova-compute[74189]:   <serial>735274f9-b4e1-4d2c-ac64-809a9aca8d08</serial>
Oct 25 21:47:34 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:47:34 user nova-compute[74189]: </disk>
Oct 25 21:47:34 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:47:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Acquiring lock "14e9c813-2486-4840-b18c-65ca237a8ebf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:47:34 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Successfully detached device vdb from instance 14e9c813-2486-4840-b18c-65ca237a8ebf from the persistent domain config.
Oct 25 21:47:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 14e9c813-2486-4840-b18c-65ca237a8ebf from the live domain config. {{(pid=74189) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 21:47:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:47:34 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:47:34 user nova-compute[74189]:   <source dev="/dev/sdb"/>
Oct 25 21:47:34 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:47:34 user nova-compute[74189]:   <serial>735274f9-b4e1-4d2c-ac64-809a9aca8d08</serial>
Oct 25 21:47:34 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:47:34 user nova-compute[74189]: </disk>
Oct 25 21:47:34 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:47:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 14e9c813-2486-4840-b18c-65ca237a8ebf {{(pid=74189) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 21:47:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:47:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-966329c6-ad67-4acb-8d58-50ffb7e5466d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "3da14c0a-31a8-4fe3-bd5a-49378680af50" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:47:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-966329c6-ad67-4acb-8d58-50ffb7e5466d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "3da14c0a-31a8-4fe3-bd5a-49378680af50" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:47:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-966329c6-ad67-4acb-8d58-50ffb7e5466d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:47:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-966329c6-ad67-4acb-8d58-50ffb7e5466d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:47:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-966329c6-ad67-4acb-8d58-50ffb7e5466d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:47:49 user nova-compute[74189]: INFO nova.compute.manager [None req-966329c6-ad67-4acb-8d58-50ffb7e5466d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Terminating instance
Oct 25 21:47:49 user nova-compute[74189]: DEBUG nova.compute.manager [None req-966329c6-ad67-4acb-8d58-50ffb7e5466d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:47:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:49 user nova-compute[74189]: DEBUG nova.compute.manager [req-806a7251-b17e-4e83-a98c-c1778232b2ce req-80801521-7a7e-419e-ad41-0d8b3b22bb76 service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Received event network-vif-unplugged-a5e7898d-caba-49d7-8310-630beb75bf21 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:47:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-806a7251-b17e-4e83-a98c-c1778232b2ce req-80801521-7a7e-419e-ad41-0d8b3b22bb76 service nova] Acquiring lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:47:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-806a7251-b17e-4e83-a98c-c1778232b2ce req-80801521-7a7e-419e-ad41-0d8b3b22bb76 service nova] Lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:47:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-806a7251-b17e-4e83-a98c-c1778232b2ce req-80801521-7a7e-419e-ad41-0d8b3b22bb76 service nova] Lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:47:49 user nova-compute[74189]: DEBUG nova.compute.manager [req-806a7251-b17e-4e83-a98c-c1778232b2ce req-80801521-7a7e-419e-ad41-0d8b3b22bb76 service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] No waiting events found dispatching network-vif-unplugged-a5e7898d-caba-49d7-8310-630beb75bf21 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:47:49 user nova-compute[74189]: DEBUG nova.compute.manager [req-806a7251-b17e-4e83-a98c-c1778232b2ce req-80801521-7a7e-419e-ad41-0d8b3b22bb76 service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Received event network-vif-unplugged-a5e7898d-caba-49d7-8310-630beb75bf21 for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:47:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:49 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Instance destroyed successfully.
Oct 25 21:47:49 user nova-compute[74189]: DEBUG nova.objects.instance [None req-966329c6-ad67-4acb-8d58-50ffb7e5466d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lazy-loading 'resources' on Instance uuid 3da14c0a-31a8-4fe3-bd5a-49378680af50 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:47:49 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-966329c6-ad67-4acb-8d58-50ffb7e5466d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:31:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1418568783',display_name='tempest-ServerRescueNegativeTestJSON-server-1418568783',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1418568783',id=33,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:33:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3df03fc18fc3467db76e336c6de78c92',ramdisk_id='',reservation_id='r-6kitp7g7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-383982506',owner_user_name='tempest-ServerRescueNegativeTestJSON-383982506-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:33:09Z,user_data=None,user_id='155c948b95c64c9083da984cdf6af494',uuid=3da14c0a-31a8-4fe3-bd5a-49378680af50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "a5e7898d-caba-49d7-8310-630beb75bf21", "address": "fa:16:3e:9d:7f:d0", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5e7898d-ca", "ovs_interfaceid": "a5e7898d-caba-49d7-8310-630beb75bf21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:47:49 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-966329c6-ad67-4acb-8d58-50ffb7e5466d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Converting VIF {"id": "a5e7898d-caba-49d7-8310-630beb75bf21", "address": "fa:16:3e:9d:7f:d0", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5e7898d-ca", "ovs_interfaceid": "a5e7898d-caba-49d7-8310-630beb75bf21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:47:49 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-966329c6-ad67-4acb-8d58-50ffb7e5466d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:7f:d0,bridge_name='br-int',has_traffic_filtering=True,id=a5e7898d-caba-49d7-8310-630beb75bf21,network=Network(b496a106-2367-44dc-a788-bcd22ec98feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5e7898d-ca') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:47:49 user nova-compute[74189]: DEBUG os_vif [None req-966329c6-ad67-4acb-8d58-50ffb7e5466d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:7f:d0,bridge_name='br-int',has_traffic_filtering=True,id=a5e7898d-caba-49d7-8310-630beb75bf21,network=Network(b496a106-2367-44dc-a788-bcd22ec98feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5e7898d-ca') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:47:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5e7898d-ca, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:47:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6280af72-9d23-4dbb-9e47-038df932cf2c) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:47:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:49 user nova-compute[74189]: INFO os_vif [None req-966329c6-ad67-4acb-8d58-50ffb7e5466d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:7f:d0,bridge_name='br-int',has_traffic_filtering=True,id=a5e7898d-caba-49d7-8310-630beb75bf21,network=Network(b496a106-2367-44dc-a788-bcd22ec98feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5e7898d-ca')
Oct 25 21:47:49 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-966329c6-ad67-4acb-8d58-50ffb7e5466d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Deleting instance files /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50_del
Oct 25 21:47:50 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-966329c6-ad67-4acb-8d58-50ffb7e5466d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Deletion of /opt/stack/data/nova/instances/3da14c0a-31a8-4fe3-bd5a-49378680af50_del complete
Oct 25 21:47:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:50 user nova-compute[74189]: INFO nova.compute.manager [None req-966329c6-ad67-4acb-8d58-50ffb7e5466d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 25 21:47:50 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-966329c6-ad67-4acb-8d58-50ffb7e5466d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:47:50 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:47:50 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:47:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:50 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:47:50 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Took 0.74 seconds to deallocate network for instance.
Oct 25 21:47:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-966329c6-ad67-4acb-8d58-50ffb7e5466d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:47:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-966329c6-ad67-4acb-8d58-50ffb7e5466d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:47:50 user nova-compute[74189]: DEBUG nova.compute.manager [req-652c5a19-a92f-4bed-9c37-3629919fe8d6 req-2b04a45d-6da3-468c-99ec-7b57b8dcc808 service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Received event network-vif-deleted-a5e7898d-caba-49d7-8310-630beb75bf21 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:47:51 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-966329c6-ad67-4acb-8d58-50ffb7e5466d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:47:51 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-966329c6-ad67-4acb-8d58-50ffb7e5466d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:47:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-966329c6-ad67-4acb-8d58-50ffb7e5466d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.269s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:47:51 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-966329c6-ad67-4acb-8d58-50ffb7e5466d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Deleted allocations for instance 3da14c0a-31a8-4fe3-bd5a-49378680af50
Oct 25 21:47:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-966329c6-ad67-4acb-8d58-50ffb7e5466d tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "3da14c0a-31a8-4fe3-bd5a-49378680af50" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.145s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:47:51 user nova-compute[74189]: DEBUG nova.compute.manager [req-3b2fe015-5879-496a-996d-2467f83c9b60 req-d563e096-ba05-485b-a9ce-6ff32e5d4eb5 service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Received event network-vif-plugged-a5e7898d-caba-49d7-8310-630beb75bf21 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:47:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3b2fe015-5879-496a-996d-2467f83c9b60 req-d563e096-ba05-485b-a9ce-6ff32e5d4eb5 service nova] Acquiring lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:47:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3b2fe015-5879-496a-996d-2467f83c9b60 req-d563e096-ba05-485b-a9ce-6ff32e5d4eb5 service nova] Lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:47:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3b2fe015-5879-496a-996d-2467f83c9b60 req-d563e096-ba05-485b-a9ce-6ff32e5d4eb5 service nova] Lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:47:51 user nova-compute[74189]: DEBUG nova.compute.manager [req-3b2fe015-5879-496a-996d-2467f83c9b60 req-d563e096-ba05-485b-a9ce-6ff32e5d4eb5 service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] No waiting events found dispatching network-vif-plugged-a5e7898d-caba-49d7-8310-630beb75bf21 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:47:51 user nova-compute[74189]: WARNING nova.compute.manager [req-3b2fe015-5879-496a-996d-2467f83c9b60 req-d563e096-ba05-485b-a9ce-6ff32e5d4eb5 service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Received unexpected event network-vif-plugged-a5e7898d-caba-49d7-8310-630beb75bf21 for instance with vm_state deleted and task_state None.
Oct 25 21:47:51 user nova-compute[74189]: DEBUG nova.compute.manager [req-3b2fe015-5879-496a-996d-2467f83c9b60 req-d563e096-ba05-485b-a9ce-6ff32e5d4eb5 service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Received event network-vif-plugged-a5e7898d-caba-49d7-8310-630beb75bf21 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:47:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3b2fe015-5879-496a-996d-2467f83c9b60 req-d563e096-ba05-485b-a9ce-6ff32e5d4eb5 service nova] Acquiring lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:47:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3b2fe015-5879-496a-996d-2467f83c9b60 req-d563e096-ba05-485b-a9ce-6ff32e5d4eb5 service nova] Lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:47:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3b2fe015-5879-496a-996d-2467f83c9b60 req-d563e096-ba05-485b-a9ce-6ff32e5d4eb5 service nova] Lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:47:51 user nova-compute[74189]: DEBUG nova.compute.manager [req-3b2fe015-5879-496a-996d-2467f83c9b60 req-d563e096-ba05-485b-a9ce-6ff32e5d4eb5 service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] No waiting events found dispatching network-vif-plugged-a5e7898d-caba-49d7-8310-630beb75bf21 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:47:51 user nova-compute[74189]: WARNING nova.compute.manager [req-3b2fe015-5879-496a-996d-2467f83c9b60 req-d563e096-ba05-485b-a9ce-6ff32e5d4eb5 service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Received unexpected event network-vif-plugged-a5e7898d-caba-49d7-8310-630beb75bf21 for instance with vm_state deleted and task_state None.
Oct 25 21:47:51 user nova-compute[74189]: DEBUG nova.compute.manager [req-3b2fe015-5879-496a-996d-2467f83c9b60 req-d563e096-ba05-485b-a9ce-6ff32e5d4eb5 service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Received event network-vif-plugged-a5e7898d-caba-49d7-8310-630beb75bf21 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:47:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3b2fe015-5879-496a-996d-2467f83c9b60 req-d563e096-ba05-485b-a9ce-6ff32e5d4eb5 service nova] Acquiring lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:47:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3b2fe015-5879-496a-996d-2467f83c9b60 req-d563e096-ba05-485b-a9ce-6ff32e5d4eb5 service nova] Lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:47:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3b2fe015-5879-496a-996d-2467f83c9b60 req-d563e096-ba05-485b-a9ce-6ff32e5d4eb5 service nova] Lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:47:51 user nova-compute[74189]: DEBUG nova.compute.manager [req-3b2fe015-5879-496a-996d-2467f83c9b60 req-d563e096-ba05-485b-a9ce-6ff32e5d4eb5 service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] No waiting events found dispatching network-vif-plugged-a5e7898d-caba-49d7-8310-630beb75bf21 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:47:51 user nova-compute[74189]: WARNING nova.compute.manager [req-3b2fe015-5879-496a-996d-2467f83c9b60 req-d563e096-ba05-485b-a9ce-6ff32e5d4eb5 service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Received unexpected event network-vif-plugged-a5e7898d-caba-49d7-8310-630beb75bf21 for instance with vm_state deleted and task_state None.
Oct 25 21:47:51 user nova-compute[74189]: DEBUG nova.compute.manager [req-3b2fe015-5879-496a-996d-2467f83c9b60 req-d563e096-ba05-485b-a9ce-6ff32e5d4eb5 service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Received event network-vif-plugged-a5e7898d-caba-49d7-8310-630beb75bf21 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:47:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3b2fe015-5879-496a-996d-2467f83c9b60 req-d563e096-ba05-485b-a9ce-6ff32e5d4eb5 service nova] Acquiring lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:47:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3b2fe015-5879-496a-996d-2467f83c9b60 req-d563e096-ba05-485b-a9ce-6ff32e5d4eb5 service nova] Lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:47:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3b2fe015-5879-496a-996d-2467f83c9b60 req-d563e096-ba05-485b-a9ce-6ff32e5d4eb5 service nova] Lock "3da14c0a-31a8-4fe3-bd5a-49378680af50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:47:51 user nova-compute[74189]: DEBUG nova.compute.manager [req-3b2fe015-5879-496a-996d-2467f83c9b60 req-d563e096-ba05-485b-a9ce-6ff32e5d4eb5 service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] No waiting events found dispatching network-vif-plugged-a5e7898d-caba-49d7-8310-630beb75bf21 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:47:51 user nova-compute[74189]: WARNING nova.compute.manager [req-3b2fe015-5879-496a-996d-2467f83c9b60 req-d563e096-ba05-485b-a9ce-6ff32e5d4eb5 service nova] [instance: 3da14c0a-31a8-4fe3-bd5a-49378680af50] Received unexpected event network-vif-plugged-a5e7898d-caba-49d7-8310-630beb75bf21 for instance with vm_state deleted and task_state None.
Oct 25 21:47:53 user nova-compute[74189]: DEBUG nova.compute.manager [None req-03b362f4-dcde-4e02-aeac-d25de712abc1 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:47:53 user nova-compute[74189]: INFO nova.compute.manager [None req-03b362f4-dcde-4e02-aeac-d25de712abc1 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] instance snapshotting
Oct 25 21:47:53 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-03b362f4-dcde-4e02-aeac-d25de712abc1 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Beginning live snapshot process
Oct 25 21:47:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-03b362f4-dcde-4e02-aeac-d25de712abc1 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json -f qcow2 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-03b362f4-dcde-4e02-aeac-d25de712abc1 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json -f qcow2" returned: 0 in 0.197s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-03b362f4-dcde-4e02-aeac-d25de712abc1 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json -f qcow2 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-03b362f4-dcde-4e02-aeac-d25de712abc1 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json -f qcow2" returned: 0 in 0.205s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-03b362f4-dcde-4e02-aeac-d25de712abc1 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-03b362f4-dcde-4e02-aeac-d25de712abc1 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.176s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-03b362f4-dcde-4e02-aeac-d25de712abc1 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp51foy6rv/552045b4d65c41f7bb57c8fcc13e8283.delta 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-03b362f4-dcde-4e02-aeac-d25de712abc1 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp51foy6rv/552045b4d65c41f7bb57c8fcc13e8283.delta 1073741824" returned: 0 in 0.053s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:54 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-03b362f4-dcde-4e02-aeac-d25de712abc1 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 25 21:47:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:55 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 14e9c813-2486-4840-b18c-65ca237a8ebf is timed out.
Oct 25 21:47:55 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Successfully detached device vdb from instance 14e9c813-2486-4840-b18c-65ca237a8ebf from the live domain config.
Oct 25 21:47:55 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CMOzvXUm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:47:55 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:47:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fab7a4-fc6c-4533-b8c2-9cbce0d56f65]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:47:55 user nova-compute[74189]: No targets found.
Oct 25 21:47:55 user nova-compute[74189]: iSNS:
Oct 25 21:47:55 user nova-compute[74189]: No targets found.
Oct 25 21:47:55 user nova-compute[74189]: STATIC:
Oct 25 21:47:55 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08
Oct 25 21:47:55 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:47:55 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:47:55 user nova-compute[74189]: FIRMWARE:
Oct 25 21:47:55 user nova-compute[74189]: No targets found.
Oct 25 21:47:55 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:47:55 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:47:55 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-03b362f4-dcde-4e02-aeac-d25de712abc1 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74189) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cce9821-3797-499a-92ea-bc0a09dd7f79]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[82164a74-fbfc-4d35-8ece-0b46b0232779]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 (non-flash)
Oct 25 21:47:55 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 (non-flash)
Oct 25 21:47:55 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2e4174af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08'): ({'sdb'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Removing single pathed devices sdb {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[decb7be9-1393-4ee8-9dff-9a040152898c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceace91b-f30d-460f-b5b1-4dbc1ec44dd0]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Flushing IO for device /dev/sdb {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[739d2205-ac8a-4df5-83be-2368aaa6ae96]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.105s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45509b7-ca3b-4631-be4b-9f52e21186de]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] SCSI volumes sdb have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77e2dcb-b312-4b21-bdae-775b2228a4b2]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc99092c-352d-48f1-a207-3c96990c2c09]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08, portal: 172.16.0.220,3260]
Oct 25 21:47:55 user nova-compute[74189]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08, portal: 172.16.0.220,3260] successful.
Oct 25 21:47:55 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7c83ee-3bf3-4744-8b70-f4774418d760]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.510s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] <== disconnect_volume: return (513ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:47:55 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-03b362f4-dcde-4e02-aeac-d25de712abc1 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] COPY block job progress, current cursor: 19005440 final cursor: 75563008 {{(pid=74189) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 21:47:56 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-03b362f4-dcde-4e02-aeac-d25de712abc1 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74189) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 21:47:56 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-03b362f4-dcde-4e02-aeac-d25de712abc1 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 25 21:47:56 user nova-compute[74189]: DEBUG nova.privsep.utils [None req-03b362f4-dcde-4e02-aeac-d25de712abc1 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74189) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 21:47:56 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-03b362f4-dcde-4e02-aeac-d25de712abc1 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp51foy6rv/552045b4d65c41f7bb57c8fcc13e8283.delta /opt/stack/data/nova/instances/snapshots/tmp51foy6rv/552045b4d65c41f7bb57c8fcc13e8283 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:56 user nova-compute[74189]: DEBUG nova.objects.instance [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lazy-loading 'flavor' on Instance uuid 14e9c813-2486-4840-b18c-65ca237a8ebf {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:47:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e86139e0-2ac0-49b6-b9ef-12c4b7931e63 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "14e9c813-2486-4840-b18c-65ca237a8ebf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.108s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:47:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "14e9c813-2486-4840-b18c-65ca237a8ebf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.995s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:47:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Acquiring lock "14e9c813-2486-4840-b18c-65ca237a8ebf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:47:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "14e9c813-2486-4840-b18c-65ca237a8ebf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:47:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "14e9c813-2486-4840-b18c-65ca237a8ebf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:47:56 user nova-compute[74189]: INFO nova.compute.manager [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Terminating instance
Oct 25 21:47:56 user nova-compute[74189]: DEBUG nova.compute.manager [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:47:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-03b362f4-dcde-4e02-aeac-d25de712abc1 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp51foy6rv/552045b4d65c41f7bb57c8fcc13e8283.delta /opt/stack/data/nova/instances/snapshots/tmp51foy6rv/552045b4d65c41f7bb57c8fcc13e8283" returned: 0 in 0.557s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:57 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-03b362f4-dcde-4e02-aeac-d25de712abc1 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Snapshot extracted, beginning image upload
Oct 25 21:47:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-bfa10e2b-5ae1-4153-b58c-48e857bcf42b req-2a4f9986-e79f-4691-8167-a76ca7036f11 service nova] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Received event network-vif-unplugged-e9e74d39-f7ae-498a-932c-65c2639a3efe {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:47:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bfa10e2b-5ae1-4153-b58c-48e857bcf42b req-2a4f9986-e79f-4691-8167-a76ca7036f11 service nova] Acquiring lock "14e9c813-2486-4840-b18c-65ca237a8ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:47:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bfa10e2b-5ae1-4153-b58c-48e857bcf42b req-2a4f9986-e79f-4691-8167-a76ca7036f11 service nova] Lock "14e9c813-2486-4840-b18c-65ca237a8ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:47:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-bfa10e2b-5ae1-4153-b58c-48e857bcf42b req-2a4f9986-e79f-4691-8167-a76ca7036f11 service nova] Lock "14e9c813-2486-4840-b18c-65ca237a8ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:47:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-bfa10e2b-5ae1-4153-b58c-48e857bcf42b req-2a4f9986-e79f-4691-8167-a76ca7036f11 service nova] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] No waiting events found dispatching network-vif-unplugged-e9e74d39-f7ae-498a-932c-65c2639a3efe {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:47:57 user nova-compute[74189]: DEBUG nova.compute.manager [req-bfa10e2b-5ae1-4153-b58c-48e857bcf42b req-2a4f9986-e79f-4691-8167-a76ca7036f11 service nova] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Received event network-vif-unplugged-e9e74d39-f7ae-498a-932c-65c2639a3efe for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:47:57 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Instance destroyed successfully.
Oct 25 21:47:57 user nova-compute[74189]: DEBUG nova.objects.instance [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lazy-loading 'resources' on Instance uuid 14e9c813-2486-4840-b18c-65ca237a8ebf {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:47:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:44:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-927101518',display_name='tempest-VolumesSnapshotTestJSON-instance-927101518',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-927101518',id=47,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvLozy56V7NoN54maH8tEM07IYGPsiXZ+3W72iTT4Lw3qaA1tPfPonSePZ5GraD33OOK3FEgGEwNEcge8a1Im6Jo9rVFDEOkZ5u2p9y/myjN40F6YKsTZor2bIYYU46hg==',key_name='tempest-keypair-1094911281',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:44:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff1b56c6086e4a41bf9a98b96101531e',ramdisk_id='',reservation_id='r-6ei9oiv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1589464160',owner_user_name='tempest-VolumesSnapshotTestJSON-1589464160-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:44:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bcb3eebd1e04f0b978238f4eeeec2de',uuid=14e9c813-2486-4840-b18c-65ca237a8ebf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9e74d39-f7ae-498a-932c-65c2639a3efe", "address": "fa:16:3e:6a:f3:d2", "network": {"id": "27a00d33-61db-45a8-a945-cd8514be6344", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1691303850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff1b56c6086e4a41bf9a98b96101531e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e74d39-f7", "ovs_interfaceid": "e9e74d39-f7ae-498a-932c-65c2639a3efe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:47:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Converting VIF {"id": "e9e74d39-f7ae-498a-932c-65c2639a3efe", "address": "fa:16:3e:6a:f3:d2", "network": {"id": "27a00d33-61db-45a8-a945-cd8514be6344", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1691303850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff1b56c6086e4a41bf9a98b96101531e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e74d39-f7", "ovs_interfaceid": "e9e74d39-f7ae-498a-932c-65c2639a3efe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:47:57 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:f3:d2,bridge_name='br-int',has_traffic_filtering=True,id=e9e74d39-f7ae-498a-932c-65c2639a3efe,network=Network(27a00d33-61db-45a8-a945-cd8514be6344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9e74d39-f7') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:47:57 user nova-compute[74189]: DEBUG os_vif [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:f3:d2,bridge_name='br-int',has_traffic_filtering=True,id=e9e74d39-f7ae-498a-932c-65c2639a3efe,network=Network(27a00d33-61db-45a8-a945-cd8514be6344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9e74d39-f7') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:47:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9e74d39-f7, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:47:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:47:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=66613e6d-cca5-4f8d-a7c8-b29306009c2f) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:47:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:47:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:47:57 user nova-compute[74189]: INFO os_vif [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:f3:d2,bridge_name='br-int',has_traffic_filtering=True,id=e9e74d39-f7ae-498a-932c-65c2639a3efe,network=Network(27a00d33-61db-45a8-a945-cd8514be6344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9e74d39-f7')
Oct 25 21:47:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:47:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:735274f9-b4e1-4d2c-ac64-809a9aca8d08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CMOzvXUm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:47:57 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:47:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:47:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:47:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:47:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:47:57 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:47:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[5e3bc650-710c-4f35-a150-66fc5b1fbe62]: Unexpected error while running command.
Oct 25 21:47:57 user nova-compute[74189]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 25 21:47:57 user nova-compute[74189]: Exit code: 21
Oct 25 21:47:57 user nova-compute[74189]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 25 21:47:57 user nova-compute[74189]: Stderr: '' {{(pid=85079) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Oct 25 21:47:57 user nova-compute[74189]: Traceback (most recent call last):
Oct 25 21:47:57 user nova-compute[74189]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Oct 25 21:47:57 user nova-compute[74189]:     ret = func(*f_args, **f_kwargs)
Oct 25 21:47:57 user nova-compute[74189]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Oct 25 21:47:57 user nova-compute[74189]:     return func(*args, **kwargs)
Oct 25 21:47:57 user nova-compute[74189]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Oct 25 21:47:57 user nova-compute[74189]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Oct 25 21:47:57 user nova-compute[74189]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Oct 25 21:47:57 user nova-compute[74189]:     return putils.execute(on_execute=on_execute,
Oct 25 21:47:57 user nova-compute[74189]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Oct 25 21:47:57 user nova-compute[74189]:     raise ProcessExecutionError(exit_code=_returncode,
Oct 25 21:47:57 user nova-compute[74189]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 25 21:47:57 user nova-compute[74189]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 25 21:47:57 user nova-compute[74189]: Exit code: 21
Oct 25 21:47:57 user nova-compute[74189]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 25 21:47:57 user nova-compute[74189]: Stderr: ''
Oct 25 21:47:57 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3bc650-710c-4f35-a150-66fc5b1fbe62]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:47:57 user nova-compute[74189]: ERROR os_brick.initiator.connectors.iscsi [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 25 21:47:57 user nova-compute[74189]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 25 21:47:57 user nova-compute[74189]: Exit code: 21
Oct 25 21:47:57 user nova-compute[74189]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 25 21:47:57 user nova-compute[74189]: Stderr: ''
Oct 25 21:47:57 user nova-compute[74189]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Oct 25 21:47:57 user nova-compute[74189]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Oct 25 21:47:57 user nova-compute[74189]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Oct 25 21:47:57 user nova-compute[74189]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Oct 25 21:47:57 user nova-compute[74189]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Oct 25 21:47:57 user nova-compute[74189]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Oct 25 21:47:57 user nova-compute[74189]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Oct 25 21:47:57 user nova-compute[74189]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Oct 25 21:47:57 user nova-compute[74189]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Oct 25 21:47:57 user nova-compute[74189]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Oct 25 21:47:57 user nova-compute[74189]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Oct 25 21:47:57 user nova-compute[74189]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Oct 25 21:47:57 user nova-compute[74189]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Oct 25 21:47:57 user nova-compute[74189]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Oct 25 21:47:57 user nova-compute[74189]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Oct 25 21:47:57 user nova-compute[74189]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 25 21:47:57 user nova-compute[74189]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Oct 25 21:47:57 user nova-compute[74189]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Oct 25 21:47:57 user nova-compute[74189]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 25 21:47:57 user nova-compute[74189]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Oct 25 21:47:57 user nova-compute[74189]: ERROR os_brick.initiator.connectors.iscsi 
Oct 25 21:47:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74189) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Oct 25 21:47:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.034s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:47:57 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] <== disconnect_volume: return (37ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:47:57 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:47:57 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Deleting instance files /opt/stack/data/nova/instances/14e9c813-2486-4840-b18c-65ca237a8ebf_del
Oct 25 21:47:57 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Deletion of /opt/stack/data/nova/instances/14e9c813-2486-4840-b18c-65ca237a8ebf_del complete
Oct 25 21:47:57 user nova-compute[74189]: INFO nova.compute.manager [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Took 0.96 seconds to destroy the instance on the hypervisor.
Oct 25 21:47:57 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:47:57 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:47:57 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:47:58 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:47:58 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Took 0.84 seconds to deallocate network for instance.
Oct 25 21:47:58 user nova-compute[74189]: DEBUG nova.compute.manager [req-03ab80c7-7dc3-4f83-8031-3e5b9682e886 req-71134c21-8cbb-4991-b3b9-06e0a0e0c74e service nova] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Received event network-vif-deleted-e9e74d39-f7ae-498a-932c-65c2639a3efe {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:47:58 user nova-compute[74189]: INFO nova.compute.manager [req-03ab80c7-7dc3-4f83-8031-3e5b9682e886 req-71134c21-8cbb-4991-b3b9-06e0a0e0c74e service nova] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Neutron deleted interface e9e74d39-f7ae-498a-932c-65c2639a3efe; detaching it from the instance and deleting it from the info cache
Oct 25 21:47:58 user nova-compute[74189]: DEBUG nova.network.neutron [req-03ab80c7-7dc3-4f83-8031-3e5b9682e886 req-71134c21-8cbb-4991-b3b9-06e0a0e0c74e service nova] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:47:58 user nova-compute[74189]: WARNING nova.volume.cinder [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Attachment 4a04124c-d491-4ae9-8c01-51c1db0c52f2 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 4a04124c-d491-4ae9-8c01-51c1db0c52f2. (HTTP 404) (Request-ID: req-319beccf-ad81-4079-ad13-47b45b67030b)
Oct 25 21:47:58 user nova-compute[74189]: INFO nova.compute.manager [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Took 0.03 seconds to detach 1 volumes for instance.
Oct 25 21:47:58 user nova-compute[74189]: DEBUG nova.compute.manager [req-03ab80c7-7dc3-4f83-8031-3e5b9682e886 req-71134c21-8cbb-4991-b3b9-06e0a0e0c74e service nova] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Detach interface failed, port_id=e9e74d39-f7ae-498a-932c-65c2639a3efe, reason: Instance 14e9c813-2486-4840-b18c-65ca237a8ebf could not be found. {{(pid=74189) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 21:47:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:47:58 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:47:59 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:47:59 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:47:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.248s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:47:59 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Deleted allocations for instance 14e9c813-2486-4840-b18c-65ca237a8ebf
Oct 25 21:47:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-fe53c8b2-a5cb-415e-b7ea-c2395e7b72b1 tempest-VolumesSnapshotTestJSON-1589464160 tempest-VolumesSnapshotTestJSON-1589464160-project-member] Lock "14e9c813-2486-4840-b18c-65ca237a8ebf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.355s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:47:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-8eb9cdd4-dd67-41f9-b8ee-2dc7d73cb3d6 req-029b205a-c914-4acf-9cda-d8fc8f8626e4 service nova] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Received event network-vif-plugged-e9e74d39-f7ae-498a-932c-65c2639a3efe {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:47:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8eb9cdd4-dd67-41f9-b8ee-2dc7d73cb3d6 req-029b205a-c914-4acf-9cda-d8fc8f8626e4 service nova] Acquiring lock "14e9c813-2486-4840-b18c-65ca237a8ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:47:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8eb9cdd4-dd67-41f9-b8ee-2dc7d73cb3d6 req-029b205a-c914-4acf-9cda-d8fc8f8626e4 service nova] Lock "14e9c813-2486-4840-b18c-65ca237a8ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:47:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8eb9cdd4-dd67-41f9-b8ee-2dc7d73cb3d6 req-029b205a-c914-4acf-9cda-d8fc8f8626e4 service nova] Lock "14e9c813-2486-4840-b18c-65ca237a8ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:47:59 user nova-compute[74189]: DEBUG nova.compute.manager [req-8eb9cdd4-dd67-41f9-b8ee-2dc7d73cb3d6 req-029b205a-c914-4acf-9cda-d8fc8f8626e4 service nova] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] No waiting events found dispatching network-vif-plugged-e9e74d39-f7ae-498a-932c-65c2639a3efe {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:47:59 user nova-compute[74189]: WARNING nova.compute.manager [req-8eb9cdd4-dd67-41f9-b8ee-2dc7d73cb3d6 req-029b205a-c914-4acf-9cda-d8fc8f8626e4 service nova] [instance: 14e9c813-2486-4840-b18c-65ca237a8ebf] Received unexpected event network-vif-plugged-e9e74d39-f7ae-498a-932c-65c2639a3efe for instance with vm_state deleted and task_state None.
Oct 25 21:47:59 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-03b362f4-dcde-4e02-aeac-d25de712abc1 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Snapshot image upload complete
Oct 25 21:47:59 user nova-compute[74189]: INFO nova.compute.manager [None req-03b362f4-dcde-4e02-aeac-d25de712abc1 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Took 6.17 seconds to snapshot the instance on the hypervisor.
Oct 25 21:48:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Acquiring lock "3735964b-ac6d-41d6-9c9c-f9fc91723558" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:48:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "3735964b-ac6d-41d6-9c9c-f9fc91723558" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:48:01 user nova-compute[74189]: DEBUG nova.compute.manager [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:48:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:48:01 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:48:01 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:48:01 user nova-compute[74189]: INFO nova.compute.claims [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Claim successful on node user
Oct 25 21:48:02 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:48:02 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:48:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.349s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:48:02 user nova-compute[74189]: DEBUG nova.compute.manager [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:48:02 user nova-compute[74189]: DEBUG nova.compute.manager [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:48:02 user nova-compute[74189]: DEBUG nova.network.neutron [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:48:02 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:48:02 user nova-compute[74189]: DEBUG nova.compute.manager [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:48:02 user nova-compute[74189]: DEBUG nova.policy [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ea97d3b6a27a4b569c04e26aa6043289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6a19ad6e8249abbe10137bdad65ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:48:02 user nova-compute[74189]: DEBUG nova.compute.manager [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:48:02 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:48:02 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Creating image(s)
Oct 25 21:48:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Acquiring lock "/opt/stack/data/nova/instances/3735964b-ac6d-41d6-9c9c-f9fc91723558/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:48:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "/opt/stack/data/nova/instances/3735964b-ac6d-41d6-9c9c-f9fc91723558/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:48:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "/opt/stack/data/nova/instances/3735964b-ac6d-41d6-9c9c-f9fc91723558/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:48:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Acquiring lock "7f7494c3b89c5692d99eb6adee46d0cab5273a73" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:48:02 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "7f7494c3b89c5692d99eb6adee46d0cab5273a73" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:48:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f7494c3b89c5692d99eb6adee46d0cab5273a73.part --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:48:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:03 user nova-compute[74189]: DEBUG nova.network.neutron [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Successfully created port: 96b88f54-6536-46e6-b6fc-11af60ae3f3f {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:48:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f7494c3b89c5692d99eb6adee46d0cab5273a73.part --force-share --output=json" returned: 0 in 0.174s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:48:03 user nova-compute[74189]: DEBUG nova.virt.images [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] 90e46664-769e-4834-b2d1-c9776a1938a1 was qcow2, converting to raw {{(pid=74189) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 21:48:03 user nova-compute[74189]: DEBUG nova.privsep.utils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74189) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 21:48:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7f7494c3b89c5692d99eb6adee46d0cab5273a73.part /opt/stack/data/nova/instances/_base/7f7494c3b89c5692d99eb6adee46d0cab5273a73.converted {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:48:04 user nova-compute[74189]: DEBUG nova.network.neutron [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Successfully updated port: 96b88f54-6536-46e6-b6fc-11af60ae3f3f {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:48:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Acquiring lock "refresh_cache-3735964b-ac6d-41d6-9c9c-f9fc91723558" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:48:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Acquired lock "refresh_cache-3735964b-ac6d-41d6-9c9c-f9fc91723558" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:48:04 user nova-compute[74189]: DEBUG nova.network.neutron [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:48:04 user nova-compute[74189]: DEBUG nova.compute.manager [req-ee2bd106-b7f1-48e3-88e7-783727c4bc62 req-07cf5d1f-00e0-41c9-aef7-2b6fb32d0630 service nova] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Received event network-changed-96b88f54-6536-46e6-b6fc-11af60ae3f3f {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:48:04 user nova-compute[74189]: DEBUG nova.compute.manager [req-ee2bd106-b7f1-48e3-88e7-783727c4bc62 req-07cf5d1f-00e0-41c9-aef7-2b6fb32d0630 service nova] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Refreshing instance network info cache due to event network-changed-96b88f54-6536-46e6-b6fc-11af60ae3f3f. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:48:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ee2bd106-b7f1-48e3-88e7-783727c4bc62 req-07cf5d1f-00e0-41c9-aef7-2b6fb32d0630 service nova] Acquiring lock "refresh_cache-3735964b-ac6d-41d6-9c9c-f9fc91723558" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:48:04 user nova-compute[74189]: DEBUG nova.network.neutron [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:48:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7f7494c3b89c5692d99eb6adee46d0cab5273a73.part /opt/stack/data/nova/instances/_base/7f7494c3b89c5692d99eb6adee46d0cab5273a73.converted" returned: 0 in 1.134s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:48:04 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f7494c3b89c5692d99eb6adee46d0cab5273a73.converted --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f7494c3b89c5692d99eb6adee46d0cab5273a73.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "7f7494c3b89c5692d99eb6adee46d0cab5273a73" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.590s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f7494c3b89c5692d99eb6adee46d0cab5273a73 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG nova.network.neutron [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Updating instance_info_cache with network_info: [{"id": "96b88f54-6536-46e6-b6fc-11af60ae3f3f", "address": "fa:16:3e:63:f5:0c", "network": {"id": "d2a72b33-1451-4343-a1ac-3e7cb75ec083", "bridge": "br-int", "label": "tempest-TestStampPattern-234506410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6a19ad6e8249abbe10137bdad65ca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b88f54-65", "ovs_interfaceid": "96b88f54-6536-46e6-b6fc-11af60ae3f3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f7494c3b89c5692d99eb6adee46d0cab5273a73 --force-share --output=json" returned: 0 in 0.170s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Acquiring lock "7f7494c3b89c5692d99eb6adee46d0cab5273a73" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "7f7494c3b89c5692d99eb6adee46d0cab5273a73" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f7494c3b89c5692d99eb6adee46d0cab5273a73 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Releasing lock "refresh_cache-3735964b-ac6d-41d6-9c9c-f9fc91723558" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG nova.compute.manager [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Instance network_info: |[{"id": "96b88f54-6536-46e6-b6fc-11af60ae3f3f", "address": "fa:16:3e:63:f5:0c", "network": {"id": "d2a72b33-1451-4343-a1ac-3e7cb75ec083", "bridge": "br-int", "label": "tempest-TestStampPattern-234506410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6a19ad6e8249abbe10137bdad65ca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b88f54-65", "ovs_interfaceid": "96b88f54-6536-46e6-b6fc-11af60ae3f3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ee2bd106-b7f1-48e3-88e7-783727c4bc62 req-07cf5d1f-00e0-41c9-aef7-2b6fb32d0630 service nova] Acquired lock "refresh_cache-3735964b-ac6d-41d6-9c9c-f9fc91723558" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG nova.network.neutron [req-ee2bd106-b7f1-48e3-88e7-783727c4bc62 req-07cf5d1f-00e0-41c9-aef7-2b6fb32d0630 service nova] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Refreshing network info cache for port 96b88f54-6536-46e6-b6fc-11af60ae3f3f {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f7494c3b89c5692d99eb6adee46d0cab5273a73 --force-share --output=json" returned: 0 in 0.180s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7f7494c3b89c5692d99eb6adee46d0cab5273a73,backing_fmt=raw /opt/stack/data/nova/instances/3735964b-ac6d-41d6-9c9c-f9fc91723558/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7f7494c3b89c5692d99eb6adee46d0cab5273a73,backing_fmt=raw /opt/stack/data/nova/instances/3735964b-ac6d-41d6-9c9c-f9fc91723558/disk 1073741824" returned: 0 in 0.053s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "7f7494c3b89c5692d99eb6adee46d0cab5273a73" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f7494c3b89c5692d99eb6adee46d0cab5273a73 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f7494c3b89c5692d99eb6adee46d0cab5273a73 --force-share --output=json" returned: 0 in 0.170s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Ensure instance console log exists: /opt/stack/data/nova/instances/3735964b-ac6d-41d6-9c9c-f9fc91723558/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Start _get_guest_xml network_info=[{"id": "96b88f54-6536-46e6-b6fc-11af60ae3f3f", "address": "fa:16:3e:63:f5:0c", "network": {"id": "d2a72b33-1451-4343-a1ac-3e7cb75ec083", "bridge": "br-int", "label": "tempest-TestStampPattern-234506410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6a19ad6e8249abbe10137bdad65ca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b88f54-65", "ovs_interfaceid": "96b88f54-6536-46e6-b6fc-11af60ae3f3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='5d9e2b1a91c804e9238e00d113f43545',container_format='bare',created_at=2023-10-25T21:47:54Z,direct_url=<?>,disk_format='qcow2',id=90e46664-769e-4834-b2d1-c9776a1938a1,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1148555656',owner='6e6a19ad6e8249abbe10137bdad65ca6',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-25T21:48:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '90e46664-769e-4834-b2d1-c9776a1938a1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:48:05 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:48:05 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:48:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5d9e2b1a91c804e9238e00d113f43545',container_format='bare',created_at=2023-10-25T21:47:54Z,direct_url=<?>,disk_format='qcow2',id=90e46664-769e-4834-b2d1-c9776a1938a1,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1148555656',owner='6e6a19ad6e8249abbe10137bdad65ca6',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-25T21:48:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:48:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1874233760',display_name='tempest-TestStampPattern-server-1874233760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1874233760',id=50,image_ref='90e46664-769e-4834-b2d1-c9776a1938a1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQ9OkIshA11eGvW1QoEDYUze94CFpHLxzzrnPEgQ/2cw2YykkRNKJSJN8zmNNN6ley6mlQwKcYrckjb4ee76GPcAhjB40Ypfxi0u4ciFrGvjcvOeYKwMAfqYUHhAHDRpA==',key_name='tempest-TestStampPattern-1702097735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e6a19ad6e8249abbe10137bdad65ca6',ramdisk_id='',reservation_id='r-onewxqqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0b5d04c5-dfae-42de-84b9-2fab02e3d679',image_min_disk='1',image_min_ram='0',image_owner_id='6e6a19ad6e8249abbe10137bdad65ca6',image_owner_project_name='tempest-TestStampPattern-367314632',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-367314632-project-member',image_user_id='ea97d3b6a27a4b569c04e26aa6043289',network_allocated='True',owner_project_name='tempest-TestStampPattern-367314632',owner_user_name='tempest-TestStampPattern-367314632-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:48:02Z,user_data=None,user_id='ea97d3b6a27a4b569c04e26aa6043289',uuid=3735964b-ac6d-41d6-9c9c-f9fc91723558,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96b88f54-6536-46e6-b6fc-11af60ae3f3f", "address": "fa:16:3e:63:f5:0c", "network": {"id": "d2a72b33-1451-4343-a1ac-3e7cb75ec083", "bridge": "br-int", "label": "tempest-TestStampPattern-234506410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6a19ad6e8249abbe10137bdad65ca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b88f54-65", "ovs_interfaceid": "96b88f54-6536-46e6-b6fc-11af60ae3f3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Converting VIF {"id": "96b88f54-6536-46e6-b6fc-11af60ae3f3f", "address": "fa:16:3e:63:f5:0c", "network": {"id": "d2a72b33-1451-4343-a1ac-3e7cb75ec083", "bridge": "br-int", "label": "tempest-TestStampPattern-234506410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6a19ad6e8249abbe10137bdad65ca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b88f54-65", "ovs_interfaceid": "96b88f54-6536-46e6-b6fc-11af60ae3f3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:f5:0c,bridge_name='br-int',has_traffic_filtering=True,id=96b88f54-6536-46e6-b6fc-11af60ae3f3f,network=Network(d2a72b33-1451-4343-a1ac-3e7cb75ec083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96b88f54-65') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG nova.objects.instance [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lazy-loading 'pci_devices' on Instance uuid 3735964b-ac6d-41d6-9c9c-f9fc91723558 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG nova.network.neutron [req-ee2bd106-b7f1-48e3-88e7-783727c4bc62 req-07cf5d1f-00e0-41c9-aef7-2b6fb32d0630 service nova] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Updated VIF entry in instance network info cache for port 96b88f54-6536-46e6-b6fc-11af60ae3f3f. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG nova.network.neutron [req-ee2bd106-b7f1-48e3-88e7-783727c4bc62 req-07cf5d1f-00e0-41c9-aef7-2b6fb32d0630 service nova] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Updating instance_info_cache with network_info: [{"id": "96b88f54-6536-46e6-b6fc-11af60ae3f3f", "address": "fa:16:3e:63:f5:0c", "network": {"id": "d2a72b33-1451-4343-a1ac-3e7cb75ec083", "bridge": "br-int", "label": "tempest-TestStampPattern-234506410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6a19ad6e8249abbe10137bdad65ca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b88f54-65", "ovs_interfaceid": "96b88f54-6536-46e6-b6fc-11af60ae3f3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:48:05 user nova-compute[74189]:   <uuid>3735964b-ac6d-41d6-9c9c-f9fc91723558</uuid>
Oct 25 21:48:05 user nova-compute[74189]:   <name>instance-00000032</name>
Oct 25 21:48:05 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:48:05 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:48:05 user nova-compute[74189]:   <metadata>
Oct 25 21:48:05 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:48:05 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:48:05 user nova-compute[74189]:       <nova:name>tempest-TestStampPattern-server-1874233760</nova:name>
Oct 25 21:48:05 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:48:05</nova:creationTime>
Oct 25 21:48:05 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:48:05 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:48:05 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:48:05 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:48:05 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:48:05 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:48:05 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:48:05 user nova-compute[74189]:       <nova:owner>
Oct 25 21:48:05 user nova-compute[74189]:         <nova:user uuid="ea97d3b6a27a4b569c04e26aa6043289">tempest-TestStampPattern-367314632-project-member</nova:user>
Oct 25 21:48:05 user nova-compute[74189]:         <nova:project uuid="6e6a19ad6e8249abbe10137bdad65ca6">tempest-TestStampPattern-367314632</nova:project>
Oct 25 21:48:05 user nova-compute[74189]:       </nova:owner>
Oct 25 21:48:05 user nova-compute[74189]:       <nova:root type="image" uuid="90e46664-769e-4834-b2d1-c9776a1938a1"/>
Oct 25 21:48:05 user nova-compute[74189]:       <nova:ports>
Oct 25 21:48:05 user nova-compute[74189]:         <nova:port uuid="96b88f54-6536-46e6-b6fc-11af60ae3f3f">
Oct 25 21:48:05 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 25 21:48:05 user nova-compute[74189]:         </nova:port>
Oct 25 21:48:05 user nova-compute[74189]:       </nova:ports>
Oct 25 21:48:05 user nova-compute[74189]:     </nova:instance>
Oct 25 21:48:05 user nova-compute[74189]:   </metadata>
Oct 25 21:48:05 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:48:05 user nova-compute[74189]:     <system>
Oct 25 21:48:05 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:48:05 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:48:05 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:48:05 user nova-compute[74189]:       <entry name="serial">3735964b-ac6d-41d6-9c9c-f9fc91723558</entry>
Oct 25 21:48:05 user nova-compute[74189]:       <entry name="uuid">3735964b-ac6d-41d6-9c9c-f9fc91723558</entry>
Oct 25 21:48:05 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:48:05 user nova-compute[74189]:     </system>
Oct 25 21:48:05 user nova-compute[74189]:   </sysinfo>
Oct 25 21:48:05 user nova-compute[74189]:   <os>
Oct 25 21:48:05 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:48:05 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:48:05 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:48:05 user nova-compute[74189]:   </os>
Oct 25 21:48:05 user nova-compute[74189]:   <features>
Oct 25 21:48:05 user nova-compute[74189]:     <acpi/>
Oct 25 21:48:05 user nova-compute[74189]:     <apic/>
Oct 25 21:48:05 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:48:05 user nova-compute[74189]:   </features>
Oct 25 21:48:05 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:48:05 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:48:05 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:48:05 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:48:05 user nova-compute[74189]:   </clock>
Oct 25 21:48:05 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:48:05 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:48:05 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:48:05 user nova-compute[74189]:   </cpu>
Oct 25 21:48:05 user nova-compute[74189]:   <devices>
Oct 25 21:48:05 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:48:05 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:48:05 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/3735964b-ac6d-41d6-9c9c-f9fc91723558/disk"/>
Oct 25 21:48:05 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:48:05 user nova-compute[74189]:     </disk>
Oct 25 21:48:05 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:48:05 user nova-compute[74189]:       <mac address="fa:16:3e:63:f5:0c"/>
Oct 25 21:48:05 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:48:05 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:48:05 user nova-compute[74189]:       <target dev="tap96b88f54-65"/>
Oct 25 21:48:05 user nova-compute[74189]:     </interface>
Oct 25 21:48:05 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:48:05 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/3735964b-ac6d-41d6-9c9c-f9fc91723558/console.log" append="off"/>
Oct 25 21:48:05 user nova-compute[74189]:     </serial>
Oct 25 21:48:05 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:48:05 user nova-compute[74189]:     <video>
Oct 25 21:48:05 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:48:05 user nova-compute[74189]:     </video>
Oct 25 21:48:05 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:48:05 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:48:05 user nova-compute[74189]:     </rng>
Oct 25 21:48:05 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:48:05 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:48:05 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:48:05 user nova-compute[74189]:     </memballoon>
Oct 25 21:48:05 user nova-compute[74189]:   </devices>
Oct 25 21:48:05 user nova-compute[74189]: </domain>
Oct 25 21:48:05 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:48:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1874233760',display_name='tempest-TestStampPattern-server-1874233760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1874233760',id=50,image_ref='90e46664-769e-4834-b2d1-c9776a1938a1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQ9OkIshA11eGvW1QoEDYUze94CFpHLxzzrnPEgQ/2cw2YykkRNKJSJN8zmNNN6ley6mlQwKcYrckjb4ee76GPcAhjB40Ypfxi0u4ciFrGvjcvOeYKwMAfqYUHhAHDRpA==',key_name='tempest-TestStampPattern-1702097735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e6a19ad6e8249abbe10137bdad65ca6',ramdisk_id='',reservation_id='r-onewxqqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0b5d04c5-dfae-42de-84b9-2fab02e3d679',image_min_disk='1',image_min_ram='0',image_owner_id='6e6a19ad6e8249abbe10137bdad65ca6',image_owner_project_name='tempest-TestStampPattern-367314632',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-367314632-project-member',image_user_id='ea97d3b6a27a4b569c04e26aa6043289',network_allocated='True',owner_project_name='tempest-TestStampPattern-367314632',owner_user_name='tempest-TestStampPattern-367314632-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:48:02Z,user_data=None,user_id='ea97d3b6a27a4b569c04e26aa6043289',uuid=3735964b-ac6d-41d6-9c9c-f9fc91723558,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96b88f54-6536-46e6-b6fc-11af60ae3f3f", "address": "fa:16:3e:63:f5:0c", "network": {"id": "d2a72b33-1451-4343-a1ac-3e7cb75ec083", "bridge": "br-int", "label": "tempest-TestStampPattern-234506410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6a19ad6e8249abbe10137bdad65ca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b88f54-65", "ovs_interfaceid": "96b88f54-6536-46e6-b6fc-11af60ae3f3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Converting VIF {"id": "96b88f54-6536-46e6-b6fc-11af60ae3f3f", "address": "fa:16:3e:63:f5:0c", "network": {"id": "d2a72b33-1451-4343-a1ac-3e7cb75ec083", "bridge": "br-int", "label": "tempest-TestStampPattern-234506410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6a19ad6e8249abbe10137bdad65ca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b88f54-65", "ovs_interfaceid": "96b88f54-6536-46e6-b6fc-11af60ae3f3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:f5:0c,bridge_name='br-int',has_traffic_filtering=True,id=96b88f54-6536-46e6-b6fc-11af60ae3f3f,network=Network(d2a72b33-1451-4343-a1ac-3e7cb75ec083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96b88f54-65') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG os_vif [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:f5:0c,bridge_name='br-int',has_traffic_filtering=True,id=96b88f54-6536-46e6-b6fc-11af60ae3f3f,network=Network(d2a72b33-1451-4343-a1ac-3e7cb75ec083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96b88f54-65') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-ee2bd106-b7f1-48e3-88e7-783727c4bc62 req-07cf5d1f-00e0-41c9-aef7-2b6fb32d0630 service nova] Releasing lock "refresh_cache-3735964b-ac6d-41d6-9c9c-f9fc91723558" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1d268858-bf6c-565a-9a9f-09527d5abcd6', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96b88f54-65, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96b88f54-65, col_values=(('qos', UUID('f9c354d4-aa9b-4dc6-9b6d-4ed59b8bc588')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96b88f54-65, col_values=(('external_ids', {'iface-id': '96b88f54-6536-46e6-b6fc-11af60ae3f3f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:f5:0c', 'vm-uuid': '3735964b-ac6d-41d6-9c9c-f9fc91723558'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:05 user nova-compute[74189]: INFO os_vif [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:f5:0c,bridge_name='br-int',has_traffic_filtering=True,id=96b88f54-6536-46e6-b6fc-11af60ae3f3f,network=Network(d2a72b33-1451-4343-a1ac-3e7cb75ec083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96b88f54-65')
Oct 25 21:48:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:48:05 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] No VIF found with MAC fa:16:3e:63:f5:0c, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:48:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:07 user nova-compute[74189]: DEBUG nova.compute.manager [req-952bba4a-c19f-4250-a1b9-2db42281856b req-b63b4cd2-a61c-462e-982e-f71866c9c095 service nova] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Received event network-vif-plugged-96b88f54-6536-46e6-b6fc-11af60ae3f3f {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:48:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-952bba4a-c19f-4250-a1b9-2db42281856b req-b63b4cd2-a61c-462e-982e-f71866c9c095 service nova] Acquiring lock "3735964b-ac6d-41d6-9c9c-f9fc91723558-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:48:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-952bba4a-c19f-4250-a1b9-2db42281856b req-b63b4cd2-a61c-462e-982e-f71866c9c095 service nova] Lock "3735964b-ac6d-41d6-9c9c-f9fc91723558-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:48:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-952bba4a-c19f-4250-a1b9-2db42281856b req-b63b4cd2-a61c-462e-982e-f71866c9c095 service nova] Lock "3735964b-ac6d-41d6-9c9c-f9fc91723558-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:48:07 user nova-compute[74189]: DEBUG nova.compute.manager [req-952bba4a-c19f-4250-a1b9-2db42281856b req-b63b4cd2-a61c-462e-982e-f71866c9c095 service nova] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] No waiting events found dispatching network-vif-plugged-96b88f54-6536-46e6-b6fc-11af60ae3f3f {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:48:07 user nova-compute[74189]: WARNING nova.compute.manager [req-952bba4a-c19f-4250-a1b9-2db42281856b req-b63b4cd2-a61c-462e-982e-f71866c9c095 service nova] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Received unexpected event network-vif-plugged-96b88f54-6536-46e6-b6fc-11af60ae3f3f for instance with vm_state building and task_state spawning.
Oct 25 21:48:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:09 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:09 user nova-compute[74189]: DEBUG nova.compute.manager [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:48:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:48:09 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Instance spawned successfully.
Oct 25 21:48:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:48:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:48:09 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:48:09 user nova-compute[74189]: DEBUG nova.compute.manager [req-e2d0fece-f382-458d-bd6a-ffc7bf6d92b6 req-7d3206fc-ccd2-4ca7-9301-4cf1609d2bd4 service nova] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Received event network-vif-plugged-96b88f54-6536-46e6-b6fc-11af60ae3f3f {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:48:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e2d0fece-f382-458d-bd6a-ffc7bf6d92b6 req-7d3206fc-ccd2-4ca7-9301-4cf1609d2bd4 service nova] Acquiring lock "3735964b-ac6d-41d6-9c9c-f9fc91723558-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:48:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e2d0fece-f382-458d-bd6a-ffc7bf6d92b6 req-7d3206fc-ccd2-4ca7-9301-4cf1609d2bd4 service nova] Lock "3735964b-ac6d-41d6-9c9c-f9fc91723558-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:48:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e2d0fece-f382-458d-bd6a-ffc7bf6d92b6 req-7d3206fc-ccd2-4ca7-9301-4cf1609d2bd4 service nova] Lock "3735964b-ac6d-41d6-9c9c-f9fc91723558-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:48:09 user nova-compute[74189]: DEBUG nova.compute.manager [req-e2d0fece-f382-458d-bd6a-ffc7bf6d92b6 req-7d3206fc-ccd2-4ca7-9301-4cf1609d2bd4 service nova] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] No waiting events found dispatching network-vif-plugged-96b88f54-6536-46e6-b6fc-11af60ae3f3f {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:48:09 user nova-compute[74189]: WARNING nova.compute.manager [req-e2d0fece-f382-458d-bd6a-ffc7bf6d92b6 req-7d3206fc-ccd2-4ca7-9301-4cf1609d2bd4 service nova] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Received unexpected event network-vif-plugged-96b88f54-6536-46e6-b6fc-11af60ae3f3f for instance with vm_state building and task_state spawning.
Oct 25 21:48:09 user nova-compute[74189]: INFO nova.compute.manager [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Took 7.09 seconds to spawn the instance on the hypervisor.
Oct 25 21:48:09 user nova-compute[74189]: DEBUG nova.compute.manager [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:48:09 user nova-compute[74189]: INFO nova.compute.manager [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Took 7.83 seconds to build instance.
Oct 25 21:48:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-0bd27293-5c79-4d82-8062-51041a629fd3 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "3735964b-ac6d-41d6-9c9c-f9fc91723558" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.935s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:48:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a3011a0f-9b6b-446f-8dd3-8f2199c97f22 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Acquiring lock "b3899ed2-d7b4-465b-b512-569898cc46d2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:48:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a3011a0f-9b6b-446f-8dd3-8f2199c97f22 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lock "b3899ed2-d7b4-465b-b512-569898cc46d2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:48:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a3011a0f-9b6b-446f-8dd3-8f2199c97f22 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Acquiring lock "b3899ed2-d7b4-465b-b512-569898cc46d2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:48:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a3011a0f-9b6b-446f-8dd3-8f2199c97f22 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lock "b3899ed2-d7b4-465b-b512-569898cc46d2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:48:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a3011a0f-9b6b-446f-8dd3-8f2199c97f22 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lock "b3899ed2-d7b4-465b-b512-569898cc46d2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:48:10 user nova-compute[74189]: INFO nova.compute.manager [None req-a3011a0f-9b6b-446f-8dd3-8f2199c97f22 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Terminating instance
Oct 25 21:48:10 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a3011a0f-9b6b-446f-8dd3-8f2199c97f22 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:48:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:10 user nova-compute[74189]: DEBUG nova.compute.manager [req-8c6fe76b-b319-4e80-832f-8a0a89ff6df4 req-c893b70b-1cc4-4afe-bf4f-589260078b6a service nova] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Received event network-vif-unplugged-a432e177-4407-4899-8954-9728927b40e0 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:48:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8c6fe76b-b319-4e80-832f-8a0a89ff6df4 req-c893b70b-1cc4-4afe-bf4f-589260078b6a service nova] Acquiring lock "b3899ed2-d7b4-465b-b512-569898cc46d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:48:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8c6fe76b-b319-4e80-832f-8a0a89ff6df4 req-c893b70b-1cc4-4afe-bf4f-589260078b6a service nova] Lock "b3899ed2-d7b4-465b-b512-569898cc46d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:48:10 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-8c6fe76b-b319-4e80-832f-8a0a89ff6df4 req-c893b70b-1cc4-4afe-bf4f-589260078b6a service nova] Lock "b3899ed2-d7b4-465b-b512-569898cc46d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:48:10 user nova-compute[74189]: DEBUG nova.compute.manager [req-8c6fe76b-b319-4e80-832f-8a0a89ff6df4 req-c893b70b-1cc4-4afe-bf4f-589260078b6a service nova] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] No waiting events found dispatching network-vif-unplugged-a432e177-4407-4899-8954-9728927b40e0 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:48:10 user nova-compute[74189]: DEBUG nova.compute.manager [req-8c6fe76b-b319-4e80-832f-8a0a89ff6df4 req-c893b70b-1cc4-4afe-bf4f-589260078b6a service nova] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Received event network-vif-unplugged-a432e177-4407-4899-8954-9728927b40e0 for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:48:11 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Instance destroyed successfully.
Oct 25 21:48:11 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a3011a0f-9b6b-446f-8dd3-8f2199c97f22 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lazy-loading 'resources' on Instance uuid b3899ed2-d7b4-465b-b512-569898cc46d2 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:48:11 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-a3011a0f-9b6b-446f-8dd3-8f2199c97f22 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1389553397',display_name='tempest-VolumesActionsTest-instance-1389553397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1389553397',id=49,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:46:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e9ba950bd71349a2bfac732f770a9731',ramdisk_id='',reservation_id='r-wuaozcis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-159377188',owner_user_name='tempest-VolumesActionsTest-159377188-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:46:26Z,user_data=None,user_id='06898f18a73c449c95fea8ee727741f0',uuid=b3899ed2-d7b4-465b-b512-569898cc46d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a432e177-4407-4899-8954-9728927b40e0", "address": "fa:16:3e:3a:ba:54", "network": {"id": "9fd8198e-7326-4533-a88c-c4ca629214d6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-40841454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9ba950bd71349a2bfac732f770a9731", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa432e177-44", "ovs_interfaceid": "a432e177-4407-4899-8954-9728927b40e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:48:11 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-a3011a0f-9b6b-446f-8dd3-8f2199c97f22 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Converting VIF {"id": "a432e177-4407-4899-8954-9728927b40e0", "address": "fa:16:3e:3a:ba:54", "network": {"id": "9fd8198e-7326-4533-a88c-c4ca629214d6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-40841454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9ba950bd71349a2bfac732f770a9731", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa432e177-44", "ovs_interfaceid": "a432e177-4407-4899-8954-9728927b40e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:48:11 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-a3011a0f-9b6b-446f-8dd3-8f2199c97f22 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ba:54,bridge_name='br-int',has_traffic_filtering=True,id=a432e177-4407-4899-8954-9728927b40e0,network=Network(9fd8198e-7326-4533-a88c-c4ca629214d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa432e177-44') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:48:11 user nova-compute[74189]: DEBUG os_vif [None req-a3011a0f-9b6b-446f-8dd3-8f2199c97f22 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ba:54,bridge_name='br-int',has_traffic_filtering=True,id=a432e177-4407-4899-8954-9728927b40e0,network=Network(9fd8198e-7326-4533-a88c-c4ca629214d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa432e177-44') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:48:11 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:11 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa432e177-44, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:48:11 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:11 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:48:11 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:11 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=59904318-1c48-4133-9a83-508b6e2fbb46) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:48:11 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:11 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:48:11 user nova-compute[74189]: INFO os_vif [None req-a3011a0f-9b6b-446f-8dd3-8f2199c97f22 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ba:54,bridge_name='br-int',has_traffic_filtering=True,id=a432e177-4407-4899-8954-9728927b40e0,network=Network(9fd8198e-7326-4533-a88c-c4ca629214d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa432e177-44')
Oct 25 21:48:11 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-a3011a0f-9b6b-446f-8dd3-8f2199c97f22 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Deleting instance files /opt/stack/data/nova/instances/b3899ed2-d7b4-465b-b512-569898cc46d2_del
Oct 25 21:48:11 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-a3011a0f-9b6b-446f-8dd3-8f2199c97f22 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Deletion of /opt/stack/data/nova/instances/b3899ed2-d7b4-465b-b512-569898cc46d2_del complete
Oct 25 21:48:11 user nova-compute[74189]: INFO nova.compute.manager [None req-a3011a0f-9b6b-446f-8dd3-8f2199c97f22 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Took 0.99 seconds to destroy the instance on the hypervisor.
Oct 25 21:48:11 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-a3011a0f-9b6b-446f-8dd3-8f2199c97f22 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:48:11 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:48:11 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:48:12 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:48:12 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Took 0.56 seconds to deallocate network for instance.
Oct 25 21:48:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a3011a0f-9b6b-446f-8dd3-8f2199c97f22 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:48:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a3011a0f-9b6b-446f-8dd3-8f2199c97f22 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:48:12 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a3011a0f-9b6b-446f-8dd3-8f2199c97f22 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:48:12 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a3011a0f-9b6b-446f-8dd3-8f2199c97f22 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:48:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a3011a0f-9b6b-446f-8dd3-8f2199c97f22 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.286s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:48:12 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-a3011a0f-9b6b-446f-8dd3-8f2199c97f22 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Deleted allocations for instance b3899ed2-d7b4-465b-b512-569898cc46d2
Oct 25 21:48:12 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a3011a0f-9b6b-446f-8dd3-8f2199c97f22 tempest-VolumesActionsTest-159377188 tempest-VolumesActionsTest-159377188-project-member] Lock "b3899ed2-d7b4-465b-b512-569898cc46d2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.053s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:48:13 user nova-compute[74189]: DEBUG nova.compute.manager [req-a2b9d721-6d50-4d74-986e-be1019c24d9f req-52344459-68be-4872-93ec-26609a208906 service nova] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Received event network-vif-plugged-a432e177-4407-4899-8954-9728927b40e0 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:48:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a2b9d721-6d50-4d74-986e-be1019c24d9f req-52344459-68be-4872-93ec-26609a208906 service nova] Acquiring lock "b3899ed2-d7b4-465b-b512-569898cc46d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:48:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a2b9d721-6d50-4d74-986e-be1019c24d9f req-52344459-68be-4872-93ec-26609a208906 service nova] Lock "b3899ed2-d7b4-465b-b512-569898cc46d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:48:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a2b9d721-6d50-4d74-986e-be1019c24d9f req-52344459-68be-4872-93ec-26609a208906 service nova] Lock "b3899ed2-d7b4-465b-b512-569898cc46d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:48:13 user nova-compute[74189]: DEBUG nova.compute.manager [req-a2b9d721-6d50-4d74-986e-be1019c24d9f req-52344459-68be-4872-93ec-26609a208906 service nova] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] No waiting events found dispatching network-vif-plugged-a432e177-4407-4899-8954-9728927b40e0 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:48:13 user nova-compute[74189]: WARNING nova.compute.manager [req-a2b9d721-6d50-4d74-986e-be1019c24d9f req-52344459-68be-4872-93ec-26609a208906 service nova] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Received unexpected event network-vif-plugged-a432e177-4407-4899-8954-9728927b40e0 for instance with vm_state deleted and task_state None.
Oct 25 21:48:13 user nova-compute[74189]: DEBUG nova.compute.manager [req-a2b9d721-6d50-4d74-986e-be1019c24d9f req-52344459-68be-4872-93ec-26609a208906 service nova] [instance: b3899ed2-d7b4-465b-b512-569898cc46d2] Received event network-vif-deleted-a432e177-4407-4899-8954-9728927b40e0 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:48:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:20 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:48:20 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:48:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-0b5d04c5-dfae-42de-84b9-2fab02e3d679" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:48:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-0b5d04c5-dfae-42de-84b9-2fab02e3d679" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:48:20 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:48:21 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Updating instance_info_cache with network_info: [{"id": "e05cb4c8-e712-4628-9d3d-a72653f19860", "address": "fa:16:3e:dc:d9:66", "network": {"id": "d2a72b33-1451-4343-a1ac-3e7cb75ec083", "bridge": "br-int", "label": "tempest-TestStampPattern-234506410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6a19ad6e8249abbe10137bdad65ca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05cb4c8-e7", "ovs_interfaceid": "e05cb4c8-e712-4628-9d3d-a72653f19860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:48:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-0b5d04c5-dfae-42de-84b9-2fab02e3d679" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:48:21 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:48:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:48:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 21:48:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:48:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:48:21 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:23 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:48:23 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:48:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:27 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:48:27 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:48:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:48:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:48:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:48:27 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:48:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:48:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:48:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:48:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:48:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:48:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:48:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:48:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:48:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:48:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:48:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:48:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:48:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3735964b-ac6d-41d6-9c9c-f9fc91723558/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:48:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3735964b-ac6d-41d6-9c9c-f9fc91723558/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:48:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3735964b-ac6d-41d6-9c9c-f9fc91723558/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:48:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3735964b-ac6d-41d6-9c9c-f9fc91723558/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:48:29 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:48:29 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:48:29 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=8442MB free_disk=24.847366333007812GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:48:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:48:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:48:30 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:48:30 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance fff8f286-0baa-4865-994f-4418af3edd0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:48:30 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 0b5d04c5-dfae-42de-84b9-2fab02e3d679 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:48:30 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3735964b-ac6d-41d6-9c9c-f9fc91723558 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:48:30 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:48:30 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:48:30 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:48:30 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:48:30 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:48:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.298s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:48:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:32 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:48:32 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:48:32 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:48:32 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:48:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:34 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:48:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c6c32ce2-4ead-429e-acfb-a3e6e61afdaf tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:48:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c6c32ce2-4ead-429e-acfb-a3e6e61afdaf tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:48:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c6c32ce2-4ead-429e-acfb-a3e6e61afdaf tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:48:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c6c32ce2-4ead-429e-acfb-a3e6e61afdaf tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:48:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c6c32ce2-4ead-429e-acfb-a3e6e61afdaf tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:48:39 user nova-compute[74189]: INFO nova.compute.manager [None req-c6c32ce2-4ead-429e-acfb-a3e6e61afdaf tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Terminating instance
Oct 25 21:48:39 user nova-compute[74189]: DEBUG nova.compute.manager [None req-c6c32ce2-4ead-429e-acfb-a3e6e61afdaf tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:48:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:39 user nova-compute[74189]: DEBUG nova.compute.manager [req-49c92ff1-ff95-45e9-b119-8f25ee4a503f req-6da02818-dc00-4240-b3e9-24763b120ee5 service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Received event network-vif-unplugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:48:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-49c92ff1-ff95-45e9-b119-8f25ee4a503f req-6da02818-dc00-4240-b3e9-24763b120ee5 service nova] Acquiring lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:48:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-49c92ff1-ff95-45e9-b119-8f25ee4a503f req-6da02818-dc00-4240-b3e9-24763b120ee5 service nova] Lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:48:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-49c92ff1-ff95-45e9-b119-8f25ee4a503f req-6da02818-dc00-4240-b3e9-24763b120ee5 service nova] Lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:48:39 user nova-compute[74189]: DEBUG nova.compute.manager [req-49c92ff1-ff95-45e9-b119-8f25ee4a503f req-6da02818-dc00-4240-b3e9-24763b120ee5 service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] No waiting events found dispatching network-vif-unplugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:48:39 user nova-compute[74189]: DEBUG nova.compute.manager [req-49c92ff1-ff95-45e9-b119-8f25ee4a503f req-6da02818-dc00-4240-b3e9-24763b120ee5 service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Received event network-vif-unplugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:48:40 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Instance destroyed successfully.
Oct 25 21:48:40 user nova-compute[74189]: DEBUG nova.objects.instance [None req-c6c32ce2-4ead-429e-acfb-a3e6e61afdaf tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lazy-loading 'resources' on Instance uuid 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:48:40 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-c6c32ce2-4ead-429e-acfb-a3e6e61afdaf tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:31:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1844515886',display_name='tempest-ServerRescueNegativeTestJSON-server-1844515886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1844515886',id=32,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:36:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3df03fc18fc3467db76e336c6de78c92',ramdisk_id='',reservation_id='r-7eqktzfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-383982506',owner_user_name='tempest-ServerRescueNegativeTestJSON-383982506-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:37:55Z,user_data=None,user_id='155c948b95c64c9083da984cdf6af494',uuid=3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "address": "fa:16:3e:5d:2c:57", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d0e911-b6", "ovs_interfaceid": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:48:40 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-c6c32ce2-4ead-429e-acfb-a3e6e61afdaf tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Converting VIF {"id": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "address": "fa:16:3e:5d:2c:57", "network": {"id": "b496a106-2367-44dc-a788-bcd22ec98feb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1969898074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df03fc18fc3467db76e336c6de78c92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d0e911-b6", "ovs_interfaceid": "67d0e911-b6fd-44a7-ad9c-8b204562a0bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:48:40 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-c6c32ce2-4ead-429e-acfb-a3e6e61afdaf tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:2c:57,bridge_name='br-int',has_traffic_filtering=True,id=67d0e911-b6fd-44a7-ad9c-8b204562a0bf,network=Network(b496a106-2367-44dc-a788-bcd22ec98feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d0e911-b6') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:48:40 user nova-compute[74189]: DEBUG os_vif [None req-c6c32ce2-4ead-429e-acfb-a3e6e61afdaf tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:2c:57,bridge_name='br-int',has_traffic_filtering=True,id=67d0e911-b6fd-44a7-ad9c-8b204562a0bf,network=Network(b496a106-2367-44dc-a788-bcd22ec98feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d0e911-b6') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:48:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67d0e911-b6, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:48:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:48:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d94cd34e-4617-40f9-8063-dd8ddf2d7d33) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:48:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:40 user nova-compute[74189]: INFO os_vif [None req-c6c32ce2-4ead-429e-acfb-a3e6e61afdaf tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:2c:57,bridge_name='br-int',has_traffic_filtering=True,id=67d0e911-b6fd-44a7-ad9c-8b204562a0bf,network=Network(b496a106-2367-44dc-a788-bcd22ec98feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d0e911-b6')
Oct 25 21:48:40 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-c6c32ce2-4ead-429e-acfb-a3e6e61afdaf tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Deleting instance files /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef_del
Oct 25 21:48:40 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-c6c32ce2-4ead-429e-acfb-a3e6e61afdaf tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Deletion of /opt/stack/data/nova/instances/3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef_del complete
Oct 25 21:48:40 user nova-compute[74189]: INFO nova.compute.manager [None req-c6c32ce2-4ead-429e-acfb-a3e6e61afdaf tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 25 21:48:40 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-c6c32ce2-4ead-429e-acfb-a3e6e61afdaf tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:48:40 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:48:40 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:48:41 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:48:41 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Took 0.88 seconds to deallocate network for instance.
Oct 25 21:48:41 user nova-compute[74189]: DEBUG nova.compute.manager [req-6ba23547-edb3-43e2-9f3d-40272d53f5df req-0b57015a-c633-48a9-b443-ccaef072604c service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Received event network-vif-deleted-67d0e911-b6fd-44a7-ad9c-8b204562a0bf {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:48:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c6c32ce2-4ead-429e-acfb-a3e6e61afdaf tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:48:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c6c32ce2-4ead-429e-acfb-a3e6e61afdaf tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:48:41 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-c6c32ce2-4ead-429e-acfb-a3e6e61afdaf tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:48:41 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-c6c32ce2-4ead-429e-acfb-a3e6e61afdaf tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:48:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c6c32ce2-4ead-429e-acfb-a3e6e61afdaf tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:48:41 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-c6c32ce2-4ead-429e-acfb-a3e6e61afdaf tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Deleted allocations for instance 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef
Oct 25 21:48:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-c6c32ce2-4ead-429e-acfb-a3e6e61afdaf tempest-ServerRescueNegativeTestJSON-383982506 tempest-ServerRescueNegativeTestJSON-383982506-project-member] Lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.164s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:48:42 user nova-compute[74189]: DEBUG nova.compute.manager [req-9d507156-c4d9-4c7e-939e-7c5486b3c498 req-5b414067-26b2-4e24-ab46-0fbf426e5c35 service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Received event network-vif-plugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:48:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9d507156-c4d9-4c7e-939e-7c5486b3c498 req-5b414067-26b2-4e24-ab46-0fbf426e5c35 service nova] Acquiring lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:48:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9d507156-c4d9-4c7e-939e-7c5486b3c498 req-5b414067-26b2-4e24-ab46-0fbf426e5c35 service nova] Lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:48:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9d507156-c4d9-4c7e-939e-7c5486b3c498 req-5b414067-26b2-4e24-ab46-0fbf426e5c35 service nova] Lock "3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:48:42 user nova-compute[74189]: DEBUG nova.compute.manager [req-9d507156-c4d9-4c7e-939e-7c5486b3c498 req-5b414067-26b2-4e24-ab46-0fbf426e5c35 service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] No waiting events found dispatching network-vif-plugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:48:42 user nova-compute[74189]: WARNING nova.compute.manager [req-9d507156-c4d9-4c7e-939e-7c5486b3c498 req-5b414067-26b2-4e24-ab46-0fbf426e5c35 service nova] [instance: 3dc2d7b4-7b75-4fbf-9193-a13a2cff31ef] Received unexpected event network-vif-plugged-67d0e911-b6fd-44a7-ad9c-8b204562a0bf for instance with vm_state deleted and task_state None.
Oct 25 21:48:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:48:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:48:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:49:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 21:49:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:49:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:49:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:49:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a3ecd552-3973-4491-8e4a-d3b50f7e6dfc tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Acquiring lock "fff8f286-0baa-4865-994f-4418af3edd0a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:49:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a3ecd552-3973-4491-8e4a-d3b50f7e6dfc tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "fff8f286-0baa-4865-994f-4418af3edd0a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:49:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a3ecd552-3973-4491-8e4a-d3b50f7e6dfc tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Acquiring lock "fff8f286-0baa-4865-994f-4418af3edd0a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:49:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a3ecd552-3973-4491-8e4a-d3b50f7e6dfc tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "fff8f286-0baa-4865-994f-4418af3edd0a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:49:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a3ecd552-3973-4491-8e4a-d3b50f7e6dfc tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "fff8f286-0baa-4865-994f-4418af3edd0a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:49:06 user nova-compute[74189]: INFO nova.compute.manager [None req-a3ecd552-3973-4491-8e4a-d3b50f7e6dfc tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Terminating instance
Oct 25 21:49:06 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a3ecd552-3973-4491-8e4a-d3b50f7e6dfc tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:49:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:06 user nova-compute[74189]: DEBUG nova.compute.manager [req-f9175c22-0c39-40c8-8764-4bba9e7aa954 req-035c5e91-c1ea-448f-8eb7-36d1b884539a service nova] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Received event network-vif-unplugged-7e686cf6-429d-4de6-8bfc-c57e256bd47a {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:49:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f9175c22-0c39-40c8-8764-4bba9e7aa954 req-035c5e91-c1ea-448f-8eb7-36d1b884539a service nova] Acquiring lock "fff8f286-0baa-4865-994f-4418af3edd0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:49:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f9175c22-0c39-40c8-8764-4bba9e7aa954 req-035c5e91-c1ea-448f-8eb7-36d1b884539a service nova] Lock "fff8f286-0baa-4865-994f-4418af3edd0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:49:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-f9175c22-0c39-40c8-8764-4bba9e7aa954 req-035c5e91-c1ea-448f-8eb7-36d1b884539a service nova] Lock "fff8f286-0baa-4865-994f-4418af3edd0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:49:06 user nova-compute[74189]: DEBUG nova.compute.manager [req-f9175c22-0c39-40c8-8764-4bba9e7aa954 req-035c5e91-c1ea-448f-8eb7-36d1b884539a service nova] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] No waiting events found dispatching network-vif-unplugged-7e686cf6-429d-4de6-8bfc-c57e256bd47a {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:49:06 user nova-compute[74189]: DEBUG nova.compute.manager [req-f9175c22-0c39-40c8-8764-4bba9e7aa954 req-035c5e91-c1ea-448f-8eb7-36d1b884539a service nova] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Received event network-vif-unplugged-7e686cf6-429d-4de6-8bfc-c57e256bd47a for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:49:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:07 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Instance destroyed successfully.
Oct 25 21:49:07 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a3ecd552-3973-4491-8e4a-d3b50f7e6dfc tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lazy-loading 'resources' on Instance uuid fff8f286-0baa-4865-994f-4418af3edd0a {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:49:07 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-a3ecd552-3973-4491-8e4a-d3b50f7e6dfc tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:40:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-727778402',display_name='tempest-SnapshotDataIntegrityTests-server-727778402',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-727778402',id=45,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJChaGAYchfI6+cZmQTo+EBnWqcpveg+fkDzaCz48wgJRof/qlTEZzhVdC7OszT4Uw2KuF+scBk2Yb4OkHPq3cQm/md0D7TF55bt6KLds401fwItaMbsz99eQkw3xNdHTQ==',key_name='tempest-keypair-1482529823',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:40:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ebe8152ff7c45b8bc0df106f7e61a91',ramdisk_id='',reservation_id='r-p28be20u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1158049058',owner_user_name='tempest-SnapshotDataIntegrityTests-1158049058-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:40:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9425c459e5364e3f9239908d003ab077',uuid=fff8f286-0baa-4865-994f-4418af3edd0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e686cf6-429d-4de6-8bfc-c57e256bd47a", "address": "fa:16:3e:b8:cf:38", "network": {"id": "0a65fa19-10fa-4360-b5f9-4faa8905e7df", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1120695373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebe8152ff7c45b8bc0df106f7e61a91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e686cf6-42", "ovs_interfaceid": "7e686cf6-429d-4de6-8bfc-c57e256bd47a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:49:07 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-a3ecd552-3973-4491-8e4a-d3b50f7e6dfc tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Converting VIF {"id": "7e686cf6-429d-4de6-8bfc-c57e256bd47a", "address": "fa:16:3e:b8:cf:38", "network": {"id": "0a65fa19-10fa-4360-b5f9-4faa8905e7df", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1120695373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebe8152ff7c45b8bc0df106f7e61a91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e686cf6-42", "ovs_interfaceid": "7e686cf6-429d-4de6-8bfc-c57e256bd47a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:49:07 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-a3ecd552-3973-4491-8e4a-d3b50f7e6dfc tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:cf:38,bridge_name='br-int',has_traffic_filtering=True,id=7e686cf6-429d-4de6-8bfc-c57e256bd47a,network=Network(0a65fa19-10fa-4360-b5f9-4faa8905e7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e686cf6-42') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:49:07 user nova-compute[74189]: DEBUG os_vif [None req-a3ecd552-3973-4491-8e4a-d3b50f7e6dfc tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:cf:38,bridge_name='br-int',has_traffic_filtering=True,id=7e686cf6-429d-4de6-8bfc-c57e256bd47a,network=Network(0a65fa19-10fa-4360-b5f9-4faa8905e7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e686cf6-42') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:49:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e686cf6-42, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:49:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:49:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6f46f379-5584-488b-859f-59446211b46f) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:49:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:49:07 user nova-compute[74189]: INFO os_vif [None req-a3ecd552-3973-4491-8e4a-d3b50f7e6dfc tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:cf:38,bridge_name='br-int',has_traffic_filtering=True,id=7e686cf6-429d-4de6-8bfc-c57e256bd47a,network=Network(0a65fa19-10fa-4360-b5f9-4faa8905e7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e686cf6-42')
Oct 25 21:49:07 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-a3ecd552-3973-4491-8e4a-d3b50f7e6dfc tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Deleting instance files /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a_del
Oct 25 21:49:07 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-a3ecd552-3973-4491-8e4a-d3b50f7e6dfc tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Deletion of /opt/stack/data/nova/instances/fff8f286-0baa-4865-994f-4418af3edd0a_del complete
Oct 25 21:49:07 user nova-compute[74189]: INFO nova.compute.manager [None req-a3ecd552-3973-4491-8e4a-d3b50f7e6dfc tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 25 21:49:07 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-a3ecd552-3973-4491-8e4a-d3b50f7e6dfc tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:49:07 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:49:07 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:49:08 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:49:08 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Took 0.79 seconds to deallocate network for instance.
Oct 25 21:49:08 user nova-compute[74189]: DEBUG nova.compute.manager [req-24b024cc-8401-4414-90cb-7ff3d03b7945 req-3eb05cc3-3e23-478d-992c-89113deac7bc service nova] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Received event network-vif-deleted-7e686cf6-429d-4de6-8bfc-c57e256bd47a {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:49:08 user nova-compute[74189]: INFO nova.compute.manager [req-24b024cc-8401-4414-90cb-7ff3d03b7945 req-3eb05cc3-3e23-478d-992c-89113deac7bc service nova] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Neutron deleted interface 7e686cf6-429d-4de6-8bfc-c57e256bd47a; detaching it from the instance and deleting it from the info cache
Oct 25 21:49:08 user nova-compute[74189]: DEBUG nova.network.neutron [req-24b024cc-8401-4414-90cb-7ff3d03b7945 req-3eb05cc3-3e23-478d-992c-89113deac7bc service nova] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:49:08 user nova-compute[74189]: DEBUG nova.compute.manager [req-24b024cc-8401-4414-90cb-7ff3d03b7945 req-3eb05cc3-3e23-478d-992c-89113deac7bc service nova] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Detach interface failed, port_id=7e686cf6-429d-4de6-8bfc-c57e256bd47a, reason: Instance fff8f286-0baa-4865-994f-4418af3edd0a could not be found. {{(pid=74189) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 21:49:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a3ecd552-3973-4491-8e4a-d3b50f7e6dfc tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:49:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a3ecd552-3973-4491-8e4a-d3b50f7e6dfc tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:49:08 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a3ecd552-3973-4491-8e4a-d3b50f7e6dfc tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:49:08 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a3ecd552-3973-4491-8e4a-d3b50f7e6dfc tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:49:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a3ecd552-3973-4491-8e4a-d3b50f7e6dfc tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:49:08 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-a3ecd552-3973-4491-8e4a-d3b50f7e6dfc tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Deleted allocations for instance fff8f286-0baa-4865-994f-4418af3edd0a
Oct 25 21:49:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a3ecd552-3973-4491-8e4a-d3b50f7e6dfc tempest-SnapshotDataIntegrityTests-1158049058 tempest-SnapshotDataIntegrityTests-1158049058-project-member] Lock "fff8f286-0baa-4865-994f-4418af3edd0a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.039s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:49:08 user nova-compute[74189]: DEBUG nova.compute.manager [req-d723ab3b-1e71-4150-94db-cca9d9036be1 req-6099b8b8-eaa3-44a3-bc6c-bc2fb21af599 service nova] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Received event network-vif-plugged-7e686cf6-429d-4de6-8bfc-c57e256bd47a {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:49:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d723ab3b-1e71-4150-94db-cca9d9036be1 req-6099b8b8-eaa3-44a3-bc6c-bc2fb21af599 service nova] Acquiring lock "fff8f286-0baa-4865-994f-4418af3edd0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:49:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d723ab3b-1e71-4150-94db-cca9d9036be1 req-6099b8b8-eaa3-44a3-bc6c-bc2fb21af599 service nova] Lock "fff8f286-0baa-4865-994f-4418af3edd0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:49:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d723ab3b-1e71-4150-94db-cca9d9036be1 req-6099b8b8-eaa3-44a3-bc6c-bc2fb21af599 service nova] Lock "fff8f286-0baa-4865-994f-4418af3edd0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:49:08 user nova-compute[74189]: DEBUG nova.compute.manager [req-d723ab3b-1e71-4150-94db-cca9d9036be1 req-6099b8b8-eaa3-44a3-bc6c-bc2fb21af599 service nova] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] No waiting events found dispatching network-vif-plugged-7e686cf6-429d-4de6-8bfc-c57e256bd47a {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:49:08 user nova-compute[74189]: WARNING nova.compute.manager [req-d723ab3b-1e71-4150-94db-cca9d9036be1 req-6099b8b8-eaa3-44a3-bc6c-bc2fb21af599 service nova] [instance: fff8f286-0baa-4865-994f-4418af3edd0a] Received unexpected event network-vif-plugged-7e686cf6-429d-4de6-8bfc-c57e256bd47a for instance with vm_state deleted and task_state None.
Oct 25 21:49:12 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:49:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 21:49:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:49:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:49:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:20 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:49:20 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:49:20 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Rebuilding the list of instances to heal {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 21:49:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-0b5d04c5-dfae-42de-84b9-2fab02e3d679" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:49:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-0b5d04c5-dfae-42de-84b9-2fab02e3d679" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:49:20 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:49:20 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lazy-loading 'info_cache' on Instance uuid 0b5d04c5-dfae-42de-84b9-2fab02e3d679 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:49:21 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Updating instance_info_cache with network_info: [{"id": "e05cb4c8-e712-4628-9d3d-a72653f19860", "address": "fa:16:3e:dc:d9:66", "network": {"id": "d2a72b33-1451-4343-a1ac-3e7cb75ec083", "bridge": "br-int", "label": "tempest-TestStampPattern-234506410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6a19ad6e8249abbe10137bdad65ca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05cb4c8-e7", "ovs_interfaceid": "e05cb4c8-e712-4628-9d3d-a72653f19860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:49:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-0b5d04c5-dfae-42de-84b9-2fab02e3d679" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:49:21 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:49:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:23 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:49:23 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:49:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:49:28 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:49:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:49:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:49:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:49:28 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:49:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3735964b-ac6d-41d6-9c9c-f9fc91723558/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:49:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3735964b-ac6d-41d6-9c9c-f9fc91723558/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:49:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3735964b-ac6d-41d6-9c9c-f9fc91723558/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:49:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3735964b-ac6d-41d6-9c9c-f9fc91723558/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:49:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:49:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:49:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:49:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:49:30 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:49:30 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:49:30 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=8631MB free_disk=24.46628189086914GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:49:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:49:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:49:30 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 0b5d04c5-dfae-42de-84b9-2fab02e3d679 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:49:30 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3735964b-ac6d-41d6-9c9c-f9fc91723558 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:49:30 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:49:30 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:49:30 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:49:30 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:49:30 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:49:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.267s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:49:31 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:49:31 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:49:31 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:49:31 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:49:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:49:32 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:49:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:36 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:49:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:37 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:49:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Acquiring lock "13d0e024-6010-4f59-81a0-d0a03c0da77d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:49:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lock "13d0e024-6010-4f59-81a0-d0a03c0da77d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:49:42 user nova-compute[74189]: DEBUG nova.compute.manager [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:49:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:49:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:49:42 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:49:42 user nova-compute[74189]: INFO nova.compute.claims [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Claim successful on node user
Oct 25 21:49:43 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:49:43 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:49:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.256s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:49:43 user nova-compute[74189]: DEBUG nova.compute.manager [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:49:43 user nova-compute[74189]: DEBUG nova.compute.manager [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:49:43 user nova-compute[74189]: DEBUG nova.network.neutron [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:49:43 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:49:43 user nova-compute[74189]: DEBUG nova.compute.manager [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:49:43 user nova-compute[74189]: DEBUG nova.policy [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac0dda9ed41347be954e24564fa2c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e86c3ee328348fe93386b07dcae4f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:49:43 user nova-compute[74189]: DEBUG nova.compute.manager [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:49:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:49:43 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Creating image(s)
Oct 25 21:49:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Acquiring lock "/opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:49:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lock "/opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:49:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lock "/opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:49:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:49:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.193s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:49:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:49:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:49:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:49:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.170s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:49:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:49:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk 1073741824" returned: 0 in 0.059s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:49:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:49:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:49:43 user nova-compute[74189]: DEBUG nova.network.neutron [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Successfully created port: 54785795-8e55-4db8-90ac-14061103f08a {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:49:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.235s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:49:44 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Checking if we can resize image /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:49:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:49:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:49:44 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Cannot resize image /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:49:44 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:49:44 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Ensure instance console log exists: /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:49:44 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:49:44 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:49:44 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:49:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:44 user nova-compute[74189]: DEBUG nova.network.neutron [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Successfully updated port: 54785795-8e55-4db8-90ac-14061103f08a {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:49:44 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Acquiring lock "refresh_cache-13d0e024-6010-4f59-81a0-d0a03c0da77d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:49:44 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Acquired lock "refresh_cache-13d0e024-6010-4f59-81a0-d0a03c0da77d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:49:44 user nova-compute[74189]: DEBUG nova.network.neutron [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:49:44 user nova-compute[74189]: DEBUG nova.compute.manager [req-c1c3fbb7-26fa-4e9d-9af0-e63de797214d req-a02db6f3-0cd0-49a0-9465-2c616e181bae service nova] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Received event network-changed-54785795-8e55-4db8-90ac-14061103f08a {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:49:44 user nova-compute[74189]: DEBUG nova.compute.manager [req-c1c3fbb7-26fa-4e9d-9af0-e63de797214d req-a02db6f3-0cd0-49a0-9465-2c616e181bae service nova] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Refreshing instance network info cache due to event network-changed-54785795-8e55-4db8-90ac-14061103f08a. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:49:44 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c1c3fbb7-26fa-4e9d-9af0-e63de797214d req-a02db6f3-0cd0-49a0-9465-2c616e181bae service nova] Acquiring lock "refresh_cache-13d0e024-6010-4f59-81a0-d0a03c0da77d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:49:44 user nova-compute[74189]: DEBUG nova.network.neutron [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:49:44 user nova-compute[74189]: DEBUG nova.network.neutron [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Updating instance_info_cache with network_info: [{"id": "54785795-8e55-4db8-90ac-14061103f08a", "address": "fa:16:3e:a9:e1:fb", "network": {"id": "693c2b04-3a2f-474f-b7cd-2ab549fcd007", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1877604098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e86c3ee328348fe93386b07dcae4f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54785795-8e", "ovs_interfaceid": "54785795-8e55-4db8-90ac-14061103f08a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:49:44 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Releasing lock "refresh_cache-13d0e024-6010-4f59-81a0-d0a03c0da77d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:49:44 user nova-compute[74189]: DEBUG nova.compute.manager [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Instance network_info: |[{"id": "54785795-8e55-4db8-90ac-14061103f08a", "address": "fa:16:3e:a9:e1:fb", "network": {"id": "693c2b04-3a2f-474f-b7cd-2ab549fcd007", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1877604098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e86c3ee328348fe93386b07dcae4f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54785795-8e", "ovs_interfaceid": "54785795-8e55-4db8-90ac-14061103f08a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:49:44 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c1c3fbb7-26fa-4e9d-9af0-e63de797214d req-a02db6f3-0cd0-49a0-9465-2c616e181bae service nova] Acquired lock "refresh_cache-13d0e024-6010-4f59-81a0-d0a03c0da77d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:49:44 user nova-compute[74189]: DEBUG nova.network.neutron [req-c1c3fbb7-26fa-4e9d-9af0-e63de797214d req-a02db6f3-0cd0-49a0-9465-2c616e181bae service nova] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Refreshing network info cache for port 54785795-8e55-4db8-90ac-14061103f08a {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:49:44 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Start _get_guest_xml network_info=[{"id": "54785795-8e55-4db8-90ac-14061103f08a", "address": "fa:16:3e:a9:e1:fb", "network": {"id": "693c2b04-3a2f-474f-b7cd-2ab549fcd007", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1877604098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e86c3ee328348fe93386b07dcae4f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54785795-8e", "ovs_interfaceid": "54785795-8e55-4db8-90ac-14061103f08a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:49:44 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:49:44 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:49:44 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1991976129',display_name='tempest-ServersNegativeTestJSON-server-1991976129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1991976129',id=51,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e86c3ee328348fe93386b07dcae4f18',ramdisk_id='',reservation_id='r-95e0i9zu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-775535143',owner_user_name='tempest-ServersNegativeTestJSON-775535143-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:49:43Z,user_data=None,user_id='ac0dda9ed41347be954e24564fa2c85b',uuid=13d0e024-6010-4f59-81a0-d0a03c0da77d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54785795-8e55-4db8-90ac-14061103f08a", "address": "fa:16:3e:a9:e1:fb", "network": {"id": "693c2b04-3a2f-474f-b7cd-2ab549fcd007", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1877604098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e86c3ee328348fe93386b07dcae4f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54785795-8e", "ovs_interfaceid": "54785795-8e55-4db8-90ac-14061103f08a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Converting VIF {"id": "54785795-8e55-4db8-90ac-14061103f08a", "address": "fa:16:3e:a9:e1:fb", "network": {"id": "693c2b04-3a2f-474f-b7cd-2ab549fcd007", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1877604098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e86c3ee328348fe93386b07dcae4f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54785795-8e", "ovs_interfaceid": "54785795-8e55-4db8-90ac-14061103f08a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:e1:fb,bridge_name='br-int',has_traffic_filtering=True,id=54785795-8e55-4db8-90ac-14061103f08a,network=Network(693c2b04-3a2f-474f-b7cd-2ab549fcd007),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54785795-8e') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG nova.objects.instance [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lazy-loading 'pci_devices' on Instance uuid 13d0e024-6010-4f59-81a0-d0a03c0da77d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:49:45 user nova-compute[74189]:   <uuid>13d0e024-6010-4f59-81a0-d0a03c0da77d</uuid>
Oct 25 21:49:45 user nova-compute[74189]:   <name>instance-00000033</name>
Oct 25 21:49:45 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:49:45 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:49:45 user nova-compute[74189]:   <metadata>
Oct 25 21:49:45 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:49:45 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:49:45 user nova-compute[74189]:       <nova:name>tempest-ServersNegativeTestJSON-server-1991976129</nova:name>
Oct 25 21:49:45 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:49:44</nova:creationTime>
Oct 25 21:49:45 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:49:45 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:49:45 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:49:45 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:49:45 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:49:45 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:49:45 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:49:45 user nova-compute[74189]:       <nova:owner>
Oct 25 21:49:45 user nova-compute[74189]:         <nova:user uuid="ac0dda9ed41347be954e24564fa2c85b">tempest-ServersNegativeTestJSON-775535143-project-member</nova:user>
Oct 25 21:49:45 user nova-compute[74189]:         <nova:project uuid="6e86c3ee328348fe93386b07dcae4f18">tempest-ServersNegativeTestJSON-775535143</nova:project>
Oct 25 21:49:45 user nova-compute[74189]:       </nova:owner>
Oct 25 21:49:45 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:49:45 user nova-compute[74189]:       <nova:ports>
Oct 25 21:49:45 user nova-compute[74189]:         <nova:port uuid="54785795-8e55-4db8-90ac-14061103f08a">
Oct 25 21:49:45 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 25 21:49:45 user nova-compute[74189]:         </nova:port>
Oct 25 21:49:45 user nova-compute[74189]:       </nova:ports>
Oct 25 21:49:45 user nova-compute[74189]:     </nova:instance>
Oct 25 21:49:45 user nova-compute[74189]:   </metadata>
Oct 25 21:49:45 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:49:45 user nova-compute[74189]:     <system>
Oct 25 21:49:45 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:49:45 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:49:45 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:49:45 user nova-compute[74189]:       <entry name="serial">13d0e024-6010-4f59-81a0-d0a03c0da77d</entry>
Oct 25 21:49:45 user nova-compute[74189]:       <entry name="uuid">13d0e024-6010-4f59-81a0-d0a03c0da77d</entry>
Oct 25 21:49:45 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:49:45 user nova-compute[74189]:     </system>
Oct 25 21:49:45 user nova-compute[74189]:   </sysinfo>
Oct 25 21:49:45 user nova-compute[74189]:   <os>
Oct 25 21:49:45 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:49:45 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:49:45 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:49:45 user nova-compute[74189]:   </os>
Oct 25 21:49:45 user nova-compute[74189]:   <features>
Oct 25 21:49:45 user nova-compute[74189]:     <acpi/>
Oct 25 21:49:45 user nova-compute[74189]:     <apic/>
Oct 25 21:49:45 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:49:45 user nova-compute[74189]:   </features>
Oct 25 21:49:45 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:49:45 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:49:45 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:49:45 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:49:45 user nova-compute[74189]:   </clock>
Oct 25 21:49:45 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:49:45 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:49:45 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:49:45 user nova-compute[74189]:   </cpu>
Oct 25 21:49:45 user nova-compute[74189]:   <devices>
Oct 25 21:49:45 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:49:45 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:49:45 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk"/>
Oct 25 21:49:45 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:49:45 user nova-compute[74189]:     </disk>
Oct 25 21:49:45 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:49:45 user nova-compute[74189]:       <mac address="fa:16:3e:a9:e1:fb"/>
Oct 25 21:49:45 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:49:45 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:49:45 user nova-compute[74189]:       <target dev="tap54785795-8e"/>
Oct 25 21:49:45 user nova-compute[74189]:     </interface>
Oct 25 21:49:45 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:49:45 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/console.log" append="off"/>
Oct 25 21:49:45 user nova-compute[74189]:     </serial>
Oct 25 21:49:45 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:49:45 user nova-compute[74189]:     <video>
Oct 25 21:49:45 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:49:45 user nova-compute[74189]:     </video>
Oct 25 21:49:45 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:49:45 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:49:45 user nova-compute[74189]:     </rng>
Oct 25 21:49:45 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:49:45 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:49:45 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:49:45 user nova-compute[74189]:     </memballoon>
Oct 25 21:49:45 user nova-compute[74189]:   </devices>
Oct 25 21:49:45 user nova-compute[74189]: </domain>
Oct 25 21:49:45 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1991976129',display_name='tempest-ServersNegativeTestJSON-server-1991976129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1991976129',id=51,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e86c3ee328348fe93386b07dcae4f18',ramdisk_id='',reservation_id='r-95e0i9zu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-775535143',owner_user_name='tempest-ServersNegativeTestJSON-775535143-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:49:43Z,user_data=None,user_id='ac0dda9ed41347be954e24564fa2c85b',uuid=13d0e024-6010-4f59-81a0-d0a03c0da77d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54785795-8e55-4db8-90ac-14061103f08a", "address": "fa:16:3e:a9:e1:fb", "network": {"id": "693c2b04-3a2f-474f-b7cd-2ab549fcd007", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1877604098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e86c3ee328348fe93386b07dcae4f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54785795-8e", "ovs_interfaceid": "54785795-8e55-4db8-90ac-14061103f08a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Converting VIF {"id": "54785795-8e55-4db8-90ac-14061103f08a", "address": "fa:16:3e:a9:e1:fb", "network": {"id": "693c2b04-3a2f-474f-b7cd-2ab549fcd007", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1877604098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e86c3ee328348fe93386b07dcae4f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54785795-8e", "ovs_interfaceid": "54785795-8e55-4db8-90ac-14061103f08a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:e1:fb,bridge_name='br-int',has_traffic_filtering=True,id=54785795-8e55-4db8-90ac-14061103f08a,network=Network(693c2b04-3a2f-474f-b7cd-2ab549fcd007),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54785795-8e') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG os_vif [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:e1:fb,bridge_name='br-int',has_traffic_filtering=True,id=54785795-8e55-4db8-90ac-14061103f08a,network=Network(693c2b04-3a2f-474f-b7cd-2ab549fcd007),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54785795-8e') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fc14cb7f-0091-54e6-918b-e09b49e5e76a', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54785795-8e, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap54785795-8e, col_values=(('qos', UUID('f6d691d7-3a3b-4401-80d0-bea106e84f9a')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap54785795-8e, col_values=(('external_ids', {'iface-id': '54785795-8e55-4db8-90ac-14061103f08a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:e1:fb', 'vm-uuid': '13d0e024-6010-4f59-81a0-d0a03c0da77d'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:45 user nova-compute[74189]: INFO os_vif [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:e1:fb,bridge_name='br-int',has_traffic_filtering=True,id=54785795-8e55-4db8-90ac-14061103f08a,network=Network(693c2b04-3a2f-474f-b7cd-2ab549fcd007),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54785795-8e')
Oct 25 21:49:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] No VIF found with MAC fa:16:3e:a9:e1:fb, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG nova.network.neutron [req-c1c3fbb7-26fa-4e9d-9af0-e63de797214d req-a02db6f3-0cd0-49a0-9465-2c616e181bae service nova] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Updated VIF entry in instance network info cache for port 54785795-8e55-4db8-90ac-14061103f08a. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG nova.network.neutron [req-c1c3fbb7-26fa-4e9d-9af0-e63de797214d req-a02db6f3-0cd0-49a0-9465-2c616e181bae service nova] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Updating instance_info_cache with network_info: [{"id": "54785795-8e55-4db8-90ac-14061103f08a", "address": "fa:16:3e:a9:e1:fb", "network": {"id": "693c2b04-3a2f-474f-b7cd-2ab549fcd007", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1877604098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e86c3ee328348fe93386b07dcae4f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54785795-8e", "ovs_interfaceid": "54785795-8e55-4db8-90ac-14061103f08a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:49:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-c1c3fbb7-26fa-4e9d-9af0-e63de797214d req-a02db6f3-0cd0-49a0-9465-2c616e181bae service nova] Releasing lock "refresh_cache-13d0e024-6010-4f59-81a0-d0a03c0da77d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:49:46 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:46 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:46 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:46 user nova-compute[74189]: DEBUG nova.compute.manager [req-9831724e-f5ab-4091-a6f5-bb305de13843 req-d7eb141c-50d1-4778-b196-69d783e7a571 service nova] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Received event network-vif-plugged-54785795-8e55-4db8-90ac-14061103f08a {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:49:46 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9831724e-f5ab-4091-a6f5-bb305de13843 req-d7eb141c-50d1-4778-b196-69d783e7a571 service nova] Acquiring lock "13d0e024-6010-4f59-81a0-d0a03c0da77d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:49:46 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9831724e-f5ab-4091-a6f5-bb305de13843 req-d7eb141c-50d1-4778-b196-69d783e7a571 service nova] Lock "13d0e024-6010-4f59-81a0-d0a03c0da77d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:49:46 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9831724e-f5ab-4091-a6f5-bb305de13843 req-d7eb141c-50d1-4778-b196-69d783e7a571 service nova] Lock "13d0e024-6010-4f59-81a0-d0a03c0da77d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:49:46 user nova-compute[74189]: DEBUG nova.compute.manager [req-9831724e-f5ab-4091-a6f5-bb305de13843 req-d7eb141c-50d1-4778-b196-69d783e7a571 service nova] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] No waiting events found dispatching network-vif-plugged-54785795-8e55-4db8-90ac-14061103f08a {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:49:46 user nova-compute[74189]: WARNING nova.compute.manager [req-9831724e-f5ab-4091-a6f5-bb305de13843 req-d7eb141c-50d1-4778-b196-69d783e7a571 service nova] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Received unexpected event network-vif-plugged-54785795-8e55-4db8-90ac-14061103f08a for instance with vm_state building and task_state spawning.
Oct 25 21:49:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:48 user nova-compute[74189]: DEBUG nova.compute.manager [req-dce6ce2b-0526-4d50-b37a-98e761534be6 req-e608537d-6b2c-40a4-a7fb-76aab84bcfc5 service nova] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Received event network-vif-plugged-54785795-8e55-4db8-90ac-14061103f08a {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:49:48 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-dce6ce2b-0526-4d50-b37a-98e761534be6 req-e608537d-6b2c-40a4-a7fb-76aab84bcfc5 service nova] Acquiring lock "13d0e024-6010-4f59-81a0-d0a03c0da77d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:49:48 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-dce6ce2b-0526-4d50-b37a-98e761534be6 req-e608537d-6b2c-40a4-a7fb-76aab84bcfc5 service nova] Lock "13d0e024-6010-4f59-81a0-d0a03c0da77d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:49:48 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-dce6ce2b-0526-4d50-b37a-98e761534be6 req-e608537d-6b2c-40a4-a7fb-76aab84bcfc5 service nova] Lock "13d0e024-6010-4f59-81a0-d0a03c0da77d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:49:48 user nova-compute[74189]: DEBUG nova.compute.manager [req-dce6ce2b-0526-4d50-b37a-98e761534be6 req-e608537d-6b2c-40a4-a7fb-76aab84bcfc5 service nova] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] No waiting events found dispatching network-vif-plugged-54785795-8e55-4db8-90ac-14061103f08a {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:49:48 user nova-compute[74189]: WARNING nova.compute.manager [req-dce6ce2b-0526-4d50-b37a-98e761534be6 req-e608537d-6b2c-40a4-a7fb-76aab84bcfc5 service nova] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Received unexpected event network-vif-plugged-54785795-8e55-4db8-90ac-14061103f08a for instance with vm_state building and task_state spawning.
Oct 25 21:49:48 user nova-compute[74189]: DEBUG nova.compute.manager [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:49:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:49:48 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Instance spawned successfully.
Oct 25 21:49:48 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:49:49 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:49:49 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:49:49 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:49:49 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:49:49 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:49:49 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:49:49 user nova-compute[74189]: INFO nova.compute.manager [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Took 5.63 seconds to spawn the instance on the hypervisor.
Oct 25 21:49:49 user nova-compute[74189]: DEBUG nova.compute.manager [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:49:49 user nova-compute[74189]: INFO nova.compute.manager [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Took 6.25 seconds to build instance.
Oct 25 21:49:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-f59d06bb-1149-4b6a-8f0e-28e18b8dc38a tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lock "13d0e024-6010-4f59-81a0-d0a03c0da77d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.366s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:49:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:53 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:54 user nova-compute[74189]: DEBUG nova.compute.manager [req-3264f4ed-60fb-4116-9a0d-80cc420392c1 req-37a7d17f-7ded-4eed-ad20-9181ba6580df service nova] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Received event network-changed-96b88f54-6536-46e6-b6fc-11af60ae3f3f {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:49:54 user nova-compute[74189]: DEBUG nova.compute.manager [req-3264f4ed-60fb-4116-9a0d-80cc420392c1 req-37a7d17f-7ded-4eed-ad20-9181ba6580df service nova] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Refreshing instance network info cache due to event network-changed-96b88f54-6536-46e6-b6fc-11af60ae3f3f. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:49:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3264f4ed-60fb-4116-9a0d-80cc420392c1 req-37a7d17f-7ded-4eed-ad20-9181ba6580df service nova] Acquiring lock "refresh_cache-3735964b-ac6d-41d6-9c9c-f9fc91723558" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:49:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3264f4ed-60fb-4116-9a0d-80cc420392c1 req-37a7d17f-7ded-4eed-ad20-9181ba6580df service nova] Acquired lock "refresh_cache-3735964b-ac6d-41d6-9c9c-f9fc91723558" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:49:54 user nova-compute[74189]: DEBUG nova.network.neutron [req-3264f4ed-60fb-4116-9a0d-80cc420392c1 req-37a7d17f-7ded-4eed-ad20-9181ba6580df service nova] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Refreshing network info cache for port 96b88f54-6536-46e6-b6fc-11af60ae3f3f {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:49:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:54 user nova-compute[74189]: DEBUG nova.network.neutron [req-3264f4ed-60fb-4116-9a0d-80cc420392c1 req-37a7d17f-7ded-4eed-ad20-9181ba6580df service nova] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Updated VIF entry in instance network info cache for port 96b88f54-6536-46e6-b6fc-11af60ae3f3f. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:49:54 user nova-compute[74189]: DEBUG nova.network.neutron [req-3264f4ed-60fb-4116-9a0d-80cc420392c1 req-37a7d17f-7ded-4eed-ad20-9181ba6580df service nova] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Updating instance_info_cache with network_info: [{"id": "96b88f54-6536-46e6-b6fc-11af60ae3f3f", "address": "fa:16:3e:63:f5:0c", "network": {"id": "d2a72b33-1451-4343-a1ac-3e7cb75ec083", "bridge": "br-int", "label": "tempest-TestStampPattern-234506410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6a19ad6e8249abbe10137bdad65ca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b88f54-65", "ovs_interfaceid": "96b88f54-6536-46e6-b6fc-11af60ae3f3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:49:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Acquiring lock "3735964b-ac6d-41d6-9c9c-f9fc91723558" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:49:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "3735964b-ac6d-41d6-9c9c-f9fc91723558" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:49:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-3264f4ed-60fb-4116-9a0d-80cc420392c1 req-37a7d17f-7ded-4eed-ad20-9181ba6580df service nova] Releasing lock "refresh_cache-3735964b-ac6d-41d6-9c9c-f9fc91723558" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:49:55 user nova-compute[74189]: DEBUG nova.objects.instance [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lazy-loading 'flavor' on Instance uuid 3735964b-ac6d-41d6-9c9c-f9fc91723558 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:49:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "3735964b-ac6d-41d6-9c9c-f9fc91723558" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.098s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:49:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:49:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Acquiring lock "3735964b-ac6d-41d6-9c9c-f9fc91723558" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:49:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "3735964b-ac6d-41d6-9c9c-f9fc91723558" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:49:55 user nova-compute[74189]: INFO nova.compute.manager [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Attaching volume a36d52b4-42a7-4bc5-9415-3d275009b8ed to /dev/vdb
Oct 25 21:49:55 user nova-compute[74189]: DEBUG os_brick.utils [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:49:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:49:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:49:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[063fa331-eddc-46ba-b0d2-6ae41e909d6e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:49:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:49:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:49:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cda4d3-e778-4a8f-9509-b69525fdb776]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:49:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:49:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:49:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2804d69e-e54f-49aa-a26b-6f8704e5f24a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:49:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[21485d1b-8681-44da-8822-4b9aa64cd403]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:49:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:49:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:49:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 21:49:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:49:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 21:49:55 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 21:49:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[be894aec-a549-4990-b644-0d2c05641c0d]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:49:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 21:49:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 21:49:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 21:49:55 user nova-compute[74189]: DEBUG os_brick.utils [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:49:55 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Updating existing volume attachment record: 519495d5-913f-46b3-9b58-bbfa5cc9d635 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 21:49:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:50:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:50:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:50:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:50:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:50:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:50:09 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:50:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oXYfesPF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:50:13 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:50:13 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:50:13 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:50:13 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:50:13 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 21:50:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed -p 172.16.0.220:3260" returned: 21 in 0.045s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[066b37b7-d664-4ef5-8bd0-1e0a691d02b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 21:50:13 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c180719-6c27-4f27-80aa-52ce3fc6cc8e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed] added
Oct 25 21:50:13 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ed71f6-80c8-4eb8-a7e9-b3210e976d58]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.061s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe9b367-d510-4935-8ca0-8f036a717214]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oXYfesPF {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oXYfesPF" returned: 0 in 0.030s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[38441e6a-7d4e-4185-ad2d-a0f94755d850]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oXYfesPF'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4d3fa3-af5c-482d-a1f3-15231f1de774]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4053f8a8-6154-4f4a-b8c3-43b02daf89be]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 21:50:13 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 21:50:13 user nova-compute[74189]:  {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:50:13 user nova-compute[74189]: WARNING os_brick.initiator.connectors.iscsi [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 21:50:13 user nova-compute[74189]: 
Oct 25 21:50:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8669d47b-9f89-483f-a8fc-65dbc41da973]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed, portal: 172.16.0.220,3260]
Oct 25 21:50:13 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed, portal: 172.16.0.220,3260] successful.
Oct 25 21:50:13 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9992595-ba4c-4bb4-88c5-7f05ec831343]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0840e442-9cff-4069-af14-927565ba0e99]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed (non-flash)
Oct 25 21:50:13 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed (non-flash)
Oct 25 21:50:13 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.380s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[22599a82-2822-4c82-9486-bc86d9b84a98]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:50:13 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:50:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:50:14 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 21:50:14 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oXYfesPF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 21:50:14 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:50:14 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '26263623061353066', 'path': '/dev/sdb'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:50:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263623061353066', 'path': '/dev/sdb'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 21:50:14 user nova-compute[74189]: DEBUG nova.objects.instance [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lazy-loading 'flavor' on Instance uuid 3735964b-ac6d-41d6-9c9c-f9fc91723558 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:50:14 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 21:50:14 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:50:14 user nova-compute[74189]:   <source dev="/dev/sdb"/>
Oct 25 21:50:14 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:50:14 user nova-compute[74189]:   <serial>a36d52b4-42a7-4bc5-9415-3d275009b8ed</serial>
Oct 25 21:50:14 user nova-compute[74189]: </disk>
Oct 25 21:50:14 user nova-compute[74189]:  {{(pid=74189) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 21:50:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:50:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:50:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:50:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] No VIF found with MAC fa:16:3e:63:f5:0c, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:50:15 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-ef3e6357-23a7-42ad-862d-c4a4307556b7 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "3735964b-ac6d-41d6-9c9c-f9fc91723558" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.196s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:50:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Acquiring lock "3735964b-ac6d-41d6-9c9c-f9fc91723558" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:50:17 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "3735964b-ac6d-41d6-9c9c-f9fc91723558" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:50:17 user nova-compute[74189]: INFO nova.compute.manager [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Detaching volume a36d52b4-42a7-4bc5-9415-3d275009b8ed
Oct 25 21:50:17 user nova-compute[74189]: INFO nova.virt.block_device [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Attempting to driver detach volume a36d52b4-42a7-4bc5-9415-3d275009b8ed from mountpoint /dev/vdb
Oct 25 21:50:17 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Attempting to detach device vdb from instance 3735964b-ac6d-41d6-9c9c-f9fc91723558 from the persistent domain config. {{(pid=74189) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 21:50:17 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:50:17 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:50:17 user nova-compute[74189]:   <source dev="/dev/sdb"/>
Oct 25 21:50:17 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:50:17 user nova-compute[74189]:   <serial>a36d52b4-42a7-4bc5-9415-3d275009b8ed</serial>
Oct 25 21:50:17 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:50:17 user nova-compute[74189]: </disk>
Oct 25 21:50:17 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:50:17 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Successfully detached device vdb from instance 3735964b-ac6d-41d6-9c9c-f9fc91723558 from the persistent domain config.
Oct 25 21:50:17 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3735964b-ac6d-41d6-9c9c-f9fc91723558 from the live domain config. {{(pid=74189) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 21:50:17 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 21:50:17 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 21:50:17 user nova-compute[74189]:   <source dev="/dev/sdb"/>
Oct 25 21:50:17 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 21:50:17 user nova-compute[74189]:   <serial>a36d52b4-42a7-4bc5-9415-3d275009b8ed</serial>
Oct 25 21:50:17 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 21:50:17 user nova-compute[74189]: </disk>
Oct 25 21:50:17 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 21:50:17 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3735964b-ac6d-41d6-9c9c-f9fc91723558 {{(pid=74189) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 21:50:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:50:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:50:21 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:50:21 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:50:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-3735964b-ac6d-41d6-9c9c-f9fc91723558" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:50:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-3735964b-ac6d-41d6-9c9c-f9fc91723558" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:50:22 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:50:22 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Updating instance_info_cache with network_info: [{"id": "96b88f54-6536-46e6-b6fc-11af60ae3f3f", "address": "fa:16:3e:63:f5:0c", "network": {"id": "d2a72b33-1451-4343-a1ac-3e7cb75ec083", "bridge": "br-int", "label": "tempest-TestStampPattern-234506410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6a19ad6e8249abbe10137bdad65ca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b88f54-65", "ovs_interfaceid": "96b88f54-6536-46e6-b6fc-11af60ae3f3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:50:22 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-3735964b-ac6d-41d6-9c9c-f9fc91723558" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:50:22 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:50:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:50:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:50:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:50:24 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:50:24 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:50:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:50:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:50:29 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:50:29 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:50:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:50:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:50:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:50:29 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:50:29 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3735964b-ac6d-41d6-9c9c-f9fc91723558/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:50:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:50:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3735964b-ac6d-41d6-9c9c-f9fc91723558/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:50:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3735964b-ac6d-41d6-9c9c-f9fc91723558/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:50:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3735964b-ac6d-41d6-9c9c-f9fc91723558/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:50:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:50:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:50:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:50:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:50:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:50:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:50:30 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:50:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:50:31 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:50:31 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:50:31 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=8629MB free_disk=24.867923736572266GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:50:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:50:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:50:31 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 0b5d04c5-dfae-42de-84b9-2fab02e3d679 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:50:31 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3735964b-ac6d-41d6-9c9c-f9fc91723558 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:50:31 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 13d0e024-6010-4f59-81a0-d0a03c0da77d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:50:31 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:50:31 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:50:31 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:50:31 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:50:31 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:50:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.265s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:50:33 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:50:33 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:50:33 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:50:33 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:50:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:50:37 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3735964b-ac6d-41d6-9c9c-f9fc91723558 is timed out.
Oct 25 21:50:37 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Successfully detached device vdb from instance 3735964b-ac6d-41d6-9c9c-f9fc91723558 from the live domain config.
Oct 25 21:50:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oXYfesPF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 21:50:37 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 21:50:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[30640304-3683-43e8-9328-515acdf3225a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 21:50:37 user nova-compute[74189]: No targets found.
Oct 25 21:50:37 user nova-compute[74189]: iSNS:
Oct 25 21:50:37 user nova-compute[74189]: No targets found.
Oct 25 21:50:37 user nova-compute[74189]: STATIC:
Oct 25 21:50:37 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed
Oct 25 21:50:37 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 21:50:37 user nova-compute[74189]:                 Iface Name: default
Oct 25 21:50:37 user nova-compute[74189]: FIRMWARE:
Oct 25 21:50:37 user nova-compute[74189]: No targets found.
Oct 25 21:50:37 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 21:50:37 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 21:50:37 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f9367f-ab91-4680-8f6b-5efe1b256234]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e39a95-a2ed-4de1-a563-ba16375bd404]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed (non-flash)
Oct 25 21:50:37 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed (non-flash)
Oct 25 21:50:37 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2e42404c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed'): ({'sdb'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Removing single pathed devices sdb {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfed286-7c0f-468c-82fb-005323741e69]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ce1095-84ca-4f38-8874-937641dc8166]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Flushing IO for device /dev/sdb {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4a6cc0-a987-4310-bf5d-00b07b6673d5]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d872b14-1a74-4108-8572-7b907cd5c39b]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] SCSI volumes sdb have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[07101d09-7671-442d-be6b-5559cc2af195]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:50:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:50:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:50:38 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[16653596-6b93-4d59-87f2-e1a637b38029]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:50:38 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed, portal: 172.16.0.220,3260]
Oct 25 21:50:38 user nova-compute[74189]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed, portal: 172.16.0.220,3260] successful.
Oct 25 21:50:38 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:50:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:50:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a36d52b4-42a7-4bc5-9415-3d275009b8ed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:50:38 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[116d1504-80a3-4ec9-9672-7f967ce43ae8]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 21:50:38 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 21:50:38 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 21:50:38 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] <== disconnect_volume: return (296ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 21:50:38 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 21:50:38 user nova-compute[74189]: DEBUG nova.objects.instance [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lazy-loading 'flavor' on Instance uuid 3735964b-ac6d-41d6-9c9c-f9fc91723558 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:50:38 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:50:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-12344e44-30d8-48e4-af5b-6602a6b883b5 tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "3735964b-ac6d-41d6-9c9c-f9fc91723558" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.880s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:50:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:50:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:50:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:50:53 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:50:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:50:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:50:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:50:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:50:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:50:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:50:53 user nova-compute[74189]: DEBUG nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Verify base images {{(pid=74189) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 25 21:50:53 user nova-compute[74189]: DEBUG nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Image id 30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd yields fingerprint b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 {{(pid=74189) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 25 21:50:53 user nova-compute[74189]: INFO nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] image 30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd at (/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8): checking
Oct 25 21:50:53 user nova-compute[74189]: DEBUG nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] image 30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd at (/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8): image is in use {{(pid=74189) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 25 21:50:53 user nova-compute[74189]: DEBUG nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74189) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 25 21:50:53 user nova-compute[74189]: DEBUG nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Image id 90e46664-769e-4834-b2d1-c9776a1938a1 yields fingerprint 7f7494c3b89c5692d99eb6adee46d0cab5273a73 {{(pid=74189) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 25 21:50:53 user nova-compute[74189]: INFO nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] image 90e46664-769e-4834-b2d1-c9776a1938a1 at (/opt/stack/data/nova/instances/_base/7f7494c3b89c5692d99eb6adee46d0cab5273a73): checking
Oct 25 21:50:53 user nova-compute[74189]: DEBUG nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] image 90e46664-769e-4834-b2d1-c9776a1938a1 at (/opt/stack/data/nova/instances/_base/7f7494c3b89c5692d99eb6adee46d0cab5273a73): image is in use {{(pid=74189) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 25 21:50:53 user nova-compute[74189]: DEBUG nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] 3735964b-ac6d-41d6-9c9c-f9fc91723558 is a valid instance name {{(pid=74189) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 25 21:50:53 user nova-compute[74189]: DEBUG nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] 3735964b-ac6d-41d6-9c9c-f9fc91723558 has a disk file {{(pid=74189) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 25 21:50:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3735964b-ac6d-41d6-9c9c-f9fc91723558/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:50:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3735964b-ac6d-41d6-9c9c-f9fc91723558/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:50:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 3735964b-ac6d-41d6-9c9c-f9fc91723558 is backed by 7f7494c3b89c5692d99eb6adee46d0cab5273a73 {{(pid=74189) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 25 21:50:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] 0b5d04c5-dfae-42de-84b9-2fab02e3d679 is a valid instance name {{(pid=74189) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 25 21:50:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] 0b5d04c5-dfae-42de-84b9-2fab02e3d679 has a disk file {{(pid=74189) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 25 21:50:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:50:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:50:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 0b5d04c5-dfae-42de-84b9-2fab02e3d679 is backed by b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 {{(pid=74189) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 25 21:50:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] 13d0e024-6010-4f59-81a0-d0a03c0da77d is a valid instance name {{(pid=74189) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 25 21:50:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] 13d0e024-6010-4f59-81a0-d0a03c0da77d has a disk file {{(pid=74189) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 25 21:50:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:50:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:50:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 13d0e024-6010-4f59-81a0-d0a03c0da77d is backed by b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 {{(pid=74189) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 25 21:50:54 user nova-compute[74189]: WARNING nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Unknown base file: /opt/stack/data/nova/instances/_base/585e49721907e895ad71a4154c3a8aefaef1f6e2
Oct 25 21:50:54 user nova-compute[74189]: WARNING nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1be6b9e830596db7af797ecca2475c0af85d8000
Oct 25 21:50:54 user nova-compute[74189]: WARNING nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Unknown base file: /opt/stack/data/nova/instances/_base/fbf2ce42cb9248d36efe9eaf3f3104cd76c61fba
Oct 25 21:50:54 user nova-compute[74189]: WARNING nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3d05a980ab0df46df2e211bfe8133762d6a32a18
Oct 25 21:50:54 user nova-compute[74189]: WARNING nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Unknown base file: /opt/stack/data/nova/instances/_base/be39b622d16183486b86a5905433aefa5bc2f512
Oct 25 21:50:54 user nova-compute[74189]: WARNING nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Unknown base file: /opt/stack/data/nova/instances/_base/63bdca806e0fba6c8e110201ec3ca6c133fdbd7f
Oct 25 21:50:54 user nova-compute[74189]: WARNING nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Unknown base file: /opt/stack/data/nova/instances/_base/070cffac7a621c3286603ac36d65087ce49fdde9
Oct 25 21:50:54 user nova-compute[74189]: WARNING nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Unknown base file: /opt/stack/data/nova/instances/_base/cc877fb24144c79b92511ca92088df21297e3344
Oct 25 21:50:54 user nova-compute[74189]: INFO nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Active base files: /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 /opt/stack/data/nova/instances/_base/7f7494c3b89c5692d99eb6adee46d0cab5273a73
Oct 25 21:50:54 user nova-compute[74189]: INFO nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Removable base files: /opt/stack/data/nova/instances/_base/585e49721907e895ad71a4154c3a8aefaef1f6e2 /opt/stack/data/nova/instances/_base/1be6b9e830596db7af797ecca2475c0af85d8000 /opt/stack/data/nova/instances/_base/fbf2ce42cb9248d36efe9eaf3f3104cd76c61fba /opt/stack/data/nova/instances/_base/3d05a980ab0df46df2e211bfe8133762d6a32a18 /opt/stack/data/nova/instances/_base/be39b622d16183486b86a5905433aefa5bc2f512 /opt/stack/data/nova/instances/_base/63bdca806e0fba6c8e110201ec3ca6c133fdbd7f /opt/stack/data/nova/instances/_base/070cffac7a621c3286603ac36d65087ce49fdde9 /opt/stack/data/nova/instances/_base/cc877fb24144c79b92511ca92088df21297e3344
Oct 25 21:50:54 user nova-compute[74189]: INFO nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/585e49721907e895ad71a4154c3a8aefaef1f6e2
Oct 25 21:50:54 user nova-compute[74189]: INFO nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1be6b9e830596db7af797ecca2475c0af85d8000
Oct 25 21:50:54 user nova-compute[74189]: INFO nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fbf2ce42cb9248d36efe9eaf3f3104cd76c61fba
Oct 25 21:50:54 user nova-compute[74189]: INFO nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3d05a980ab0df46df2e211bfe8133762d6a32a18
Oct 25 21:50:54 user nova-compute[74189]: INFO nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/be39b622d16183486b86a5905433aefa5bc2f512
Oct 25 21:50:54 user nova-compute[74189]: INFO nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/63bdca806e0fba6c8e110201ec3ca6c133fdbd7f
Oct 25 21:50:54 user nova-compute[74189]: INFO nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/070cffac7a621c3286603ac36d65087ce49fdde9
Oct 25 21:50:54 user nova-compute[74189]: INFO nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cc877fb24144c79b92511ca92088df21297e3344
Oct 25 21:50:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Verification complete {{(pid=74189) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Oct 25 21:50:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Verify swap images {{(pid=74189) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Oct 25 21:50:54 user nova-compute[74189]: DEBUG nova.virt.libvirt.imagecache [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Verify ephemeral images {{(pid=74189) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Oct 25 21:50:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:51:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:51:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:51:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:51:07 user nova-compute[74189]: DEBUG nova.compute.manager [req-0f87bd85-0150-4e1e-b517-e65a79132915 req-ac113590-449f-489c-8d10-845865af3254 service nova] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Received event network-changed-96b88f54-6536-46e6-b6fc-11af60ae3f3f {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:51:07 user nova-compute[74189]: DEBUG nova.compute.manager [req-0f87bd85-0150-4e1e-b517-e65a79132915 req-ac113590-449f-489c-8d10-845865af3254 service nova] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Refreshing instance network info cache due to event network-changed-96b88f54-6536-46e6-b6fc-11af60ae3f3f. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:51:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0f87bd85-0150-4e1e-b517-e65a79132915 req-ac113590-449f-489c-8d10-845865af3254 service nova] Acquiring lock "refresh_cache-3735964b-ac6d-41d6-9c9c-f9fc91723558" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:51:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0f87bd85-0150-4e1e-b517-e65a79132915 req-ac113590-449f-489c-8d10-845865af3254 service nova] Acquired lock "refresh_cache-3735964b-ac6d-41d6-9c9c-f9fc91723558" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:51:07 user nova-compute[74189]: DEBUG nova.network.neutron [req-0f87bd85-0150-4e1e-b517-e65a79132915 req-ac113590-449f-489c-8d10-845865af3254 service nova] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Refreshing network info cache for port 96b88f54-6536-46e6-b6fc-11af60ae3f3f {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:51:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-275fa83a-e3e5-43c3-8f0e-7af2799575fd tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Acquiring lock "3735964b-ac6d-41d6-9c9c-f9fc91723558" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:51:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-275fa83a-e3e5-43c3-8f0e-7af2799575fd tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "3735964b-ac6d-41d6-9c9c-f9fc91723558" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:51:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-275fa83a-e3e5-43c3-8f0e-7af2799575fd tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Acquiring lock "3735964b-ac6d-41d6-9c9c-f9fc91723558-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:51:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-275fa83a-e3e5-43c3-8f0e-7af2799575fd tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "3735964b-ac6d-41d6-9c9c-f9fc91723558-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:51:07 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-275fa83a-e3e5-43c3-8f0e-7af2799575fd tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "3735964b-ac6d-41d6-9c9c-f9fc91723558-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:51:07 user nova-compute[74189]: INFO nova.compute.manager [None req-275fa83a-e3e5-43c3-8f0e-7af2799575fd tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Terminating instance
Oct 25 21:51:07 user nova-compute[74189]: DEBUG nova.compute.manager [None req-275fa83a-e3e5-43c3-8f0e-7af2799575fd tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:51:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:51:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:51:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:51:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:51:08 user nova-compute[74189]: DEBUG nova.network.neutron [req-0f87bd85-0150-4e1e-b517-e65a79132915 req-ac113590-449f-489c-8d10-845865af3254 service nova] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Updated VIF entry in instance network info cache for port 96b88f54-6536-46e6-b6fc-11af60ae3f3f. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:51:08 user nova-compute[74189]: DEBUG nova.network.neutron [req-0f87bd85-0150-4e1e-b517-e65a79132915 req-ac113590-449f-489c-8d10-845865af3254 service nova] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Updating instance_info_cache with network_info: [{"id": "96b88f54-6536-46e6-b6fc-11af60ae3f3f", "address": "fa:16:3e:63:f5:0c", "network": {"id": "d2a72b33-1451-4343-a1ac-3e7cb75ec083", "bridge": "br-int", "label": "tempest-TestStampPattern-234506410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6a19ad6e8249abbe10137bdad65ca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b88f54-65", "ovs_interfaceid": "96b88f54-6536-46e6-b6fc-11af60ae3f3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:51:08 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-0f87bd85-0150-4e1e-b517-e65a79132915 req-ac113590-449f-489c-8d10-845865af3254 service nova] Releasing lock "refresh_cache-3735964b-ac6d-41d6-9c9c-f9fc91723558" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:51:08 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Instance destroyed successfully.
Oct 25 21:51:08 user nova-compute[74189]: DEBUG nova.objects.instance [None req-275fa83a-e3e5-43c3-8f0e-7af2799575fd tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lazy-loading 'resources' on Instance uuid 3735964b-ac6d-41d6-9c9c-f9fc91723558 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:51:08 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-275fa83a-e3e5-43c3-8f0e-7af2799575fd tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:48:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1874233760',display_name='tempest-TestStampPattern-server-1874233760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1874233760',id=50,image_ref='90e46664-769e-4834-b2d1-c9776a1938a1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQ9OkIshA11eGvW1QoEDYUze94CFpHLxzzrnPEgQ/2cw2YykkRNKJSJN8zmNNN6ley6mlQwKcYrckjb4ee76GPcAhjB40Ypfxi0u4ciFrGvjcvOeYKwMAfqYUHhAHDRpA==',key_name='tempest-TestStampPattern-1702097735',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:48:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e6a19ad6e8249abbe10137bdad65ca6',ramdisk_id='',reservation_id='r-onewxqqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0b5d04c5-dfae-42de-84b9-2fab02e3d679',image_min_disk='1',image_min_ram='0',image_owner_id='6e6a19ad6e8249abbe10137bdad65ca6',image_owner_project_name='tempest-TestStampPattern-367314632',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-367314632-project-member',image_user_id='ea97d3b6a27a4b569c04e26aa6043289',owner_project_name='tempest-TestStampPattern-367314632',owner_user_name='tempest-TestStampPattern-367314632-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:48:10Z,user_data=None,user_id='ea97d3b6a27a4b569c04e26aa6043289',uuid=3735964b-ac6d-41d6-9c9c-f9fc91723558,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96b88f54-6536-46e6-b6fc-11af60ae3f3f", "address": "fa:16:3e:63:f5:0c", "network": {"id": "d2a72b33-1451-4343-a1ac-3e7cb75ec083", "bridge": "br-int", "label": "tempest-TestStampPattern-234506410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6a19ad6e8249abbe10137bdad65ca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b88f54-65", "ovs_interfaceid": "96b88f54-6536-46e6-b6fc-11af60ae3f3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:51:08 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-275fa83a-e3e5-43c3-8f0e-7af2799575fd tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Converting VIF {"id": "96b88f54-6536-46e6-b6fc-11af60ae3f3f", "address": "fa:16:3e:63:f5:0c", "network": {"id": "d2a72b33-1451-4343-a1ac-3e7cb75ec083", "bridge": "br-int", "label": "tempest-TestStampPattern-234506410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6a19ad6e8249abbe10137bdad65ca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b88f54-65", "ovs_interfaceid": "96b88f54-6536-46e6-b6fc-11af60ae3f3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:51:08 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-275fa83a-e3e5-43c3-8f0e-7af2799575fd tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:f5:0c,bridge_name='br-int',has_traffic_filtering=True,id=96b88f54-6536-46e6-b6fc-11af60ae3f3f,network=Network(d2a72b33-1451-4343-a1ac-3e7cb75ec083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96b88f54-65') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:51:08 user nova-compute[74189]: DEBUG os_vif [None req-275fa83a-e3e5-43c3-8f0e-7af2799575fd tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:f5:0c,bridge_name='br-int',has_traffic_filtering=True,id=96b88f54-6536-46e6-b6fc-11af60ae3f3f,network=Network(d2a72b33-1451-4343-a1ac-3e7cb75ec083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96b88f54-65') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:51:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:51:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96b88f54-65, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:51:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:51:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:51:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:51:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9c354d4-aa9b-4dc6-9b6d-4ed59b8bc588) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:51:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:51:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:51:08 user nova-compute[74189]: INFO os_vif [None req-275fa83a-e3e5-43c3-8f0e-7af2799575fd tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:f5:0c,bridge_name='br-int',has_traffic_filtering=True,id=96b88f54-6536-46e6-b6fc-11af60ae3f3f,network=Network(d2a72b33-1451-4343-a1ac-3e7cb75ec083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96b88f54-65')
Oct 25 21:51:08 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-275fa83a-e3e5-43c3-8f0e-7af2799575fd tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Deleting instance files /opt/stack/data/nova/instances/3735964b-ac6d-41d6-9c9c-f9fc91723558_del
Oct 25 21:51:08 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-275fa83a-e3e5-43c3-8f0e-7af2799575fd tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Deletion of /opt/stack/data/nova/instances/3735964b-ac6d-41d6-9c9c-f9fc91723558_del complete
Oct 25 21:51:08 user nova-compute[74189]: INFO nova.compute.manager [None req-275fa83a-e3e5-43c3-8f0e-7af2799575fd tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 25 21:51:08 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-275fa83a-e3e5-43c3-8f0e-7af2799575fd tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:51:08 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:51:08 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:51:09 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:51:09 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Took 0.62 seconds to deallocate network for instance.
Oct 25 21:51:09 user nova-compute[74189]: DEBUG nova.compute.manager [req-13e9eed3-b0de-45ec-ab54-838790a4f129 req-52964475-6dd9-4673-9c31-6fed6738cd8e service nova] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Received event network-vif-deleted-96b88f54-6536-46e6-b6fc-11af60ae3f3f {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:51:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-275fa83a-e3e5-43c3-8f0e-7af2799575fd tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:51:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-275fa83a-e3e5-43c3-8f0e-7af2799575fd tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:51:09 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-275fa83a-e3e5-43c3-8f0e-7af2799575fd tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:51:09 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-275fa83a-e3e5-43c3-8f0e-7af2799575fd tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:51:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-275fa83a-e3e5-43c3-8f0e-7af2799575fd tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:51:09 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-275fa83a-e3e5-43c3-8f0e-7af2799575fd tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Deleted allocations for instance 3735964b-ac6d-41d6-9c9c-f9fc91723558
Oct 25 21:51:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-275fa83a-e3e5-43c3-8f0e-7af2799575fd tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "3735964b-ac6d-41d6-9c9c-f9fc91723558" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.872s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:51:09 user nova-compute[74189]: DEBUG nova.compute.manager [req-e0a3a809-5c6e-4bc7-b9df-b3c3c9d89ccc req-865c9d98-52d4-46b5-b2fb-a560b2d7585e service nova] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Received event network-vif-unplugged-96b88f54-6536-46e6-b6fc-11af60ae3f3f {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:51:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e0a3a809-5c6e-4bc7-b9df-b3c3c9d89ccc req-865c9d98-52d4-46b5-b2fb-a560b2d7585e service nova] Acquiring lock "3735964b-ac6d-41d6-9c9c-f9fc91723558-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:51:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e0a3a809-5c6e-4bc7-b9df-b3c3c9d89ccc req-865c9d98-52d4-46b5-b2fb-a560b2d7585e service nova] Lock "3735964b-ac6d-41d6-9c9c-f9fc91723558-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:51:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e0a3a809-5c6e-4bc7-b9df-b3c3c9d89ccc req-865c9d98-52d4-46b5-b2fb-a560b2d7585e service nova] Lock "3735964b-ac6d-41d6-9c9c-f9fc91723558-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:51:09 user nova-compute[74189]: DEBUG nova.compute.manager [req-e0a3a809-5c6e-4bc7-b9df-b3c3c9d89ccc req-865c9d98-52d4-46b5-b2fb-a560b2d7585e service nova] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] No waiting events found dispatching network-vif-unplugged-96b88f54-6536-46e6-b6fc-11af60ae3f3f {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:51:09 user nova-compute[74189]: WARNING nova.compute.manager [req-e0a3a809-5c6e-4bc7-b9df-b3c3c9d89ccc req-865c9d98-52d4-46b5-b2fb-a560b2d7585e service nova] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Received unexpected event network-vif-unplugged-96b88f54-6536-46e6-b6fc-11af60ae3f3f for instance with vm_state deleted and task_state None.
Oct 25 21:51:09 user nova-compute[74189]: DEBUG nova.compute.manager [req-e0a3a809-5c6e-4bc7-b9df-b3c3c9d89ccc req-865c9d98-52d4-46b5-b2fb-a560b2d7585e service nova] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Received event network-vif-plugged-96b88f54-6536-46e6-b6fc-11af60ae3f3f {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:51:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e0a3a809-5c6e-4bc7-b9df-b3c3c9d89ccc req-865c9d98-52d4-46b5-b2fb-a560b2d7585e service nova] Acquiring lock "3735964b-ac6d-41d6-9c9c-f9fc91723558-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:51:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e0a3a809-5c6e-4bc7-b9df-b3c3c9d89ccc req-865c9d98-52d4-46b5-b2fb-a560b2d7585e service nova] Lock "3735964b-ac6d-41d6-9c9c-f9fc91723558-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:51:09 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e0a3a809-5c6e-4bc7-b9df-b3c3c9d89ccc req-865c9d98-52d4-46b5-b2fb-a560b2d7585e service nova] Lock "3735964b-ac6d-41d6-9c9c-f9fc91723558-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:51:09 user nova-compute[74189]: DEBUG nova.compute.manager [req-e0a3a809-5c6e-4bc7-b9df-b3c3c9d89ccc req-865c9d98-52d4-46b5-b2fb-a560b2d7585e service nova] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] No waiting events found dispatching network-vif-plugged-96b88f54-6536-46e6-b6fc-11af60ae3f3f {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:51:09 user nova-compute[74189]: WARNING nova.compute.manager [req-e0a3a809-5c6e-4bc7-b9df-b3c3c9d89ccc req-865c9d98-52d4-46b5-b2fb-a560b2d7585e service nova] [instance: 3735964b-ac6d-41d6-9c9c-f9fc91723558] Received unexpected event network-vif-plugged-96b88f54-6536-46e6-b6fc-11af60ae3f3f for instance with vm_state deleted and task_state None.
Oct 25 21:51:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:51:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:51:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:51:24 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:51:24 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:51:24 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Rebuilding the list of instances to heal {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 21:51:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-0b5d04c5-dfae-42de-84b9-2fab02e3d679" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:51:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-0b5d04c5-dfae-42de-84b9-2fab02e3d679" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:51:24 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:51:24 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lazy-loading 'info_cache' on Instance uuid 0b5d04c5-dfae-42de-84b9-2fab02e3d679 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:51:25 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Updating instance_info_cache with network_info: [{"id": "e05cb4c8-e712-4628-9d3d-a72653f19860", "address": "fa:16:3e:dc:d9:66", "network": {"id": "d2a72b33-1451-4343-a1ac-3e7cb75ec083", "bridge": "br-int", "label": "tempest-TestStampPattern-234506410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6a19ad6e8249abbe10137bdad65ca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05cb4c8-e7", "ovs_interfaceid": "e05cb4c8-e712-4628-9d3d-a72653f19860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:51:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-0b5d04c5-dfae-42de-84b9-2fab02e3d679" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:51:25 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:51:25 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:51:25 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:51:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:51:31 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:51:31 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:51:31 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:51:31 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:51:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:51:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:51:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:51:31 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:51:31 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:51:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:51:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:51:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:51:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:51:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:51:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:51:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:51:33 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:51:33 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:51:33 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=8757MB free_disk=24.859878540039062GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:51:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:51:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:51:33 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 0b5d04c5-dfae-42de-84b9-2fab02e3d679 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:51:33 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 13d0e024-6010-4f59-81a0-d0a03c0da77d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:51:33 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:51:33 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:51:33 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:51:33 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:51:33 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:51:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.228s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:51:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:51:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Acquiring lock "4417f819-195c-43be-9be6-ecb9845ba42f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:51:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lock "4417f819-195c-43be-9be6-ecb9845ba42f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:51:34 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 21:51:34 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:51:34 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:51:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:51:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:51:34 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 21:51:34 user nova-compute[74189]: INFO nova.compute.claims [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Claim successful on node user
Oct 25 21:51:34 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:51:34 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:51:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.248s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:51:34 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 21:51:34 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 21:51:34 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 21:51:34 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 21:51:34 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 21:51:34 user nova-compute[74189]: DEBUG nova.policy [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac0dda9ed41347be954e24564fa2c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e86c3ee328348fe93386b07dcae4f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 21:51:34 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 21:51:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 21:51:34 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Creating image(s)
Oct 25 21:51:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Acquiring lock "/opt/stack/data/nova/instances/4417f819-195c-43be-9be6-ecb9845ba42f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:51:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lock "/opt/stack/data/nova/instances/4417f819-195c-43be-9be6-ecb9845ba42f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:51:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lock "/opt/stack/data/nova/instances/4417f819-195c-43be-9be6-ecb9845ba42f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:51:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:51:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.178s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:51:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:51:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:51:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:51:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.178s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:51:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/4417f819-195c-43be-9be6-ecb9845ba42f/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:51:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/4417f819-195c-43be-9be6-ecb9845ba42f/disk 1073741824" returned: 0 in 0.047s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:51:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:51:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:51:35 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Successfully created port: 6d95f2fc-1e3a-4cd5-94e3-ea24580164bd {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 21:51:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.198s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:51:35 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4417f819-195c-43be-9be6-ecb9845ba42f/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 21:51:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4417f819-195c-43be-9be6-ecb9845ba42f/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:51:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4417f819-195c-43be-9be6-ecb9845ba42f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:51:35 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Cannot resize image /opt/stack/data/nova/instances/4417f819-195c-43be-9be6-ecb9845ba42f/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 21:51:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 21:51:35 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Ensure instance console log exists: /opt/stack/data/nova/instances/4417f819-195c-43be-9be6-ecb9845ba42f/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 21:51:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:51:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:51:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Successfully updated port: 6d95f2fc-1e3a-4cd5-94e3-ea24580164bd {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Acquiring lock "refresh_cache-4417f819-195c-43be-9be6-ecb9845ba42f" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Acquired lock "refresh_cache-4417f819-195c-43be-9be6-ecb9845ba42f" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.compute.manager [req-525dcdfd-2df3-4254-a5e1-7508406d2d43 req-2d1e9362-e3c0-47d2-a78b-1fc76b3603ad service nova] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Received event network-changed-6d95f2fc-1e3a-4cd5-94e3-ea24580164bd {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.compute.manager [req-525dcdfd-2df3-4254-a5e1-7508406d2d43 req-2d1e9362-e3c0-47d2-a78b-1fc76b3603ad service nova] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Refreshing instance network info cache due to event network-changed-6d95f2fc-1e3a-4cd5-94e3-ea24580164bd. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-525dcdfd-2df3-4254-a5e1-7508406d2d43 req-2d1e9362-e3c0-47d2-a78b-1fc76b3603ad service nova] Acquiring lock "refresh_cache-4417f819-195c-43be-9be6-ecb9845ba42f" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Updating instance_info_cache with network_info: [{"id": "6d95f2fc-1e3a-4cd5-94e3-ea24580164bd", "address": "fa:16:3e:5e:43:60", "network": {"id": "693c2b04-3a2f-474f-b7cd-2ab549fcd007", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1877604098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e86c3ee328348fe93386b07dcae4f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d95f2fc-1e", "ovs_interfaceid": "6d95f2fc-1e3a-4cd5-94e3-ea24580164bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Releasing lock "refresh_cache-4417f819-195c-43be-9be6-ecb9845ba42f" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Instance network_info: |[{"id": "6d95f2fc-1e3a-4cd5-94e3-ea24580164bd", "address": "fa:16:3e:5e:43:60", "network": {"id": "693c2b04-3a2f-474f-b7cd-2ab549fcd007", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1877604098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e86c3ee328348fe93386b07dcae4f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d95f2fc-1e", "ovs_interfaceid": "6d95f2fc-1e3a-4cd5-94e3-ea24580164bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-525dcdfd-2df3-4254-a5e1-7508406d2d43 req-2d1e9362-e3c0-47d2-a78b-1fc76b3603ad service nova] Acquired lock "refresh_cache-4417f819-195c-43be-9be6-ecb9845ba42f" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.network.neutron [req-525dcdfd-2df3-4254-a5e1-7508406d2d43 req-2d1e9362-e3c0-47d2-a78b-1fc76b3603ad service nova] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Refreshing network info cache for port 6d95f2fc-1e3a-4cd5-94e3-ea24580164bd {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Start _get_guest_xml network_info=[{"id": "6d95f2fc-1e3a-4cd5-94e3-ea24580164bd", "address": "fa:16:3e:5e:43:60", "network": {"id": "693c2b04-3a2f-474f-b7cd-2ab549fcd007", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1877604098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e86c3ee328348fe93386b07dcae4f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d95f2fc-1e", "ovs_interfaceid": "6d95f2fc-1e3a-4cd5-94e3-ea24580164bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 21:51:36 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:51:36 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:51:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1331363452',display_name='tempest-ServersNegativeTestJSON-server-1331363452',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1331363452',id=52,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e86c3ee328348fe93386b07dcae4f18',ramdisk_id='',reservation_id='r-kqp3id1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-775535143',owner_user_name='tempest-ServersNegativeTestJSON-775535143-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:51:35Z,user_data=None,user_id='ac0dda9ed41347be954e24564fa2c85b',uuid=4417f819-195c-43be-9be6-ecb9845ba42f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d95f2fc-1e3a-4cd5-94e3-ea24580164bd", "address": "fa:16:3e:5e:43:60", "network": {"id": "693c2b04-3a2f-474f-b7cd-2ab549fcd007", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1877604098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e86c3ee328348fe93386b07dcae4f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d95f2fc-1e", "ovs_interfaceid": "6d95f2fc-1e3a-4cd5-94e3-ea24580164bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Converting VIF {"id": "6d95f2fc-1e3a-4cd5-94e3-ea24580164bd", "address": "fa:16:3e:5e:43:60", "network": {"id": "693c2b04-3a2f-474f-b7cd-2ab549fcd007", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1877604098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e86c3ee328348fe93386b07dcae4f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d95f2fc-1e", "ovs_interfaceid": "6d95f2fc-1e3a-4cd5-94e3-ea24580164bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:43:60,bridge_name='br-int',has_traffic_filtering=True,id=6d95f2fc-1e3a-4cd5-94e3-ea24580164bd,network=Network(693c2b04-3a2f-474f-b7cd-2ab549fcd007),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d95f2fc-1e') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lazy-loading 'pci_devices' on Instance uuid 4417f819-195c-43be-9be6-ecb9845ba42f {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] End _get_guest_xml xml=<domain type="kvm">
Oct 25 21:51:36 user nova-compute[74189]:   <uuid>4417f819-195c-43be-9be6-ecb9845ba42f</uuid>
Oct 25 21:51:36 user nova-compute[74189]:   <name>instance-00000034</name>
Oct 25 21:51:36 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 21:51:36 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 21:51:36 user nova-compute[74189]:   <metadata>
Oct 25 21:51:36 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 21:51:36 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 21:51:36 user nova-compute[74189]:       <nova:name>tempest-ServersNegativeTestJSON-server-1331363452</nova:name>
Oct 25 21:51:36 user nova-compute[74189]:       <nova:creationTime>2023-10-25 21:51:36</nova:creationTime>
Oct 25 21:51:36 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 21:51:36 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 21:51:36 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 21:51:36 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 21:51:36 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 21:51:36 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 21:51:36 user nova-compute[74189]:       </nova:flavor>
Oct 25 21:51:36 user nova-compute[74189]:       <nova:owner>
Oct 25 21:51:36 user nova-compute[74189]:         <nova:user uuid="ac0dda9ed41347be954e24564fa2c85b">tempest-ServersNegativeTestJSON-775535143-project-member</nova:user>
Oct 25 21:51:36 user nova-compute[74189]:         <nova:project uuid="6e86c3ee328348fe93386b07dcae4f18">tempest-ServersNegativeTestJSON-775535143</nova:project>
Oct 25 21:51:36 user nova-compute[74189]:       </nova:owner>
Oct 25 21:51:36 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 21:51:36 user nova-compute[74189]:       <nova:ports>
Oct 25 21:51:36 user nova-compute[74189]:         <nova:port uuid="6d95f2fc-1e3a-4cd5-94e3-ea24580164bd">
Oct 25 21:51:36 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 25 21:51:36 user nova-compute[74189]:         </nova:port>
Oct 25 21:51:36 user nova-compute[74189]:       </nova:ports>
Oct 25 21:51:36 user nova-compute[74189]:     </nova:instance>
Oct 25 21:51:36 user nova-compute[74189]:   </metadata>
Oct 25 21:51:36 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 21:51:36 user nova-compute[74189]:     <system>
Oct 25 21:51:36 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 21:51:36 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 21:51:36 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 21:51:36 user nova-compute[74189]:       <entry name="serial">4417f819-195c-43be-9be6-ecb9845ba42f</entry>
Oct 25 21:51:36 user nova-compute[74189]:       <entry name="uuid">4417f819-195c-43be-9be6-ecb9845ba42f</entry>
Oct 25 21:51:36 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 21:51:36 user nova-compute[74189]:     </system>
Oct 25 21:51:36 user nova-compute[74189]:   </sysinfo>
Oct 25 21:51:36 user nova-compute[74189]:   <os>
Oct 25 21:51:36 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 21:51:36 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 21:51:36 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 21:51:36 user nova-compute[74189]:   </os>
Oct 25 21:51:36 user nova-compute[74189]:   <features>
Oct 25 21:51:36 user nova-compute[74189]:     <acpi/>
Oct 25 21:51:36 user nova-compute[74189]:     <apic/>
Oct 25 21:51:36 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 21:51:36 user nova-compute[74189]:   </features>
Oct 25 21:51:36 user nova-compute[74189]:   <clock offset="utc">
Oct 25 21:51:36 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 21:51:36 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 21:51:36 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 21:51:36 user nova-compute[74189]:   </clock>
Oct 25 21:51:36 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 21:51:36 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 21:51:36 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 21:51:36 user nova-compute[74189]:   </cpu>
Oct 25 21:51:36 user nova-compute[74189]:   <devices>
Oct 25 21:51:36 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 21:51:36 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 21:51:36 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/4417f819-195c-43be-9be6-ecb9845ba42f/disk"/>
Oct 25 21:51:36 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 21:51:36 user nova-compute[74189]:     </disk>
Oct 25 21:51:36 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 21:51:36 user nova-compute[74189]:       <mac address="fa:16:3e:5e:43:60"/>
Oct 25 21:51:36 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:51:36 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 21:51:36 user nova-compute[74189]:       <target dev="tap6d95f2fc-1e"/>
Oct 25 21:51:36 user nova-compute[74189]:     </interface>
Oct 25 21:51:36 user nova-compute[74189]:     <serial type="pty">
Oct 25 21:51:36 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/4417f819-195c-43be-9be6-ecb9845ba42f/console.log" append="off"/>
Oct 25 21:51:36 user nova-compute[74189]:     </serial>
Oct 25 21:51:36 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 21:51:36 user nova-compute[74189]:     <video>
Oct 25 21:51:36 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 21:51:36 user nova-compute[74189]:     </video>
Oct 25 21:51:36 user nova-compute[74189]:     <rng model="virtio">
Oct 25 21:51:36 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 21:51:36 user nova-compute[74189]:     </rng>
Oct 25 21:51:36 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 21:51:36 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 21:51:36 user nova-compute[74189]:       <stats period="10"/>
Oct 25 21:51:36 user nova-compute[74189]:     </memballoon>
Oct 25 21:51:36 user nova-compute[74189]:   </devices>
Oct 25 21:51:36 user nova-compute[74189]: </domain>
Oct 25 21:51:36 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:51:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1331363452',display_name='tempest-ServersNegativeTestJSON-server-1331363452',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1331363452',id=52,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e86c3ee328348fe93386b07dcae4f18',ramdisk_id='',reservation_id='r-kqp3id1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-775535143',owner_user_name='tempest-ServersNegativeTestJSON-775535143-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T21:51:35Z,user_data=None,user_id='ac0dda9ed41347be954e24564fa2c85b',uuid=4417f819-195c-43be-9be6-ecb9845ba42f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d95f2fc-1e3a-4cd5-94e3-ea24580164bd", "address": "fa:16:3e:5e:43:60", "network": {"id": "693c2b04-3a2f-474f-b7cd-2ab549fcd007", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1877604098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e86c3ee328348fe93386b07dcae4f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d95f2fc-1e", "ovs_interfaceid": "6d95f2fc-1e3a-4cd5-94e3-ea24580164bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Converting VIF {"id": "6d95f2fc-1e3a-4cd5-94e3-ea24580164bd", "address": "fa:16:3e:5e:43:60", "network": {"id": "693c2b04-3a2f-474f-b7cd-2ab549fcd007", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1877604098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e86c3ee328348fe93386b07dcae4f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d95f2fc-1e", "ovs_interfaceid": "6d95f2fc-1e3a-4cd5-94e3-ea24580164bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:43:60,bridge_name='br-int',has_traffic_filtering=True,id=6d95f2fc-1e3a-4cd5-94e3-ea24580164bd,network=Network(693c2b04-3a2f-474f-b7cd-2ab549fcd007),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d95f2fc-1e') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG os_vif [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:43:60,bridge_name='br-int',has_traffic_filtering=True,id=6d95f2fc-1e3a-4cd5-94e3-ea24580164bd,network=Network(693c2b04-3a2f-474f-b7cd-2ab549fcd007),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d95f2fc-1e') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '95a47cc3-6e4b-50d4-8ff9-bc79e519e938', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d95f2fc-1e, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d95f2fc-1e, col_values=(('qos', UUID('f39f31a4-b926-480f-bb4c-db95cf74e92e')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d95f2fc-1e, col_values=(('external_ids', {'iface-id': '6d95f2fc-1e3a-4cd5-94e3-ea24580164bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:43:60', 'vm-uuid': '4417f819-195c-43be-9be6-ecb9845ba42f'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:51:36 user nova-compute[74189]: INFO os_vif [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:43:60,bridge_name='br-int',has_traffic_filtering=True,id=6d95f2fc-1e3a-4cd5-94e3-ea24580164bd,network=Network(693c2b04-3a2f-474f-b7cd-2ab549fcd007),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d95f2fc-1e')
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] No VIF found with MAC fa:16:3e:5e:43:60, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Cleaning up deleted instances {{(pid=74189) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 21:51:36 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] There are 0 instances to clean {{(pid=74189) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 21:51:37 user nova-compute[74189]: DEBUG nova.network.neutron [req-525dcdfd-2df3-4254-a5e1-7508406d2d43 req-2d1e9362-e3c0-47d2-a78b-1fc76b3603ad service nova] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Updated VIF entry in instance network info cache for port 6d95f2fc-1e3a-4cd5-94e3-ea24580164bd. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:51:37 user nova-compute[74189]: DEBUG nova.network.neutron [req-525dcdfd-2df3-4254-a5e1-7508406d2d43 req-2d1e9362-e3c0-47d2-a78b-1fc76b3603ad service nova] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Updating instance_info_cache with network_info: [{"id": "6d95f2fc-1e3a-4cd5-94e3-ea24580164bd", "address": "fa:16:3e:5e:43:60", "network": {"id": "693c2b04-3a2f-474f-b7cd-2ab549fcd007", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1877604098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e86c3ee328348fe93386b07dcae4f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d95f2fc-1e", "ovs_interfaceid": "6d95f2fc-1e3a-4cd5-94e3-ea24580164bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:51:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-525dcdfd-2df3-4254-a5e1-7508406d2d43 req-2d1e9362-e3c0-47d2-a78b-1fc76b3603ad service nova] Releasing lock "refresh_cache-4417f819-195c-43be-9be6-ecb9845ba42f" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:51:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:51:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:51:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:51:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:51:38 user nova-compute[74189]: DEBUG nova.compute.manager [req-a1f5c8a1-0632-422d-89fd-7e1fece21411 req-c2525013-b4e9-4d43-8e05-a6784fad4c1f service nova] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Received event network-vif-plugged-6d95f2fc-1e3a-4cd5-94e3-ea24580164bd {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:51:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a1f5c8a1-0632-422d-89fd-7e1fece21411 req-c2525013-b4e9-4d43-8e05-a6784fad4c1f service nova] Acquiring lock "4417f819-195c-43be-9be6-ecb9845ba42f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:51:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a1f5c8a1-0632-422d-89fd-7e1fece21411 req-c2525013-b4e9-4d43-8e05-a6784fad4c1f service nova] Lock "4417f819-195c-43be-9be6-ecb9845ba42f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:51:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-a1f5c8a1-0632-422d-89fd-7e1fece21411 req-c2525013-b4e9-4d43-8e05-a6784fad4c1f service nova] Lock "4417f819-195c-43be-9be6-ecb9845ba42f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:51:38 user nova-compute[74189]: DEBUG nova.compute.manager [req-a1f5c8a1-0632-422d-89fd-7e1fece21411 req-c2525013-b4e9-4d43-8e05-a6784fad4c1f service nova] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] No waiting events found dispatching network-vif-plugged-6d95f2fc-1e3a-4cd5-94e3-ea24580164bd {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:51:38 user nova-compute[74189]: WARNING nova.compute.manager [req-a1f5c8a1-0632-422d-89fd-7e1fece21411 req-c2525013-b4e9-4d43-8e05-a6784fad4c1f service nova] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Received unexpected event network-vif-plugged-6d95f2fc-1e3a-4cd5-94e3-ea24580164bd for instance with vm_state building and task_state spawning.
Oct 25 21:51:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:51:39 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:51:39 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 21:51:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 21:51:39 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Instance spawned successfully.
Oct 25 21:51:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 21:51:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:51:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:51:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:51:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:51:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:51:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 21:51:40 user nova-compute[74189]: INFO nova.compute.manager [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Took 5.20 seconds to spawn the instance on the hypervisor.
Oct 25 21:51:40 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 21:51:40 user nova-compute[74189]: INFO nova.compute.manager [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Took 5.79 seconds to build instance.
Oct 25 21:51:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a7d5bcc0-6a69-4fc5-a1ea-3858ac65f5b7 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lock "4417f819-195c-43be-9be6-ecb9845ba42f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.879s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:51:40 user nova-compute[74189]: DEBUG nova.compute.manager [req-148a445a-6479-4a28-ad71-686e130ff806 req-878cb56a-03de-46ad-9323-ddb386d3ede8 service nova] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Received event network-vif-plugged-6d95f2fc-1e3a-4cd5-94e3-ea24580164bd {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:51:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-148a445a-6479-4a28-ad71-686e130ff806 req-878cb56a-03de-46ad-9323-ddb386d3ede8 service nova] Acquiring lock "4417f819-195c-43be-9be6-ecb9845ba42f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:51:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-148a445a-6479-4a28-ad71-686e130ff806 req-878cb56a-03de-46ad-9323-ddb386d3ede8 service nova] Lock "4417f819-195c-43be-9be6-ecb9845ba42f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:51:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-148a445a-6479-4a28-ad71-686e130ff806 req-878cb56a-03de-46ad-9323-ddb386d3ede8 service nova] Lock "4417f819-195c-43be-9be6-ecb9845ba42f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:51:40 user nova-compute[74189]: DEBUG nova.compute.manager [req-148a445a-6479-4a28-ad71-686e130ff806 req-878cb56a-03de-46ad-9323-ddb386d3ede8 service nova] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] No waiting events found dispatching network-vif-plugged-6d95f2fc-1e3a-4cd5-94e3-ea24580164bd {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:51:40 user nova-compute[74189]: WARNING nova.compute.manager [req-148a445a-6479-4a28-ad71-686e130ff806 req-878cb56a-03de-46ad-9323-ddb386d3ede8 service nova] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Received unexpected event network-vif-plugged-6d95f2fc-1e3a-4cd5-94e3-ea24580164bd for instance with vm_state active and task_state None.
Oct 25 21:51:41 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:51:41 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:51:42 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:51:42 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:51:42 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74189) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 21:51:46 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:51:51 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:51:51 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:51:51 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 21:51:51 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:51:51 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:51:51 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:51:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:51:56 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:51:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:52:01 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:52:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:52:06 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:52:06 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:52:06 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Triggering sync for uuid 0b5d04c5-dfae-42de-84b9-2fab02e3d679 {{(pid=74189) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 21:52:06 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Triggering sync for uuid 13d0e024-6010-4f59-81a0-d0a03c0da77d {{(pid=74189) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 21:52:06 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Triggering sync for uuid 4417f819-195c-43be-9be6-ecb9845ba42f {{(pid=74189) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 21:52:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "0b5d04c5-dfae-42de-84b9-2fab02e3d679" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:52:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "0b5d04c5-dfae-42de-84b9-2fab02e3d679" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:52:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "13d0e024-6010-4f59-81a0-d0a03c0da77d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:52:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "13d0e024-6010-4f59-81a0-d0a03c0da77d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:52:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "4417f819-195c-43be-9be6-ecb9845ba42f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:52:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "4417f819-195c-43be-9be6-ecb9845ba42f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:52:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "0b5d04c5-dfae-42de-84b9-2fab02e3d679" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:52:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "4417f819-195c-43be-9be6-ecb9845ba42f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:52:06 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "13d0e024-6010-4f59-81a0-d0a03c0da77d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:52:09 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:52:11 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:52:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:52:16 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:52:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:52:19 user nova-compute[74189]: DEBUG nova.compute.manager [req-4e91f240-355e-4739-a30f-e5417610aecc req-ecf214ea-c11f-4a14-a228-c0a77c53beac service nova] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Received event network-changed-e05cb4c8-e712-4628-9d3d-a72653f19860 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:52:19 user nova-compute[74189]: DEBUG nova.compute.manager [req-4e91f240-355e-4739-a30f-e5417610aecc req-ecf214ea-c11f-4a14-a228-c0a77c53beac service nova] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Refreshing instance network info cache due to event network-changed-e05cb4c8-e712-4628-9d3d-a72653f19860. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 21:52:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4e91f240-355e-4739-a30f-e5417610aecc req-ecf214ea-c11f-4a14-a228-c0a77c53beac service nova] Acquiring lock "refresh_cache-0b5d04c5-dfae-42de-84b9-2fab02e3d679" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:52:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4e91f240-355e-4739-a30f-e5417610aecc req-ecf214ea-c11f-4a14-a228-c0a77c53beac service nova] Acquired lock "refresh_cache-0b5d04c5-dfae-42de-84b9-2fab02e3d679" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:52:19 user nova-compute[74189]: DEBUG nova.network.neutron [req-4e91f240-355e-4739-a30f-e5417610aecc req-ecf214ea-c11f-4a14-a228-c0a77c53beac service nova] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Refreshing network info cache for port e05cb4c8-e712-4628-9d3d-a72653f19860 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 21:52:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9e6de1e5-f59c-4093-9904-44a95e59561e tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Acquiring lock "0b5d04c5-dfae-42de-84b9-2fab02e3d679" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:52:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9e6de1e5-f59c-4093-9904-44a95e59561e tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "0b5d04c5-dfae-42de-84b9-2fab02e3d679" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:52:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9e6de1e5-f59c-4093-9904-44a95e59561e tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Acquiring lock "0b5d04c5-dfae-42de-84b9-2fab02e3d679-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:52:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9e6de1e5-f59c-4093-9904-44a95e59561e tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "0b5d04c5-dfae-42de-84b9-2fab02e3d679-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:52:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9e6de1e5-f59c-4093-9904-44a95e59561e tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "0b5d04c5-dfae-42de-84b9-2fab02e3d679-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:52:19 user nova-compute[74189]: INFO nova.compute.manager [None req-9e6de1e5-f59c-4093-9904-44a95e59561e tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Terminating instance
Oct 25 21:52:19 user nova-compute[74189]: DEBUG nova.compute.manager [None req-9e6de1e5-f59c-4093-9904-44a95e59561e tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:52:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:52:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:52:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:52:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:52:19 user nova-compute[74189]: DEBUG nova.network.neutron [req-4e91f240-355e-4739-a30f-e5417610aecc req-ecf214ea-c11f-4a14-a228-c0a77c53beac service nova] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Updated VIF entry in instance network info cache for port e05cb4c8-e712-4628-9d3d-a72653f19860. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 21:52:19 user nova-compute[74189]: DEBUG nova.network.neutron [req-4e91f240-355e-4739-a30f-e5417610aecc req-ecf214ea-c11f-4a14-a228-c0a77c53beac service nova] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Updating instance_info_cache with network_info: [{"id": "e05cb4c8-e712-4628-9d3d-a72653f19860", "address": "fa:16:3e:dc:d9:66", "network": {"id": "d2a72b33-1451-4343-a1ac-3e7cb75ec083", "bridge": "br-int", "label": "tempest-TestStampPattern-234506410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6a19ad6e8249abbe10137bdad65ca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05cb4c8-e7", "ovs_interfaceid": "e05cb4c8-e712-4628-9d3d-a72653f19860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:52:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4e91f240-355e-4739-a30f-e5417610aecc req-ecf214ea-c11f-4a14-a228-c0a77c53beac service nova] Releasing lock "refresh_cache-0b5d04c5-dfae-42de-84b9-2fab02e3d679" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:52:19 user nova-compute[74189]: DEBUG nova.compute.manager [req-75dbc762-3a30-4609-8ee6-3100088249fc req-234e5ffd-9d5f-4514-98e3-ed47d692d7eb service nova] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Received event network-vif-unplugged-e05cb4c8-e712-4628-9d3d-a72653f19860 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:52:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-75dbc762-3a30-4609-8ee6-3100088249fc req-234e5ffd-9d5f-4514-98e3-ed47d692d7eb service nova] Acquiring lock "0b5d04c5-dfae-42de-84b9-2fab02e3d679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:52:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-75dbc762-3a30-4609-8ee6-3100088249fc req-234e5ffd-9d5f-4514-98e3-ed47d692d7eb service nova] Lock "0b5d04c5-dfae-42de-84b9-2fab02e3d679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:52:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-75dbc762-3a30-4609-8ee6-3100088249fc req-234e5ffd-9d5f-4514-98e3-ed47d692d7eb service nova] Lock "0b5d04c5-dfae-42de-84b9-2fab02e3d679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:52:19 user nova-compute[74189]: DEBUG nova.compute.manager [req-75dbc762-3a30-4609-8ee6-3100088249fc req-234e5ffd-9d5f-4514-98e3-ed47d692d7eb service nova] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] No waiting events found dispatching network-vif-unplugged-e05cb4c8-e712-4628-9d3d-a72653f19860 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:52:19 user nova-compute[74189]: DEBUG nova.compute.manager [req-75dbc762-3a30-4609-8ee6-3100088249fc req-234e5ffd-9d5f-4514-98e3-ed47d692d7eb service nova] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Received event network-vif-unplugged-e05cb4c8-e712-4628-9d3d-a72653f19860 for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:52:20 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Instance destroyed successfully.
Oct 25 21:52:20 user nova-compute[74189]: DEBUG nova.objects.instance [None req-9e6de1e5-f59c-4093-9904-44a95e59561e tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lazy-loading 'resources' on Instance uuid 0b5d04c5-dfae-42de-84b9-2fab02e3d679 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:52:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-9e6de1e5-f59c-4093-9904-44a95e59561e tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:44:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1759054533',display_name='tempest-TestStampPattern-server-1759054533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1759054533',id=48,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQ9OkIshA11eGvW1QoEDYUze94CFpHLxzzrnPEgQ/2cw2YykkRNKJSJN8zmNNN6ley6mlQwKcYrckjb4ee76GPcAhjB40Ypfxi0u4ciFrGvjcvOeYKwMAfqYUHhAHDRpA==',key_name='tempest-TestStampPattern-1702097735',keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:44:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e6a19ad6e8249abbe10137bdad65ca6',ramdisk_id='',reservation_id='r-kwikn0nu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-367314632',owner_user_name='tempest-TestStampPattern-367314632-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:48:00Z,user_data=None,user_id='ea97d3b6a27a4b569c04e26aa6043289',uuid=0b5d04c5-dfae-42de-84b9-2fab02e3d679,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e05cb4c8-e712-4628-9d3d-a72653f19860", "address": "fa:16:3e:dc:d9:66", "network": {"id": "d2a72b33-1451-4343-a1ac-3e7cb75ec083", "bridge": "br-int", "label": "tempest-TestStampPattern-234506410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6a19ad6e8249abbe10137bdad65ca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05cb4c8-e7", "ovs_interfaceid": "e05cb4c8-e712-4628-9d3d-a72653f19860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:52:20 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-9e6de1e5-f59c-4093-9904-44a95e59561e tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Converting VIF {"id": "e05cb4c8-e712-4628-9d3d-a72653f19860", "address": "fa:16:3e:dc:d9:66", "network": {"id": "d2a72b33-1451-4343-a1ac-3e7cb75ec083", "bridge": "br-int", "label": "tempest-TestStampPattern-234506410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6a19ad6e8249abbe10137bdad65ca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05cb4c8-e7", "ovs_interfaceid": "e05cb4c8-e712-4628-9d3d-a72653f19860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:52:20 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-9e6de1e5-f59c-4093-9904-44a95e59561e tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:d9:66,bridge_name='br-int',has_traffic_filtering=True,id=e05cb4c8-e712-4628-9d3d-a72653f19860,network=Network(d2a72b33-1451-4343-a1ac-3e7cb75ec083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape05cb4c8-e7') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:52:20 user nova-compute[74189]: DEBUG os_vif [None req-9e6de1e5-f59c-4093-9904-44a95e59561e tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:d9:66,bridge_name='br-int',has_traffic_filtering=True,id=e05cb4c8-e712-4628-9d3d-a72653f19860,network=Network(d2a72b33-1451-4343-a1ac-3e7cb75ec083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape05cb4c8-e7') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:52:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:52:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape05cb4c8-e7, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:52:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:52:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:52:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:52:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=444ff821-99e5-4264-a8e0-24f276dd7e62) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:52:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:52:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:52:20 user nova-compute[74189]: INFO os_vif [None req-9e6de1e5-f59c-4093-9904-44a95e59561e tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:d9:66,bridge_name='br-int',has_traffic_filtering=True,id=e05cb4c8-e712-4628-9d3d-a72653f19860,network=Network(d2a72b33-1451-4343-a1ac-3e7cb75ec083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape05cb4c8-e7')
Oct 25 21:52:20 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-9e6de1e5-f59c-4093-9904-44a95e59561e tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Deleting instance files /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679_del
Oct 25 21:52:20 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-9e6de1e5-f59c-4093-9904-44a95e59561e tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Deletion of /opt/stack/data/nova/instances/0b5d04c5-dfae-42de-84b9-2fab02e3d679_del complete
Oct 25 21:52:20 user nova-compute[74189]: INFO nova.compute.manager [None req-9e6de1e5-f59c-4093-9904-44a95e59561e tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 25 21:52:20 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-9e6de1e5-f59c-4093-9904-44a95e59561e tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:52:20 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:52:20 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:52:20 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:52:20 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Took 0.49 seconds to deallocate network for instance.
Oct 25 21:52:20 user nova-compute[74189]: DEBUG nova.compute.manager [req-02accb15-98b8-4bcf-b35c-0379641041f1 req-1aa61154-a55e-48d5-9478-81f16aadd9a4 service nova] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Received event network-vif-deleted-e05cb4c8-e712-4628-9d3d-a72653f19860 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:52:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9e6de1e5-f59c-4093-9904-44a95e59561e tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:52:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9e6de1e5-f59c-4093-9904-44a95e59561e tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:52:20 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-9e6de1e5-f59c-4093-9904-44a95e59561e tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:52:20 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-9e6de1e5-f59c-4093-9904-44a95e59561e tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:52:20 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9e6de1e5-f59c-4093-9904-44a95e59561e tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.166s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:52:20 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-9e6de1e5-f59c-4093-9904-44a95e59561e tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Deleted allocations for instance 0b5d04c5-dfae-42de-84b9-2fab02e3d679
Oct 25 21:52:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9e6de1e5-f59c-4093-9904-44a95e59561e tempest-TestStampPattern-367314632 tempest-TestStampPattern-367314632-project-member] Lock "0b5d04c5-dfae-42de-84b9-2fab02e3d679" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.703s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:52:21 user nova-compute[74189]: DEBUG nova.compute.manager [req-d2148303-a49f-48e8-a68a-7f847b9b887e req-eb1b9f34-9b40-4ba6-870b-1d31c3f157e5 service nova] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Received event network-vif-plugged-e05cb4c8-e712-4628-9d3d-a72653f19860 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:52:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d2148303-a49f-48e8-a68a-7f847b9b887e req-eb1b9f34-9b40-4ba6-870b-1d31c3f157e5 service nova] Acquiring lock "0b5d04c5-dfae-42de-84b9-2fab02e3d679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:52:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d2148303-a49f-48e8-a68a-7f847b9b887e req-eb1b9f34-9b40-4ba6-870b-1d31c3f157e5 service nova] Lock "0b5d04c5-dfae-42de-84b9-2fab02e3d679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:52:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-d2148303-a49f-48e8-a68a-7f847b9b887e req-eb1b9f34-9b40-4ba6-870b-1d31c3f157e5 service nova] Lock "0b5d04c5-dfae-42de-84b9-2fab02e3d679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:52:21 user nova-compute[74189]: DEBUG nova.compute.manager [req-d2148303-a49f-48e8-a68a-7f847b9b887e req-eb1b9f34-9b40-4ba6-870b-1d31c3f157e5 service nova] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] No waiting events found dispatching network-vif-plugged-e05cb4c8-e712-4628-9d3d-a72653f19860 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:52:21 user nova-compute[74189]: WARNING nova.compute.manager [req-d2148303-a49f-48e8-a68a-7f847b9b887e req-eb1b9f34-9b40-4ba6-870b-1d31c3f157e5 service nova] [instance: 0b5d04c5-dfae-42de-84b9-2fab02e3d679] Received unexpected event network-vif-plugged-e05cb4c8-e712-4628-9d3d-a72653f19860 for instance with vm_state deleted and task_state None.
Oct 25 21:52:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:52:25 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:52:25 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:52:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-13d0e024-6010-4f59-81a0-d0a03c0da77d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:52:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-13d0e024-6010-4f59-81a0-d0a03c0da77d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:52:25 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:52:26 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Updating instance_info_cache with network_info: [{"id": "54785795-8e55-4db8-90ac-14061103f08a", "address": "fa:16:3e:a9:e1:fb", "network": {"id": "693c2b04-3a2f-474f-b7cd-2ab549fcd007", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1877604098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e86c3ee328348fe93386b07dcae4f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54785795-8e", "ovs_interfaceid": "54785795-8e55-4db8-90ac-14061103f08a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:52:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-13d0e024-6010-4f59-81a0-d0a03c0da77d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:52:26 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:52:27 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:52:27 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:52:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:52:31 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:52:32 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:52:32 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:52:33 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:52:33 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:52:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:52:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:52:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:52:33 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:52:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4417f819-195c-43be-9be6-ecb9845ba42f/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:52:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4417f819-195c-43be-9be6-ecb9845ba42f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:52:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4417f819-195c-43be-9be6-ecb9845ba42f/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:52:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4417f819-195c-43be-9be6-ecb9845ba42f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:52:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:52:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:52:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:52:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:52:35 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:52:35 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:52:35 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=8740MB free_disk=24.954524993896484GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:52:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:52:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:52:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:52:35 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 13d0e024-6010-4f59-81a0-d0a03c0da77d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:52:35 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 4417f819-195c-43be-9be6-ecb9845ba42f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:52:35 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:52:35 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:52:35 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Refreshing inventories for resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 21:52:35 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Updating ProviderTree inventory for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 21:52:35 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Updating inventory in ProviderTree for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 21:52:35 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Refreshing aggregate associations for resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc, aggregates: None {{(pid=74189) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 21:52:35 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Refreshing trait associations for resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING {{(pid=74189) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 21:52:35 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:52:35 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:52:35 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:52:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.534s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:52:37 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:52:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:52:40 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:52:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:52:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:52:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:53:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:53:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:53:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:53:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 21:53:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:53:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:53:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:53:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:53:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:53:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:53:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:53:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:53:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2614a330-dca5-4b14-9859-90adf0552cfa tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Acquiring lock "4417f819-195c-43be-9be6-ecb9845ba42f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:53:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2614a330-dca5-4b14-9859-90adf0552cfa tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lock "4417f819-195c-43be-9be6-ecb9845ba42f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:53:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2614a330-dca5-4b14-9859-90adf0552cfa tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Acquiring lock "4417f819-195c-43be-9be6-ecb9845ba42f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:53:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2614a330-dca5-4b14-9859-90adf0552cfa tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lock "4417f819-195c-43be-9be6-ecb9845ba42f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:53:24 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2614a330-dca5-4b14-9859-90adf0552cfa tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lock "4417f819-195c-43be-9be6-ecb9845ba42f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:53:24 user nova-compute[74189]: INFO nova.compute.manager [None req-2614a330-dca5-4b14-9859-90adf0552cfa tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Terminating instance
Oct 25 21:53:24 user nova-compute[74189]: DEBUG nova.compute.manager [None req-2614a330-dca5-4b14-9859-90adf0552cfa tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:53:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:53:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG nova.compute.manager [req-4c5c7a9a-8ca2-443f-872b-4de1e8065e67 req-9cf9f57e-9ca9-4132-828c-6609385c0259 service nova] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Received event network-vif-unplugged-6d95f2fc-1e3a-4cd5-94e3-ea24580164bd {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4c5c7a9a-8ca2-443f-872b-4de1e8065e67 req-9cf9f57e-9ca9-4132-828c-6609385c0259 service nova] Acquiring lock "4417f819-195c-43be-9be6-ecb9845ba42f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4c5c7a9a-8ca2-443f-872b-4de1e8065e67 req-9cf9f57e-9ca9-4132-828c-6609385c0259 service nova] Lock "4417f819-195c-43be-9be6-ecb9845ba42f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-4c5c7a9a-8ca2-443f-872b-4de1e8065e67 req-9cf9f57e-9ca9-4132-828c-6609385c0259 service nova] Lock "4417f819-195c-43be-9be6-ecb9845ba42f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG nova.compute.manager [req-4c5c7a9a-8ca2-443f-872b-4de1e8065e67 req-9cf9f57e-9ca9-4132-828c-6609385c0259 service nova] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] No waiting events found dispatching network-vif-unplugged-6d95f2fc-1e3a-4cd5-94e3-ea24580164bd {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG nova.compute.manager [req-4c5c7a9a-8ca2-443f-872b-4de1e8065e67 req-9cf9f57e-9ca9-4132-828c-6609385c0259 service nova] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Received event network-vif-unplugged-6d95f2fc-1e3a-4cd5-94e3-ea24580164bd for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:53:25 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Instance destroyed successfully.
Oct 25 21:53:25 user nova-compute[74189]: DEBUG nova.objects.instance [None req-2614a330-dca5-4b14-9859-90adf0552cfa tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lazy-loading 'resources' on Instance uuid 4417f819-195c-43be-9be6-ecb9845ba42f {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-2614a330-dca5-4b14-9859-90adf0552cfa tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:51:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1331363452',display_name='tempest-ServersNegativeTestJSON-server-1331363452',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1331363452',id=52,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:51:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e86c3ee328348fe93386b07dcae4f18',ramdisk_id='',reservation_id='r-kqp3id1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-775535143',owner_user_name='tempest-ServersNegativeTestJSON-775535143-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:51:40Z,user_data=None,user_id='ac0dda9ed41347be954e24564fa2c85b',uuid=4417f819-195c-43be-9be6-ecb9845ba42f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d95f2fc-1e3a-4cd5-94e3-ea24580164bd", "address": "fa:16:3e:5e:43:60", "network": {"id": "693c2b04-3a2f-474f-b7cd-2ab549fcd007", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1877604098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e86c3ee328348fe93386b07dcae4f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d95f2fc-1e", "ovs_interfaceid": "6d95f2fc-1e3a-4cd5-94e3-ea24580164bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-2614a330-dca5-4b14-9859-90adf0552cfa tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Converting VIF {"id": "6d95f2fc-1e3a-4cd5-94e3-ea24580164bd", "address": "fa:16:3e:5e:43:60", "network": {"id": "693c2b04-3a2f-474f-b7cd-2ab549fcd007", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1877604098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e86c3ee328348fe93386b07dcae4f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d95f2fc-1e", "ovs_interfaceid": "6d95f2fc-1e3a-4cd5-94e3-ea24580164bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-2614a330-dca5-4b14-9859-90adf0552cfa tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:43:60,bridge_name='br-int',has_traffic_filtering=True,id=6d95f2fc-1e3a-4cd5-94e3-ea24580164bd,network=Network(693c2b04-3a2f-474f-b7cd-2ab549fcd007),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d95f2fc-1e') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG os_vif [None req-2614a330-dca5-4b14-9859-90adf0552cfa tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:43:60,bridge_name='br-int',has_traffic_filtering=True,id=6d95f2fc-1e3a-4cd5-94e3-ea24580164bd,network=Network(693c2b04-3a2f-474f-b7cd-2ab549fcd007),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d95f2fc-1e') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d95f2fc-1e, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f39f31a4-b926-480f-bb4c-db95cf74e92e) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:53:25 user nova-compute[74189]: INFO os_vif [None req-2614a330-dca5-4b14-9859-90adf0552cfa tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:43:60,bridge_name='br-int',has_traffic_filtering=True,id=6d95f2fc-1e3a-4cd5-94e3-ea24580164bd,network=Network(693c2b04-3a2f-474f-b7cd-2ab549fcd007),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d95f2fc-1e')
Oct 25 21:53:25 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-2614a330-dca5-4b14-9859-90adf0552cfa tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Deleting instance files /opt/stack/data/nova/instances/4417f819-195c-43be-9be6-ecb9845ba42f_del
Oct 25 21:53:25 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-2614a330-dca5-4b14-9859-90adf0552cfa tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Deletion of /opt/stack/data/nova/instances/4417f819-195c-43be-9be6-ecb9845ba42f_del complete
Oct 25 21:53:25 user nova-compute[74189]: INFO nova.compute.manager [None req-2614a330-dca5-4b14-9859-90adf0552cfa tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Took 0.73 seconds to destroy the instance on the hypervisor.
Oct 25 21:53:25 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-2614a330-dca5-4b14-9859-90adf0552cfa tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Rebuilding the list of instances to heal {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Skipping network cache update for instance because it is being deleted. {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9938}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-13d0e024-6010-4f59-81a0-d0a03c0da77d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-13d0e024-6010-4f59-81a0-d0a03c0da77d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:53:25 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lazy-loading 'info_cache' on Instance uuid 13d0e024-6010-4f59-81a0-d0a03c0da77d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:53:26 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:53:26 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Updating instance_info_cache with network_info: [{"id": "54785795-8e55-4db8-90ac-14061103f08a", "address": "fa:16:3e:a9:e1:fb", "network": {"id": "693c2b04-3a2f-474f-b7cd-2ab549fcd007", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1877604098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e86c3ee328348fe93386b07dcae4f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54785795-8e", "ovs_interfaceid": "54785795-8e55-4db8-90ac-14061103f08a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:53:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-13d0e024-6010-4f59-81a0-d0a03c0da77d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:53:26 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:53:26 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:53:26 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Took 1.07 seconds to deallocate network for instance.
Oct 25 21:53:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2614a330-dca5-4b14-9859-90adf0552cfa tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:53:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2614a330-dca5-4b14-9859-90adf0552cfa tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:53:26 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-2614a330-dca5-4b14-9859-90adf0552cfa tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:53:26 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-2614a330-dca5-4b14-9859-90adf0552cfa tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:53:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2614a330-dca5-4b14-9859-90adf0552cfa tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.166s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:53:26 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-2614a330-dca5-4b14-9859-90adf0552cfa tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Deleted allocations for instance 4417f819-195c-43be-9be6-ecb9845ba42f
Oct 25 21:53:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-2614a330-dca5-4b14-9859-90adf0552cfa tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lock "4417f819-195c-43be-9be6-ecb9845ba42f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.170s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:53:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-937d1276-9088-4858-8415-d772518fe0f6 req-8efe5679-365f-4576-95fb-10bc0e2b73d7 service nova] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Received event network-vif-plugged-6d95f2fc-1e3a-4cd5-94e3-ea24580164bd {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:53:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-937d1276-9088-4858-8415-d772518fe0f6 req-8efe5679-365f-4576-95fb-10bc0e2b73d7 service nova] Acquiring lock "4417f819-195c-43be-9be6-ecb9845ba42f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:53:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-937d1276-9088-4858-8415-d772518fe0f6 req-8efe5679-365f-4576-95fb-10bc0e2b73d7 service nova] Lock "4417f819-195c-43be-9be6-ecb9845ba42f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:53:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-937d1276-9088-4858-8415-d772518fe0f6 req-8efe5679-365f-4576-95fb-10bc0e2b73d7 service nova] Lock "4417f819-195c-43be-9be6-ecb9845ba42f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:53:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-937d1276-9088-4858-8415-d772518fe0f6 req-8efe5679-365f-4576-95fb-10bc0e2b73d7 service nova] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] No waiting events found dispatching network-vif-plugged-6d95f2fc-1e3a-4cd5-94e3-ea24580164bd {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:53:27 user nova-compute[74189]: WARNING nova.compute.manager [req-937d1276-9088-4858-8415-d772518fe0f6 req-8efe5679-365f-4576-95fb-10bc0e2b73d7 service nova] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Received unexpected event network-vif-plugged-6d95f2fc-1e3a-4cd5-94e3-ea24580164bd for instance with vm_state deleted and task_state None.
Oct 25 21:53:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-937d1276-9088-4858-8415-d772518fe0f6 req-8efe5679-365f-4576-95fb-10bc0e2b73d7 service nova] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Received event network-vif-plugged-6d95f2fc-1e3a-4cd5-94e3-ea24580164bd {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:53:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-937d1276-9088-4858-8415-d772518fe0f6 req-8efe5679-365f-4576-95fb-10bc0e2b73d7 service nova] Acquiring lock "4417f819-195c-43be-9be6-ecb9845ba42f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:53:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-937d1276-9088-4858-8415-d772518fe0f6 req-8efe5679-365f-4576-95fb-10bc0e2b73d7 service nova] Lock "4417f819-195c-43be-9be6-ecb9845ba42f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:53:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-937d1276-9088-4858-8415-d772518fe0f6 req-8efe5679-365f-4576-95fb-10bc0e2b73d7 service nova] Lock "4417f819-195c-43be-9be6-ecb9845ba42f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:53:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-937d1276-9088-4858-8415-d772518fe0f6 req-8efe5679-365f-4576-95fb-10bc0e2b73d7 service nova] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] No waiting events found dispatching network-vif-plugged-6d95f2fc-1e3a-4cd5-94e3-ea24580164bd {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:53:27 user nova-compute[74189]: WARNING nova.compute.manager [req-937d1276-9088-4858-8415-d772518fe0f6 req-8efe5679-365f-4576-95fb-10bc0e2b73d7 service nova] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Received unexpected event network-vif-plugged-6d95f2fc-1e3a-4cd5-94e3-ea24580164bd for instance with vm_state deleted and task_state None.
Oct 25 21:53:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-937d1276-9088-4858-8415-d772518fe0f6 req-8efe5679-365f-4576-95fb-10bc0e2b73d7 service nova] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Received event network-vif-plugged-6d95f2fc-1e3a-4cd5-94e3-ea24580164bd {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:53:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-937d1276-9088-4858-8415-d772518fe0f6 req-8efe5679-365f-4576-95fb-10bc0e2b73d7 service nova] Acquiring lock "4417f819-195c-43be-9be6-ecb9845ba42f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:53:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-937d1276-9088-4858-8415-d772518fe0f6 req-8efe5679-365f-4576-95fb-10bc0e2b73d7 service nova] Lock "4417f819-195c-43be-9be6-ecb9845ba42f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:53:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-937d1276-9088-4858-8415-d772518fe0f6 req-8efe5679-365f-4576-95fb-10bc0e2b73d7 service nova] Lock "4417f819-195c-43be-9be6-ecb9845ba42f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:53:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-937d1276-9088-4858-8415-d772518fe0f6 req-8efe5679-365f-4576-95fb-10bc0e2b73d7 service nova] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] No waiting events found dispatching network-vif-plugged-6d95f2fc-1e3a-4cd5-94e3-ea24580164bd {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:53:27 user nova-compute[74189]: WARNING nova.compute.manager [req-937d1276-9088-4858-8415-d772518fe0f6 req-8efe5679-365f-4576-95fb-10bc0e2b73d7 service nova] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Received unexpected event network-vif-plugged-6d95f2fc-1e3a-4cd5-94e3-ea24580164bd for instance with vm_state deleted and task_state None.
Oct 25 21:53:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-937d1276-9088-4858-8415-d772518fe0f6 req-8efe5679-365f-4576-95fb-10bc0e2b73d7 service nova] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Received event network-vif-unplugged-6d95f2fc-1e3a-4cd5-94e3-ea24580164bd {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:53:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-937d1276-9088-4858-8415-d772518fe0f6 req-8efe5679-365f-4576-95fb-10bc0e2b73d7 service nova] Acquiring lock "4417f819-195c-43be-9be6-ecb9845ba42f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:53:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-937d1276-9088-4858-8415-d772518fe0f6 req-8efe5679-365f-4576-95fb-10bc0e2b73d7 service nova] Lock "4417f819-195c-43be-9be6-ecb9845ba42f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:53:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-937d1276-9088-4858-8415-d772518fe0f6 req-8efe5679-365f-4576-95fb-10bc0e2b73d7 service nova] Lock "4417f819-195c-43be-9be6-ecb9845ba42f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:53:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-937d1276-9088-4858-8415-d772518fe0f6 req-8efe5679-365f-4576-95fb-10bc0e2b73d7 service nova] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] No waiting events found dispatching network-vif-unplugged-6d95f2fc-1e3a-4cd5-94e3-ea24580164bd {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:53:27 user nova-compute[74189]: WARNING nova.compute.manager [req-937d1276-9088-4858-8415-d772518fe0f6 req-8efe5679-365f-4576-95fb-10bc0e2b73d7 service nova] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Received unexpected event network-vif-unplugged-6d95f2fc-1e3a-4cd5-94e3-ea24580164bd for instance with vm_state deleted and task_state None.
Oct 25 21:53:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-937d1276-9088-4858-8415-d772518fe0f6 req-8efe5679-365f-4576-95fb-10bc0e2b73d7 service nova] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Received event network-vif-plugged-6d95f2fc-1e3a-4cd5-94e3-ea24580164bd {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:53:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-937d1276-9088-4858-8415-d772518fe0f6 req-8efe5679-365f-4576-95fb-10bc0e2b73d7 service nova] Acquiring lock "4417f819-195c-43be-9be6-ecb9845ba42f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:53:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-937d1276-9088-4858-8415-d772518fe0f6 req-8efe5679-365f-4576-95fb-10bc0e2b73d7 service nova] Lock "4417f819-195c-43be-9be6-ecb9845ba42f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:53:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-937d1276-9088-4858-8415-d772518fe0f6 req-8efe5679-365f-4576-95fb-10bc0e2b73d7 service nova] Lock "4417f819-195c-43be-9be6-ecb9845ba42f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:53:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-937d1276-9088-4858-8415-d772518fe0f6 req-8efe5679-365f-4576-95fb-10bc0e2b73d7 service nova] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] No waiting events found dispatching network-vif-plugged-6d95f2fc-1e3a-4cd5-94e3-ea24580164bd {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:53:27 user nova-compute[74189]: WARNING nova.compute.manager [req-937d1276-9088-4858-8415-d772518fe0f6 req-8efe5679-365f-4576-95fb-10bc0e2b73d7 service nova] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Received unexpected event network-vif-plugged-6d95f2fc-1e3a-4cd5-94e3-ea24580164bd for instance with vm_state deleted and task_state None.
Oct 25 21:53:27 user nova-compute[74189]: DEBUG nova.compute.manager [req-937d1276-9088-4858-8415-d772518fe0f6 req-8efe5679-365f-4576-95fb-10bc0e2b73d7 service nova] [instance: 4417f819-195c-43be-9be6-ecb9845ba42f] Received event network-vif-deleted-6d95f2fc-1e3a-4cd5-94e3-ea24580164bd {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:53:29 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:53:29 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:53:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:53:32 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:53:33 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:53:33 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:53:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:53:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:53:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:53:33 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:53:33 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:53:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:53:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:53:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:53:34 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:53:34 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:53:34 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=8831MB free_disk=24.980182647705078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:53:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:53:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:53:34 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 13d0e024-6010-4f59-81a0-d0a03c0da77d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:53:34 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:53:34 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:53:34 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:53:34 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:53:34 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:53:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:53:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:53:35 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:53:35 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:53:36 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:53:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:53:42 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:53:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:53:46 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:53:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:53:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:54:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:54:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:54:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:54:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:54:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:54:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:54:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:54:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 21:54:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:54:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:54:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:54:27 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:54:27 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:54:27 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Rebuilding the list of instances to heal {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 21:54:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-13d0e024-6010-4f59-81a0-d0a03c0da77d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:54:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-13d0e024-6010-4f59-81a0-d0a03c0da77d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:54:27 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:54:27 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lazy-loading 'info_cache' on Instance uuid 13d0e024-6010-4f59-81a0-d0a03c0da77d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:54:28 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Updating instance_info_cache with network_info: [{"id": "54785795-8e55-4db8-90ac-14061103f08a", "address": "fa:16:3e:a9:e1:fb", "network": {"id": "693c2b04-3a2f-474f-b7cd-2ab549fcd007", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1877604098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e86c3ee328348fe93386b07dcae4f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54785795-8e", "ovs_interfaceid": "54785795-8e55-4db8-90ac-14061103f08a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:54:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-13d0e024-6010-4f59-81a0-d0a03c0da77d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:54:28 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:54:29 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:54:29 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:54:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:54:33 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:54:34 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:54:34 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:54:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:54:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:54:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:54:34 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:54:34 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:54:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:54:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:54:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:54:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:54:35 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:54:35 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:54:35 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=8967MB free_disk=24.978771209716797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:54:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:54:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:54:35 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 13d0e024-6010-4f59-81a0-d0a03c0da77d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:54:35 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:54:35 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:54:35 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:54:35 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:54:35 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:54:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:54:36 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:54:36 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:54:38 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:54:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:54:42 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:54:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:54:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:54:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:55:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:55:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:55:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:55:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:55:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:55:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:55:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:55:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 21:55:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:55:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:55:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:55:29 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:55:29 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:55:29 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Rebuilding the list of instances to heal {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 21:55:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-13d0e024-6010-4f59-81a0-d0a03c0da77d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:55:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-13d0e024-6010-4f59-81a0-d0a03c0da77d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:55:30 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:55:30 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lazy-loading 'info_cache' on Instance uuid 13d0e024-6010-4f59-81a0-d0a03c0da77d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:55:30 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Updating instance_info_cache with network_info: [{"id": "54785795-8e55-4db8-90ac-14061103f08a", "address": "fa:16:3e:a9:e1:fb", "network": {"id": "693c2b04-3a2f-474f-b7cd-2ab549fcd007", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1877604098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e86c3ee328348fe93386b07dcae4f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54785795-8e", "ovs_interfaceid": "54785795-8e55-4db8-90ac-14061103f08a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:55:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:55:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-13d0e024-6010-4f59-81a0-d0a03c0da77d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:55:30 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:55:30 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:55:30 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:55:33 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:55:34 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:55:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:55:35 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:55:35 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:55:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:55:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:55:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:55:35 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:55:35 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:55:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:55:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:55:36 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:55:36 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:55:36 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:55:36 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=8977MB free_disk=24.97808074951172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:55:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:55:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:55:36 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 13d0e024-6010-4f59-81a0-d0a03c0da77d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:55:36 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:55:36 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:55:36 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:55:36 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:55:36 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:55:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:55:37 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:55:39 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:55:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:55:43 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:55:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:55:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:55:50 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:55:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:56:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:56:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:56:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:56:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:56:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:56:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:56:29 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:56:29 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:56:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:56:31 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:56:31 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:56:31 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Rebuilding the list of instances to heal {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 21:56:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-13d0e024-6010-4f59-81a0-d0a03c0da77d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:56:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-13d0e024-6010-4f59-81a0-d0a03c0da77d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:56:31 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:56:31 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lazy-loading 'info_cache' on Instance uuid 13d0e024-6010-4f59-81a0-d0a03c0da77d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:56:32 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Updating instance_info_cache with network_info: [{"id": "54785795-8e55-4db8-90ac-14061103f08a", "address": "fa:16:3e:a9:e1:fb", "network": {"id": "693c2b04-3a2f-474f-b7cd-2ab549fcd007", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1877604098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e86c3ee328348fe93386b07dcae4f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54785795-8e", "ovs_interfaceid": "54785795-8e55-4db8-90ac-14061103f08a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:56:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-13d0e024-6010-4f59-81a0-d0a03c0da77d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:56:32 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:56:33 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:56:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:56:35 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:56:36 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:56:37 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:56:37 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:56:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:56:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:56:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:56:37 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:56:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:56:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:56:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:56:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:56:38 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:56:38 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:56:38 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=8983MB free_disk=24.977527618408203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:56:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:56:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:56:38 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 13d0e024-6010-4f59-81a0-d0a03c0da77d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:56:38 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:56:38 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:56:38 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:56:38 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:56:38 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:56:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:56:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:56:42 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:56:44 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:56:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:56:47 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:56:47 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74189) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 21:56:48 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:56:48 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Cleaning up deleted instances {{(pid=74189) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 21:56:48 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] There are 0 instances to clean {{(pid=74189) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 21:56:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:56:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:56:55 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:57:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:57:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:57:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:57:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:57:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 21:57:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:57:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:57:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:57:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:57:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:57:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:57:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:57:31 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:57:31 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:57:33 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:57:33 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:57:33 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Rebuilding the list of instances to heal {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 21:57:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-13d0e024-6010-4f59-81a0-d0a03c0da77d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:57:33 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-13d0e024-6010-4f59-81a0-d0a03c0da77d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:57:33 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:57:33 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lazy-loading 'info_cache' on Instance uuid 13d0e024-6010-4f59-81a0-d0a03c0da77d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:57:34 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Updating instance_info_cache with network_info: [{"id": "54785795-8e55-4db8-90ac-14061103f08a", "address": "fa:16:3e:a9:e1:fb", "network": {"id": "693c2b04-3a2f-474f-b7cd-2ab549fcd007", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1877604098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e86c3ee328348fe93386b07dcae4f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54785795-8e", "ovs_interfaceid": "54785795-8e55-4db8-90ac-14061103f08a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:57:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-13d0e024-6010-4f59-81a0-d0a03c0da77d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:57:34 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:57:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:57:35 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:57:36 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:57:38 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:57:38 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:57:39 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:57:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:57:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:57:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:57:39 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:57:39 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:57:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:57:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:57:40 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:57:40 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:57:40 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:57:40 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=8977MB free_disk=24.96908950805664GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:57:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:57:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:57:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:57:40 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 13d0e024-6010-4f59-81a0-d0a03c0da77d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:57:40 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:57:40 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:57:40 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Refreshing inventories for resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 21:57:40 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Updating ProviderTree inventory for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 21:57:40 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Updating inventory in ProviderTree for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 21:57:40 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Refreshing aggregate associations for resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc, aggregates: None {{(pid=74189) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 21:57:41 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Refreshing trait associations for resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING {{(pid=74189) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 21:57:41 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:57:41 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:57:41 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:57:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.438s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:57:45 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:57:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:57:46 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:57:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:57:53 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:57:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:58:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:58:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:58:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:58:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:58:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:58:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:58:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:58:32 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:58:32 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:58:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:58:35 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:58:35 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:58:35 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Rebuilding the list of instances to heal {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 21:58:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-13d0e024-6010-4f59-81a0-d0a03c0da77d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 21:58:35 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-13d0e024-6010-4f59-81a0-d0a03c0da77d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 21:58:35 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 21:58:35 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lazy-loading 'info_cache' on Instance uuid 13d0e024-6010-4f59-81a0-d0a03c0da77d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:58:36 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Updating instance_info_cache with network_info: [{"id": "54785795-8e55-4db8-90ac-14061103f08a", "address": "fa:16:3e:a9:e1:fb", "network": {"id": "693c2b04-3a2f-474f-b7cd-2ab549fcd007", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1877604098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e86c3ee328348fe93386b07dcae4f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54785795-8e", "ovs_interfaceid": "54785795-8e55-4db8-90ac-14061103f08a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:58:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-13d0e024-6010-4f59-81a0-d0a03c0da77d" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 21:58:36 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 21:58:36 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:58:38 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:58:39 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:58:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:58:40 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:58:41 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:58:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:58:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:58:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:58:41 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:58:41 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:58:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:58:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 21:58:42 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 21:58:42 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:58:42 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:58:42 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=8984MB free_disk=24.968429565429688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:58:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:58:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:58:42 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 13d0e024-6010-4f59-81a0-d0a03c0da77d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 21:58:42 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:58:42 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:58:42 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:58:42 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:58:42 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:58:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:58:44 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:58:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:58:46 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:58:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e7119608-8d0d-4c7f-b394-91eac1fa7216 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Acquiring lock "13d0e024-6010-4f59-81a0-d0a03c0da77d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:58:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e7119608-8d0d-4c7f-b394-91eac1fa7216 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lock "13d0e024-6010-4f59-81a0-d0a03c0da77d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:58:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e7119608-8d0d-4c7f-b394-91eac1fa7216 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Acquiring lock "13d0e024-6010-4f59-81a0-d0a03c0da77d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:58:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e7119608-8d0d-4c7f-b394-91eac1fa7216 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lock "13d0e024-6010-4f59-81a0-d0a03c0da77d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:58:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e7119608-8d0d-4c7f-b394-91eac1fa7216 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lock "13d0e024-6010-4f59-81a0-d0a03c0da77d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:58:47 user nova-compute[74189]: INFO nova.compute.manager [None req-e7119608-8d0d-4c7f-b394-91eac1fa7216 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Terminating instance
Oct 25 21:58:47 user nova-compute[74189]: DEBUG nova.compute.manager [None req-e7119608-8d0d-4c7f-b394-91eac1fa7216 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 21:58:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:58:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:58:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:58:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:58:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:58:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:58:47 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Instance destroyed successfully.
Oct 25 21:58:47 user nova-compute[74189]: DEBUG nova.objects.instance [None req-e7119608-8d0d-4c7f-b394-91eac1fa7216 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lazy-loading 'resources' on Instance uuid 13d0e024-6010-4f59-81a0-d0a03c0da77d {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 21:58:47 user nova-compute[74189]: DEBUG nova.compute.manager [req-e9ef052c-3a40-4cec-8c84-5f1305b73f40 req-f7946860-cdeb-42a4-98d0-8c2e602e16a5 service nova] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Received event network-vif-unplugged-54785795-8e55-4db8-90ac-14061103f08a {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:58:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e9ef052c-3a40-4cec-8c84-5f1305b73f40 req-f7946860-cdeb-42a4-98d0-8c2e602e16a5 service nova] Acquiring lock "13d0e024-6010-4f59-81a0-d0a03c0da77d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:58:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e9ef052c-3a40-4cec-8c84-5f1305b73f40 req-f7946860-cdeb-42a4-98d0-8c2e602e16a5 service nova] Lock "13d0e024-6010-4f59-81a0-d0a03c0da77d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:58:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-e9ef052c-3a40-4cec-8c84-5f1305b73f40 req-f7946860-cdeb-42a4-98d0-8c2e602e16a5 service nova] Lock "13d0e024-6010-4f59-81a0-d0a03c0da77d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:58:47 user nova-compute[74189]: DEBUG nova.compute.manager [req-e9ef052c-3a40-4cec-8c84-5f1305b73f40 req-f7946860-cdeb-42a4-98d0-8c2e602e16a5 service nova] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] No waiting events found dispatching network-vif-unplugged-54785795-8e55-4db8-90ac-14061103f08a {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:58:47 user nova-compute[74189]: DEBUG nova.compute.manager [req-e9ef052c-3a40-4cec-8c84-5f1305b73f40 req-f7946860-cdeb-42a4-98d0-8c2e602e16a5 service nova] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Received event network-vif-unplugged-54785795-8e55-4db8-90ac-14061103f08a for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 21:58:47 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-e7119608-8d0d-4c7f-b394-91eac1fa7216 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T21:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1991976129',display_name='tempest-ServersNegativeTestJSON-server-1991976129',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1991976129',id=51,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T21:49:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e86c3ee328348fe93386b07dcae4f18',ramdisk_id='',reservation_id='r-95e0i9zu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-775535143',owner_user_name='tempest-ServersNegativeTestJSON-775535143-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T21:49:49Z,user_data=None,user_id='ac0dda9ed41347be954e24564fa2c85b',uuid=13d0e024-6010-4f59-81a0-d0a03c0da77d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54785795-8e55-4db8-90ac-14061103f08a", "address": "fa:16:3e:a9:e1:fb", "network": {"id": "693c2b04-3a2f-474f-b7cd-2ab549fcd007", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1877604098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e86c3ee328348fe93386b07dcae4f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54785795-8e", "ovs_interfaceid": "54785795-8e55-4db8-90ac-14061103f08a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 21:58:47 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-e7119608-8d0d-4c7f-b394-91eac1fa7216 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Converting VIF {"id": "54785795-8e55-4db8-90ac-14061103f08a", "address": "fa:16:3e:a9:e1:fb", "network": {"id": "693c2b04-3a2f-474f-b7cd-2ab549fcd007", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1877604098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e86c3ee328348fe93386b07dcae4f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54785795-8e", "ovs_interfaceid": "54785795-8e55-4db8-90ac-14061103f08a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 21:58:47 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-e7119608-8d0d-4c7f-b394-91eac1fa7216 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:e1:fb,bridge_name='br-int',has_traffic_filtering=True,id=54785795-8e55-4db8-90ac-14061103f08a,network=Network(693c2b04-3a2f-474f-b7cd-2ab549fcd007),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54785795-8e') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 21:58:47 user nova-compute[74189]: DEBUG os_vif [None req-e7119608-8d0d-4c7f-b394-91eac1fa7216 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:e1:fb,bridge_name='br-int',has_traffic_filtering=True,id=54785795-8e55-4db8-90ac-14061103f08a,network=Network(693c2b04-3a2f-474f-b7cd-2ab549fcd007),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54785795-8e') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 21:58:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:58:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54785795-8e, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:58:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:58:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:58:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:58:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f6d691d7-3a3b-4401-80d0-bea106e84f9a) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 21:58:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:58:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:58:47 user nova-compute[74189]: INFO os_vif [None req-e7119608-8d0d-4c7f-b394-91eac1fa7216 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:e1:fb,bridge_name='br-int',has_traffic_filtering=True,id=54785795-8e55-4db8-90ac-14061103f08a,network=Network(693c2b04-3a2f-474f-b7cd-2ab549fcd007),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54785795-8e')
Oct 25 21:58:47 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-e7119608-8d0d-4c7f-b394-91eac1fa7216 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Deleting instance files /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d_del
Oct 25 21:58:47 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-e7119608-8d0d-4c7f-b394-91eac1fa7216 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Deletion of /opt/stack/data/nova/instances/13d0e024-6010-4f59-81a0-d0a03c0da77d_del complete
Oct 25 21:58:48 user nova-compute[74189]: INFO nova.compute.manager [None req-e7119608-8d0d-4c7f-b394-91eac1fa7216 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 25 21:58:48 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-e7119608-8d0d-4c7f-b394-91eac1fa7216 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 21:58:48 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 21:58:48 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 21:58:48 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 21:58:48 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Took 0.54 seconds to deallocate network for instance.
Oct 25 21:58:48 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e7119608-8d0d-4c7f-b394-91eac1fa7216 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:58:48 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e7119608-8d0d-4c7f-b394-91eac1fa7216 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:58:48 user nova-compute[74189]: DEBUG nova.compute.manager [req-ec911a09-2dbf-47f0-ae5c-040e804bc047 req-f0a6747d-5ac0-4d54-b4bf-eda26f395b71 service nova] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Received event network-vif-deleted-54785795-8e55-4db8-90ac-14061103f08a {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:58:48 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-e7119608-8d0d-4c7f-b394-91eac1fa7216 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:58:48 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-e7119608-8d0d-4c7f-b394-91eac1fa7216 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:58:48 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e7119608-8d0d-4c7f-b394-91eac1fa7216 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:58:48 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-e7119608-8d0d-4c7f-b394-91eac1fa7216 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Deleted allocations for instance 13d0e024-6010-4f59-81a0-d0a03c0da77d
Oct 25 21:58:48 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-e7119608-8d0d-4c7f-b394-91eac1fa7216 tempest-ServersNegativeTestJSON-775535143 tempest-ServersNegativeTestJSON-775535143-project-member] Lock "13d0e024-6010-4f59-81a0-d0a03c0da77d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.848s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:58:49 user nova-compute[74189]: DEBUG nova.compute.manager [req-7fa97db8-6af4-470f-b104-5128774329ca req-c6c4031b-e8c0-4e3f-9980-2d2054229018 service nova] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Received event network-vif-plugged-54785795-8e55-4db8-90ac-14061103f08a {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 21:58:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7fa97db8-6af4-470f-b104-5128774329ca req-c6c4031b-e8c0-4e3f-9980-2d2054229018 service nova] Acquiring lock "13d0e024-6010-4f59-81a0-d0a03c0da77d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:58:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7fa97db8-6af4-470f-b104-5128774329ca req-c6c4031b-e8c0-4e3f-9980-2d2054229018 service nova] Lock "13d0e024-6010-4f59-81a0-d0a03c0da77d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:58:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-7fa97db8-6af4-470f-b104-5128774329ca req-c6c4031b-e8c0-4e3f-9980-2d2054229018 service nova] Lock "13d0e024-6010-4f59-81a0-d0a03c0da77d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:58:49 user nova-compute[74189]: DEBUG nova.compute.manager [req-7fa97db8-6af4-470f-b104-5128774329ca req-c6c4031b-e8c0-4e3f-9980-2d2054229018 service nova] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] No waiting events found dispatching network-vif-plugged-54785795-8e55-4db8-90ac-14061103f08a {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 21:58:49 user nova-compute[74189]: WARNING nova.compute.manager [req-7fa97db8-6af4-470f-b104-5128774329ca req-c6c4031b-e8c0-4e3f-9980-2d2054229018 service nova] [instance: 13d0e024-6010-4f59-81a0-d0a03c0da77d] Received unexpected event network-vif-plugged-54785795-8e55-4db8-90ac-14061103f08a for instance with vm_state deleted and task_state None.
Oct 25 21:58:52 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:58:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:59:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:59:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:59:12 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:59:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:59:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:59:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 21:59:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:59:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:59:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:59:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:59:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:59:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 21:59:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:59:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 21:59:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:59:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 21:59:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:59:33 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:59:33 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 21:59:35 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:59:35 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 21:59:35 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Rebuilding the list of instances to heal {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 21:59:35 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Didn't find any instances for network info cache update. {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 21:59:37 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:59:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:59:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:59:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:59:40 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:59:40 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:59:41 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:59:41 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:59:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:59:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:59:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:59:41 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 21:59:42 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:59:42 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 21:59:42 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=9120MB free_disk=24.99539566040039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 21:59:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 21:59:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 21:59:42 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 21:59:42 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 21:59:42 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 21:59:42 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 21:59:42 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 21:59:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 21:59:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:59:45 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:59:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:59:48 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:59:52 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 21:59:54 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 21:59:57 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:00:02 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:00:07 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:00:12 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:00:17 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:00:22 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:00:27 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:00:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:00:33 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:00:33 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 22:00:36 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:00:36 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 22:00:36 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Rebuilding the list of instances to heal {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 22:00:36 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Didn't find any instances for network info cache update. {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 22:00:37 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:00:39 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:00:41 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:00:41 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:00:41 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:00:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:00:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:00:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:00:41 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 22:00:42 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:00:42 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:00:42 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=9108MB free_disk=24.992755889892578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 22:00:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:00:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:00:42 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 22:00:42 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 22:00:42 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:00:42 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:00:42 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 22:00:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.105s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:00:42 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:00:43 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:00:45 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:00:47 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:00:48 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:00:53 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:00:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:01:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:01:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:01:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:01:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:01:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:01:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:01:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:01:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:01:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:01:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:01:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:01:33 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:01:33 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:01:33 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 22:01:36 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:01:36 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 22:01:36 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Rebuilding the list of instances to heal {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 22:01:36 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Didn't find any instances for network info cache update. {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 22:01:38 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:01:40 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:01:42 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:01:42 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:01:42 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:01:42 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:01:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:01:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:01:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:01:42 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 22:01:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:01:43 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:01:43 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:01:43 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=9119MB free_disk=24.99163818359375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 22:01:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:01:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:01:43 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 22:01:43 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 22:01:43 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:01:43 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:01:43 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 22:01:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.113s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:01:43 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:01:47 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:01:48 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:01:48 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:01:53 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:01:54 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:01:54 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Cleaning up deleted instances {{(pid=74189) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 22:01:54 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] There are 0 instances to clean {{(pid=74189) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 22:01:57 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:01:58 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:01:58 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:01:58 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74189) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 22:02:03 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:03 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:02:08 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:02:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:12 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:13 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:18 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:23 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Acquiring lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:02:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:02:26 user nova-compute[74189]: DEBUG nova.compute.manager [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Starting instance... {{(pid=74189) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 22:02:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:02:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:02:26 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74189) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 22:02:26 user nova-compute[74189]: INFO nova.compute.claims [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Claim successful on node user
Oct 25 22:02:27 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:02:27 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:02:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.252s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:02:27 user nova-compute[74189]: DEBUG nova.compute.manager [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Start building networks asynchronously for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 22:02:27 user nova-compute[74189]: DEBUG nova.compute.manager [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Allocating IP information in the background. {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 22:02:27 user nova-compute[74189]: DEBUG nova.network.neutron [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] allocate_for_instance() {{(pid=74189) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 22:02:27 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 22:02:27 user nova-compute[74189]: DEBUG nova.compute.manager [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Start building block device mappings for instance. {{(pid=74189) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 22:02:27 user nova-compute[74189]: DEBUG nova.policy [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f3b0dfb68004254af76c63df3fe595b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87430885ac4264ae70053d7b3f5686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74189) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 22:02:27 user nova-compute[74189]: DEBUG nova.compute.manager [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Start spawning the instance on the hypervisor. {{(pid=74189) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 22:02:27 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Creating instance directory {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 22:02:27 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Creating image(s)
Oct 25 22:02:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Acquiring lock "/opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:02:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "/opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:02:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "/opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:02:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:02:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.187s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:02:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Acquiring lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:02:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:02:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:02:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.218s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:02:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk 1073741824 {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:02:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8,backing_fmt=raw /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk 1073741824" returned: 0 in 0.062s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:02:27 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:02:27 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:02:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17710c367cd6e731ddc2baee3db0c7ff6fc9ab8 --force-share --output=json" returned: 0 in 0.218s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:02:28 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Checking if we can resize image /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk. size=1073741824 {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 22:02:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:02:28 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:28 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:02:28 user nova-compute[74189]: DEBUG nova.virt.disk.api [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Cannot resize image /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk to a smaller size. {{(pid=74189) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 22:02:28 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Created local disks {{(pid=74189) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 22:02:28 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Ensure instance console log exists: /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/console.log {{(pid=74189) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 22:02:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:02:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:02:28 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:02:28 user nova-compute[74189]: DEBUG nova.network.neutron [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Successfully created port: 1522ee3a-8194-48a5-a462-9ad0a8089dc5 {{(pid=74189) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG nova.network.neutron [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Successfully updated port: 1522ee3a-8194-48a5-a462-9ad0a8089dc5 {{(pid=74189) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Acquiring lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Acquired lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG nova.network.neutron [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Building network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-874f3476-efda-4a40-9dac-0bd2208271fd req-c8cecdf7-1f3c-4296-bbca-8549380c01c5 service nova] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Received event network-changed-1522ee3a-8194-48a5-a462-9ad0a8089dc5 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG nova.compute.manager [req-874f3476-efda-4a40-9dac-0bd2208271fd req-c8cecdf7-1f3c-4296-bbca-8549380c01c5 service nova] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Refreshing instance network info cache due to event network-changed-1522ee3a-8194-48a5-a462-9ad0a8089dc5. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-874f3476-efda-4a40-9dac-0bd2208271fd req-c8cecdf7-1f3c-4296-bbca-8549380c01c5 service nova] Acquiring lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG nova.network.neutron [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Instance cache missing network info. {{(pid=74189) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG nova.network.neutron [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Updating instance_info_cache with network_info: [{"id": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "address": "fa:16:3e:99:17:42", "network": {"id": "1a61611a-0391-4bde-90de-0f44166caefc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1703595461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db87430885ac4264ae70053d7b3f5686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1522ee3a-81", "ovs_interfaceid": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Releasing lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG nova.compute.manager [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Instance network_info: |[{"id": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "address": "fa:16:3e:99:17:42", "network": {"id": "1a61611a-0391-4bde-90de-0f44166caefc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1703595461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db87430885ac4264ae70053d7b3f5686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1522ee3a-81", "ovs_interfaceid": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74189) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-874f3476-efda-4a40-9dac-0bd2208271fd req-c8cecdf7-1f3c-4296-bbca-8549380c01c5 service nova] Acquired lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG nova.network.neutron [req-874f3476-efda-4a40-9dac-0bd2208271fd req-c8cecdf7-1f3c-4296-bbca-8549380c01c5 service nova] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Refreshing network info cache for port 1522ee3a-8194-48a5-a462-9ad0a8089dc5 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Start _get_guest_xml network_info=[{"id": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "address": "fa:16:3e:99:17:42", "network": {"id": "1a61611a-0391-4bde-90de-0f44166caefc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1703595461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db87430885ac4264ae70053d7b3f5686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1522ee3a-81", "ovs_interfaceid": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'image_id': '30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:02:29 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:02:29 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:02:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] CPU controller missing on host. {{(pid=74189) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.host [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] CPU controller found on host. {{(pid=74189) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74189) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T21:11:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T21:11:22Z,direct_url=<?>,disk_format='qcow2',id=30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1714f2820764423b9f4461ac8cbd9965',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T21:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Flavor limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Image limits 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Flavor pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Image pref 0:0:0 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74189) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Got 1 possible topologies {{(pid=74189) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG nova.virt.hardware [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74189) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:02:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1925543989',display_name='tempest-SnapshotDataIntegrityTests-server-1925543989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1925543989',id=53,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOGkChUSQ65M6kqMAkqrtdgcddHKn/UOMZfWpMTgChDcFgcdxVH59Hqpt4nOgLhLvLihSH9mj/kSS2IDjalVqCx/5TkU5aZO/q4g7cx1jG7wUJc/tzqNn2rRjxNCD6X4w==',key_name='tempest-keypair-342761449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db87430885ac4264ae70053d7b3f5686',ramdisk_id='',reservation_id='r-e135oict',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-392403849',owner_user_name='tempest-SnapshotDataIntegrityTests-392403849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:02:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f3b0dfb68004254af76c63df3fe595b',uuid=937588fa-28ca-451f-b7ff-2af93f8f2f41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "address": "fa:16:3e:99:17:42", "network": {"id": "1a61611a-0391-4bde-90de-0f44166caefc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1703595461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db87430885ac4264ae70053d7b3f5686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1522ee3a-81", "ovs_interfaceid": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74189) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Converting VIF {"id": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "address": "fa:16:3e:99:17:42", "network": {"id": "1a61611a-0391-4bde-90de-0f44166caefc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1703595461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db87430885ac4264ae70053d7b3f5686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1522ee3a-81", "ovs_interfaceid": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:17:42,bridge_name='br-int',has_traffic_filtering=True,id=1522ee3a-8194-48a5-a462-9ad0a8089dc5,network=Network(1a61611a-0391-4bde-90de-0f44166caefc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1522ee3a-81') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG nova.objects.instance [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lazy-loading 'pci_devices' on Instance uuid 937588fa-28ca-451f-b7ff-2af93f8f2f41 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:02:29 user nova-compute[74189]:   <uuid>937588fa-28ca-451f-b7ff-2af93f8f2f41</uuid>
Oct 25 22:02:29 user nova-compute[74189]:   <name>instance-00000035</name>
Oct 25 22:02:29 user nova-compute[74189]:   <memory>524288</memory>
Oct 25 22:02:29 user nova-compute[74189]:   <vcpu>1</vcpu>
Oct 25 22:02:29 user nova-compute[74189]:   <metadata>
Oct 25 22:02:29 user nova-compute[74189]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:02:29 user nova-compute[74189]:       <nova:package version="0.0.0"/>
Oct 25 22:02:29 user nova-compute[74189]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1925543989</nova:name>
Oct 25 22:02:29 user nova-compute[74189]:       <nova:creationTime>2023-10-25 22:02:29</nova:creationTime>
Oct 25 22:02:29 user nova-compute[74189]:       <nova:flavor name="m1.tiny">
Oct 25 22:02:29 user nova-compute[74189]:         <nova:memory>512</nova:memory>
Oct 25 22:02:29 user nova-compute[74189]:         <nova:disk>1</nova:disk>
Oct 25 22:02:29 user nova-compute[74189]:         <nova:swap>0</nova:swap>
Oct 25 22:02:29 user nova-compute[74189]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:02:29 user nova-compute[74189]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:02:29 user nova-compute[74189]:       </nova:flavor>
Oct 25 22:02:29 user nova-compute[74189]:       <nova:owner>
Oct 25 22:02:29 user nova-compute[74189]:         <nova:user uuid="0f3b0dfb68004254af76c63df3fe595b">tempest-SnapshotDataIntegrityTests-392403849-project-member</nova:user>
Oct 25 22:02:29 user nova-compute[74189]:         <nova:project uuid="db87430885ac4264ae70053d7b3f5686">tempest-SnapshotDataIntegrityTests-392403849</nova:project>
Oct 25 22:02:29 user nova-compute[74189]:       </nova:owner>
Oct 25 22:02:29 user nova-compute[74189]:       <nova:root type="image" uuid="30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd"/>
Oct 25 22:02:29 user nova-compute[74189]:       <nova:ports>
Oct 25 22:02:29 user nova-compute[74189]:         <nova:port uuid="1522ee3a-8194-48a5-a462-9ad0a8089dc5">
Oct 25 22:02:29 user nova-compute[74189]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 25 22:02:29 user nova-compute[74189]:         </nova:port>
Oct 25 22:02:29 user nova-compute[74189]:       </nova:ports>
Oct 25 22:02:29 user nova-compute[74189]:     </nova:instance>
Oct 25 22:02:29 user nova-compute[74189]:   </metadata>
Oct 25 22:02:29 user nova-compute[74189]:   <sysinfo type="smbios">
Oct 25 22:02:29 user nova-compute[74189]:     <system>
Oct 25 22:02:29 user nova-compute[74189]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:02:29 user nova-compute[74189]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:02:29 user nova-compute[74189]:       <entry name="version">0.0.0</entry>
Oct 25 22:02:29 user nova-compute[74189]:       <entry name="serial">937588fa-28ca-451f-b7ff-2af93f8f2f41</entry>
Oct 25 22:02:29 user nova-compute[74189]:       <entry name="uuid">937588fa-28ca-451f-b7ff-2af93f8f2f41</entry>
Oct 25 22:02:29 user nova-compute[74189]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:02:29 user nova-compute[74189]:     </system>
Oct 25 22:02:29 user nova-compute[74189]:   </sysinfo>
Oct 25 22:02:29 user nova-compute[74189]:   <os>
Oct 25 22:02:29 user nova-compute[74189]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:02:29 user nova-compute[74189]:     <boot dev="hd"/>
Oct 25 22:02:29 user nova-compute[74189]:     <smbios mode="sysinfo"/>
Oct 25 22:02:29 user nova-compute[74189]:   </os>
Oct 25 22:02:29 user nova-compute[74189]:   <features>
Oct 25 22:02:29 user nova-compute[74189]:     <acpi/>
Oct 25 22:02:29 user nova-compute[74189]:     <apic/>
Oct 25 22:02:29 user nova-compute[74189]:     <vmcoreinfo/>
Oct 25 22:02:29 user nova-compute[74189]:   </features>
Oct 25 22:02:29 user nova-compute[74189]:   <clock offset="utc">
Oct 25 22:02:29 user nova-compute[74189]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:02:29 user nova-compute[74189]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:02:29 user nova-compute[74189]:     <timer name="hpet" present="no"/>
Oct 25 22:02:29 user nova-compute[74189]:   </clock>
Oct 25 22:02:29 user nova-compute[74189]:   <cpu mode="custom" match="exact">
Oct 25 22:02:29 user nova-compute[74189]:     <model>Nehalem</model>
Oct 25 22:02:29 user nova-compute[74189]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:02:29 user nova-compute[74189]:   </cpu>
Oct 25 22:02:29 user nova-compute[74189]:   <devices>
Oct 25 22:02:29 user nova-compute[74189]:     <disk type="file" device="disk">
Oct 25 22:02:29 user nova-compute[74189]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:02:29 user nova-compute[74189]:       <source file="/opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk"/>
Oct 25 22:02:29 user nova-compute[74189]:       <target dev="vda" bus="virtio"/>
Oct 25 22:02:29 user nova-compute[74189]:     </disk>
Oct 25 22:02:29 user nova-compute[74189]:     <interface type="ethernet">
Oct 25 22:02:29 user nova-compute[74189]:       <mac address="fa:16:3e:99:17:42"/>
Oct 25 22:02:29 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 22:02:29 user nova-compute[74189]:       <mtu size="1442"/>
Oct 25 22:02:29 user nova-compute[74189]:       <target dev="tap1522ee3a-81"/>
Oct 25 22:02:29 user nova-compute[74189]:     </interface>
Oct 25 22:02:29 user nova-compute[74189]:     <serial type="pty">
Oct 25 22:02:29 user nova-compute[74189]:       <log file="/opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/console.log" append="off"/>
Oct 25 22:02:29 user nova-compute[74189]:     </serial>
Oct 25 22:02:29 user nova-compute[74189]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:02:29 user nova-compute[74189]:     <video>
Oct 25 22:02:29 user nova-compute[74189]:       <model type="virtio"/>
Oct 25 22:02:29 user nova-compute[74189]:     </video>
Oct 25 22:02:29 user nova-compute[74189]:     <rng model="virtio">
Oct 25 22:02:29 user nova-compute[74189]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:02:29 user nova-compute[74189]:     </rng>
Oct 25 22:02:29 user nova-compute[74189]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:02:29 user nova-compute[74189]:     <memballoon model="virtio">
Oct 25 22:02:29 user nova-compute[74189]:       <stats period="10"/>
Oct 25 22:02:29 user nova-compute[74189]:     </memballoon>
Oct 25 22:02:29 user nova-compute[74189]:   </devices>
Oct 25 22:02:29 user nova-compute[74189]: </domain>
Oct 25 22:02:29 user nova-compute[74189]:  {{(pid=74189) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:02:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1925543989',display_name='tempest-SnapshotDataIntegrityTests-server-1925543989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1925543989',id=53,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOGkChUSQ65M6kqMAkqrtdgcddHKn/UOMZfWpMTgChDcFgcdxVH59Hqpt4nOgLhLvLihSH9mj/kSS2IDjalVqCx/5TkU5aZO/q4g7cx1jG7wUJc/tzqNn2rRjxNCD6X4w==',key_name='tempest-keypair-342761449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db87430885ac4264ae70053d7b3f5686',ramdisk_id='',reservation_id='r-e135oict',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-392403849',owner_user_name='tempest-SnapshotDataIntegrityTests-392403849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:02:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f3b0dfb68004254af76c63df3fe595b',uuid=937588fa-28ca-451f-b7ff-2af93f8f2f41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "address": "fa:16:3e:99:17:42", "network": {"id": "1a61611a-0391-4bde-90de-0f44166caefc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1703595461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db87430885ac4264ae70053d7b3f5686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1522ee3a-81", "ovs_interfaceid": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Converting VIF {"id": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "address": "fa:16:3e:99:17:42", "network": {"id": "1a61611a-0391-4bde-90de-0f44166caefc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1703595461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db87430885ac4264ae70053d7b3f5686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1522ee3a-81", "ovs_interfaceid": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:17:42,bridge_name='br-int',has_traffic_filtering=True,id=1522ee3a-8194-48a5-a462-9ad0a8089dc5,network=Network(1a61611a-0391-4bde-90de-0f44166caefc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1522ee3a-81') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG os_vif [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:17:42,bridge_name='br-int',has_traffic_filtering=True,id=1522ee3a-8194-48a5-a462-9ad0a8089dc5,network=Network(1a61611a-0391-4bde-90de-0f44166caefc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1522ee3a-81') {{(pid=74189) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '80172c28-dcc2-5d58-97b6-2052b1e0a5bd', '_type': 'linux-noop'}}, row=False) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:02:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:02:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1522ee3a-81, may_exist=True, interface_attrs={}) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:02:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1522ee3a-81, col_values=(('qos', UUID('286cdf84-a723-4894-9d8f-c89154d7725a')),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:02:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1522ee3a-81, col_values=(('external_ids', {'iface-id': '1522ee3a-8194-48a5-a462-9ad0a8089dc5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:17:42', 'vm-uuid': '937588fa-28ca-451f-b7ff-2af93f8f2f41'}),), if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:02:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:02:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:30 user nova-compute[74189]: INFO os_vif [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:17:42,bridge_name='br-int',has_traffic_filtering=True,id=1522ee3a-8194-48a5-a462-9ad0a8089dc5,network=Network(1a61611a-0391-4bde-90de-0f44166caefc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1522ee3a-81')
Oct 25 22:02:30 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:02:30 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] No VIF found with MAC fa:16:3e:99:17:42, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:02:30 user nova-compute[74189]: DEBUG nova.network.neutron [req-874f3476-efda-4a40-9dac-0bd2208271fd req-c8cecdf7-1f3c-4296-bbca-8549380c01c5 service nova] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Updated VIF entry in instance network info cache for port 1522ee3a-8194-48a5-a462-9ad0a8089dc5. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:02:30 user nova-compute[74189]: DEBUG nova.network.neutron [req-874f3476-efda-4a40-9dac-0bd2208271fd req-c8cecdf7-1f3c-4296-bbca-8549380c01c5 service nova] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Updating instance_info_cache with network_info: [{"id": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "address": "fa:16:3e:99:17:42", "network": {"id": "1a61611a-0391-4bde-90de-0f44166caefc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1703595461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db87430885ac4264ae70053d7b3f5686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1522ee3a-81", "ovs_interfaceid": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:02:30 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-874f3476-efda-4a40-9dac-0bd2208271fd req-c8cecdf7-1f3c-4296-bbca-8549380c01c5 service nova] Releasing lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:02:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:31 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:32 user nova-compute[74189]: DEBUG nova.compute.manager [req-865097f8-b09d-4b1d-945d-f53809057eca req-6816c3cd-291f-49b9-94b1-f1a34db11370 service nova] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Received event network-vif-plugged-1522ee3a-8194-48a5-a462-9ad0a8089dc5 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:02:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-865097f8-b09d-4b1d-945d-f53809057eca req-6816c3cd-291f-49b9-94b1-f1a34db11370 service nova] Acquiring lock "937588fa-28ca-451f-b7ff-2af93f8f2f41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:02:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-865097f8-b09d-4b1d-945d-f53809057eca req-6816c3cd-291f-49b9-94b1-f1a34db11370 service nova] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:02:32 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-865097f8-b09d-4b1d-945d-f53809057eca req-6816c3cd-291f-49b9-94b1-f1a34db11370 service nova] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:02:32 user nova-compute[74189]: DEBUG nova.compute.manager [req-865097f8-b09d-4b1d-945d-f53809057eca req-6816c3cd-291f-49b9-94b1-f1a34db11370 service nova] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] No waiting events found dispatching network-vif-plugged-1522ee3a-8194-48a5-a462-9ad0a8089dc5 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:02:32 user nova-compute[74189]: WARNING nova.compute.manager [req-865097f8-b09d-4b1d-945d-f53809057eca req-6816c3cd-291f-49b9-94b1-f1a34db11370 service nova] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Received unexpected event network-vif-plugged-1522ee3a-8194-48a5-a462-9ad0a8089dc5 for instance with vm_state building and task_state spawning.
Oct 25 22:02:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:32 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:34 user nova-compute[74189]: DEBUG nova.compute.manager [req-1d3d079c-b546-4eaf-af37-00efb7d2300a req-f1fd18ce-4f59-4536-b250-dcb2cc880b7f service nova] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Received event network-vif-plugged-1522ee3a-8194-48a5-a462-9ad0a8089dc5 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:02:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1d3d079c-b546-4eaf-af37-00efb7d2300a req-f1fd18ce-4f59-4536-b250-dcb2cc880b7f service nova] Acquiring lock "937588fa-28ca-451f-b7ff-2af93f8f2f41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:02:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1d3d079c-b546-4eaf-af37-00efb7d2300a req-f1fd18ce-4f59-4536-b250-dcb2cc880b7f service nova] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:02:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-1d3d079c-b546-4eaf-af37-00efb7d2300a req-f1fd18ce-4f59-4536-b250-dcb2cc880b7f service nova] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:02:34 user nova-compute[74189]: DEBUG nova.compute.manager [req-1d3d079c-b546-4eaf-af37-00efb7d2300a req-f1fd18ce-4f59-4536-b250-dcb2cc880b7f service nova] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] No waiting events found dispatching network-vif-plugged-1522ee3a-8194-48a5-a462-9ad0a8089dc5 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:02:34 user nova-compute[74189]: WARNING nova.compute.manager [req-1d3d079c-b546-4eaf-af37-00efb7d2300a req-f1fd18ce-4f59-4536-b250-dcb2cc880b7f service nova] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Received unexpected event network-vif-plugged-1522ee3a-8194-48a5-a462-9ad0a8089dc5 for instance with vm_state building and task_state spawning.
Oct 25 22:02:34 user nova-compute[74189]: DEBUG nova.compute.manager [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Instance event wait completed in 0 seconds for  {{(pid=74189) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 22:02:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Guest created on hypervisor {{(pid=74189) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 22:02:34 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Instance spawned successfully.
Oct 25 22:02:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 22:02:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Found default for hw_cdrom_bus of ide {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:02:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Found default for hw_disk_bus of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:02:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Found default for hw_input_bus of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:02:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Found default for hw_pointer_model of None {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:02:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Found default for hw_video_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:02:34 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Found default for hw_vif_model of virtio {{(pid=74189) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:02:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:34 user nova-compute[74189]: INFO nova.compute.manager [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Took 7.26 seconds to spawn the instance on the hypervisor.
Oct 25 22:02:34 user nova-compute[74189]: DEBUG nova.compute.manager [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Checking state {{(pid=74189) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:02:34 user nova-compute[74189]: INFO nova.compute.manager [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Took 7.93 seconds to build instance.
Oct 25 22:02:34 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6f2f841f-d093-41fc-9112-d8aa6ff45c58 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.081s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:02:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:36 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:02:36 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Triggering sync for uuid 937588fa-28ca-451f-b7ff-2af93f8f2f41 {{(pid=74189) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 22:02:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:02:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:02:36 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:02:36 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 22:02:36 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:02:37 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:02:37 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 22:02:37 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Rebuilding the list of instances to heal {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 22:02:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:02:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:02:37 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 22:02:37 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lazy-loading 'info_cache' on Instance uuid 937588fa-28ca-451f-b7ff-2af93f8f2f41 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:02:37 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Updating instance_info_cache with network_info: [{"id": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "address": "fa:16:3e:99:17:42", "network": {"id": "1a61611a-0391-4bde-90de-0f44166caefc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1703595461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db87430885ac4264ae70053d7b3f5686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1522ee3a-81", "ovs_interfaceid": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:02:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:02:37 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 22:02:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:02:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:02:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:02:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:02:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:40 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:02:43 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:02:43 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:02:43 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:02:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:02:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:02:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:02:43 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 22:02:43 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:02:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:02:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:02:44 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:02:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:44 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:02:44 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:02:44 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=8616MB free_disk=24.97665023803711GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 22:02:44 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:02:44 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:02:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:45 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 937588fa-28ca-451f-b7ff-2af93f8f2f41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:02:45 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 22:02:45 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 22:02:45 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Refreshing inventories for resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 22:02:45 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Updating ProviderTree inventory for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 22:02:45 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Updating inventory in ProviderTree for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 22:02:45 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Refreshing aggregate associations for resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc, aggregates: None {{(pid=74189) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 22:02:45 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Refreshing trait associations for resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING {{(pid=74189) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 22:02:45 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:02:45 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:02:45 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 22:02:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.485s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:02:46 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:02:47 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:02:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:49 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:02:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:02:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:03:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:03:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:03:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:03:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:03:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:03:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:03:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:03:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:03:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:03:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:03:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:03:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:03:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:03:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:03:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:03:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:03:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:03:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:03:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:03:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:03:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:03:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:03:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:03:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:03:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:03:35 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:03:35 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 22:03:38 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:03:38 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 22:03:38 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Rebuilding the list of instances to heal {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 22:03:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:03:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:03:39 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 22:03:39 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lazy-loading 'info_cache' on Instance uuid 937588fa-28ca-451f-b7ff-2af93f8f2f41 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:03:39 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Updating instance_info_cache with network_info: [{"id": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "address": "fa:16:3e:99:17:42", "network": {"id": "1a61611a-0391-4bde-90de-0f44166caefc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1703595461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db87430885ac4264ae70053d7b3f5686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1522ee3a-81", "ovs_interfaceid": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:03:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:03:39 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 22:03:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:03:41 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:03:43 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:03:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:03:44 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:03:44 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:03:44 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:03:44 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:03:44 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:03:44 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 22:03:45 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:03:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:03:45 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:03:45 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:03:45 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:03:45 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:03:45 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:03:45 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=8696MB free_disk=24.94562530517578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 22:03:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:03:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:03:45 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 937588fa-28ca-451f-b7ff-2af93f8f2f41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:03:45 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 22:03:45 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 22:03:45 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:03:45 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:03:45 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 22:03:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:03:47 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:03:49 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:03:49 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:03:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:03:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:03:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:03:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:03:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:03:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:03:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:03:59 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:04:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:04:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:04:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:04:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:04:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:04:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:04:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:04:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:04:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:04:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:04:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:04:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:04:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:04:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:04:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:04:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:04:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:04:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:04:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:04:18 user nova-compute[74189]: DEBUG nova.compute.manager [req-9e172df6-84ef-4a9d-8605-d76d5a062b39 req-3cb55cf2-f42c-4974-8b80-9cae27ceae7b service nova] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Received event network-changed-1522ee3a-8194-48a5-a462-9ad0a8089dc5 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:04:18 user nova-compute[74189]: DEBUG nova.compute.manager [req-9e172df6-84ef-4a9d-8605-d76d5a062b39 req-3cb55cf2-f42c-4974-8b80-9cae27ceae7b service nova] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Refreshing instance network info cache due to event network-changed-1522ee3a-8194-48a5-a462-9ad0a8089dc5. {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:04:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9e172df6-84ef-4a9d-8605-d76d5a062b39 req-3cb55cf2-f42c-4974-8b80-9cae27ceae7b service nova] Acquiring lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:04:18 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9e172df6-84ef-4a9d-8605-d76d5a062b39 req-3cb55cf2-f42c-4974-8b80-9cae27ceae7b service nova] Acquired lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:04:18 user nova-compute[74189]: DEBUG nova.network.neutron [req-9e172df6-84ef-4a9d-8605-d76d5a062b39 req-3cb55cf2-f42c-4974-8b80-9cae27ceae7b service nova] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Refreshing network info cache for port 1522ee3a-8194-48a5-a462-9ad0a8089dc5 {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:04:19 user nova-compute[74189]: DEBUG nova.network.neutron [req-9e172df6-84ef-4a9d-8605-d76d5a062b39 req-3cb55cf2-f42c-4974-8b80-9cae27ceae7b service nova] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Updated VIF entry in instance network info cache for port 1522ee3a-8194-48a5-a462-9ad0a8089dc5. {{(pid=74189) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:04:19 user nova-compute[74189]: DEBUG nova.network.neutron [req-9e172df6-84ef-4a9d-8605-d76d5a062b39 req-3cb55cf2-f42c-4974-8b80-9cae27ceae7b service nova] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Updating instance_info_cache with network_info: [{"id": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "address": "fa:16:3e:99:17:42", "network": {"id": "1a61611a-0391-4bde-90de-0f44166caefc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1703595461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db87430885ac4264ae70053d7b3f5686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1522ee3a-81", "ovs_interfaceid": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:04:19 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-9e172df6-84ef-4a9d-8605-d76d5a062b39 req-3cb55cf2-f42c-4974-8b80-9cae27ceae7b service nova] Releasing lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:04:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:04:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:04:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:04:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:04:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:04:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:04:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Acquiring lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:04:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:04:31 user nova-compute[74189]: DEBUG nova.objects.instance [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lazy-loading 'flavor' on Instance uuid 937588fa-28ca-451f-b7ff-2af93f8f2f41 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:04:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:04:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Acquiring lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:04:31 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:04:31 user nova-compute[74189]: INFO nova.compute.manager [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Attaching volume 4c5c6c3a-de3f-4230-a925-4610ca61e497 to /dev/vdb
Oct 25 22:04:32 user nova-compute[74189]: DEBUG os_brick.utils [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:04:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:04:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:04:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20af8e6-0df1-47b4-8583-4dad6dbc0dd5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:04:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:04:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:04:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8126c78-d2b8-47f8-aead-4769b6604497]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:04:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:04:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:04:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[013c2b09-bbff-443a-a812-f621feed77ac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:04:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5f6431-0d2b-4563-8a9d-e9d7f1e2f1c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:04:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:04:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:04:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 22:04:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:04:32 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:04:32 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 22:04:32 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[14efb593-0d45-4787-8b35-dd066c78a8ec]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:04:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 22:04:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 22:04:32 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 22:04:32 user nova-compute[74189]: DEBUG os_brick.utils [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:04:32 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Updating existing volume attachment record: 8663b8a3-7535-4de8-b4e4-cf3142c3e803 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 22:04:34 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:04:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:04:37 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:04:37 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 22:04:38 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:04:38 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 22:04:38 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Rebuilding the list of instances to heal {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 22:04:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:04:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:04:38 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 22:04:38 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lazy-loading 'info_cache' on Instance uuid 937588fa-28ca-451f-b7ff-2af93f8f2f41 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:04:39 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Updating instance_info_cache with network_info: [{"id": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "address": "fa:16:3e:99:17:42", "network": {"id": "1a61611a-0391-4bde-90de-0f44166caefc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1703595461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db87430885ac4264ae70053d7b3f5686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1522ee3a-81", "ovs_interfaceid": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:04:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:04:39 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 22:04:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:04:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:04:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:04:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:04:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:04:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:04:43 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:04:44 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:04:44 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:04:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:04:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:04:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:04:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:04:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:04:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:04:45 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:04:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:04:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:04:45 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:04:45 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 22:04:45 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:04:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:04:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:04:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:04:46 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:04:46 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:04:46 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=8839MB free_disk=24.92734146118164GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 22:04:46 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:04:46 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:04:46 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 937588fa-28ca-451f-b7ff-2af93f8f2f41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:04:46 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 22:04:46 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 22:04:46 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:04:46 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:04:46 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 22:04:46 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.242s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:04:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:04:49 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:04:49 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:04:49 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoUBLlwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:04:50 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:04:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:04:50 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:04:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:04:50 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 22:04:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497 -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1282171-cd7f-4a30-a9fd-228ac4df084f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 22:04:50 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497 -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc5fce9-e081-42b0-8233-3d61a26507b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497] added
Oct 25 22:04:50 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddc1310-c0b0-40bf-a96f-cd2ce78a61c8]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96e8a62-d4af-4be2-93e7-3f441e23eaae]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AoUBLlwI {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AoUBLlwI" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f53583-4990-4a4c-af1b-1df4693ee4de]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AoUBLlwI'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0e80cf-c03f-4c44-87f0-c8490522864a]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77d2d03-7d70-49e6-ba26-8792f63c1593]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 22:04:50 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 22:04:50 user nova-compute[74189]:  {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:04:50 user nova-compute[74189]: WARNING os_brick.initiator.connectors.iscsi [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 22:04:50 user nova-compute[74189]: 
Oct 25 22:04:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497 -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbd5af0-b7ae-4e59-aecf-2ca802829122]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497, portal: 172.16.0.220,3260]
Oct 25 22:04:50 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497, portal: 172.16.0.220,3260] successful.
Oct 25 22:04:50 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e8dbe0-270a-45b6-9e45-89bc6c999b77]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b59b71-24c6-4c57-b96e-b3ef9e408614]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497 (non-flash)
Oct 25 22:04:50 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497 (non-flash)
Oct 25 22:04:50 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a4ebf8-ff68-44c9-ab9f-e82aeb689639]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoUBLlwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 22:04:50 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:04:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:04:51 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23061356137316261', 'path': '/dev/sdb'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:04:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061356137316261', 'path': '/dev/sdb'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 22:04:51 user nova-compute[74189]: DEBUG nova.objects.instance [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lazy-loading 'flavor' on Instance uuid 937588fa-28ca-451f-b7ff-2af93f8f2f41 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:04:51 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 22:04:51 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:04:51 user nova-compute[74189]:   <source dev="/dev/sdb"/>
Oct 25 22:04:51 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:04:51 user nova-compute[74189]:   <serial>4c5c6c3a-de3f-4230-a925-4610ca61e497</serial>
Oct 25 22:04:51 user nova-compute[74189]: </disk>
Oct 25 22:04:51 user nova-compute[74189]:  {{(pid=74189) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 22:04:52 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:04:52 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:04:52 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] No VIF found with MAC fa:16:3e:99:17:42, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:04:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-49a3715b-3f24-4c28-ba89-0a67a928a5ee tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.358s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:04:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:04:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:05:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:05:04 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:05:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:05:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:05:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:05:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:05:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:05:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:05:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:05:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:05:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:05:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:05:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:05:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Acquiring lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:05:26 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:05:26 user nova-compute[74189]: INFO nova.compute.manager [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Detaching volume 4c5c6c3a-de3f-4230-a925-4610ca61e497
Oct 25 22:05:26 user nova-compute[74189]: INFO nova.virt.block_device [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Attempting to driver detach volume 4c5c6c3a-de3f-4230-a925-4610ca61e497 from mountpoint /dev/vdb
Oct 25 22:05:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Attempting to detach device vdb from instance 937588fa-28ca-451f-b7ff-2af93f8f2f41 from the persistent domain config. {{(pid=74189) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 22:05:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 22:05:26 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:05:26 user nova-compute[74189]:   <source dev="/dev/sdb"/>
Oct 25 22:05:26 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:05:26 user nova-compute[74189]:   <serial>4c5c6c3a-de3f-4230-a925-4610ca61e497</serial>
Oct 25 22:05:26 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 22:05:26 user nova-compute[74189]: </disk>
Oct 25 22:05:26 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 22:05:26 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Successfully detached device vdb from instance 937588fa-28ca-451f-b7ff-2af93f8f2f41 from the persistent domain config.
Oct 25 22:05:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 937588fa-28ca-451f-b7ff-2af93f8f2f41 from the live domain config. {{(pid=74189) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 22:05:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 22:05:26 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:05:26 user nova-compute[74189]:   <source dev="/dev/sdb"/>
Oct 25 22:05:26 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:05:26 user nova-compute[74189]:   <serial>4c5c6c3a-de3f-4230-a925-4610ca61e497</serial>
Oct 25 22:05:26 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 22:05:26 user nova-compute[74189]: </disk>
Oct 25 22:05:26 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 22:05:26 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 937588fa-28ca-451f-b7ff-2af93f8f2f41 {{(pid=74189) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 22:05:29 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:05:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:05:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:05:37 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:05:37 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 22:05:39 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:05:39 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 22:05:39 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Rebuilding the list of instances to heal {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 22:05:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:05:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:05:39 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 22:05:39 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lazy-loading 'info_cache' on Instance uuid 937588fa-28ca-451f-b7ff-2af93f8f2f41 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:05:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:05:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:05:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:05:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:05:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:05:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:05:40 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Updating instance_info_cache with network_info: [{"id": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "address": "fa:16:3e:99:17:42", "network": {"id": "1a61611a-0391-4bde-90de-0f44166caefc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1703595461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db87430885ac4264ae70053d7b3f5686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1522ee3a-81", "ovs_interfaceid": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:05:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:05:40 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 22:05:44 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:05:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:05:45 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:05:45 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:05:46 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 937588fa-28ca-451f-b7ff-2af93f8f2f41 is timed out.
Oct 25 22:05:46 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Successfully detached device vdb from instance 937588fa-28ca-451f-b7ff-2af93f8f2f41 from the live domain config.
Oct 25 22:05:46 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoUBLlwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:05:46 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:05:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[837f76e7-444e-4c5d-972d-3f7da4ec835f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 22:05:46 user nova-compute[74189]: No targets found.
Oct 25 22:05:46 user nova-compute[74189]: iSNS:
Oct 25 22:05:46 user nova-compute[74189]: No targets found.
Oct 25 22:05:46 user nova-compute[74189]: STATIC:
Oct 25 22:05:46 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497
Oct 25 22:05:46 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:05:46 user nova-compute[74189]:                 Iface Name: default
Oct 25 22:05:46 user nova-compute[74189]: FIRMWARE:
Oct 25 22:05:46 user nova-compute[74189]: No targets found.
Oct 25 22:05:46 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 22:05:46 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 22:05:46 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2616bedc-8af3-40fa-be78-01d3b35c3137]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[27009b90-b253-4dce-8139-bb0c6fc4c352]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497 (non-flash)
Oct 25 22:05:46 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497 (non-flash)
Oct 25 22:05:46 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2e4241900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497'): ({'sdb'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Removing single pathed devices sdb {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ae61f3-897e-43d7-9265-37f34249b34b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d4b25c-4254-4405-86c3-56cf728e6cbc]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Flushing IO for device /dev/sdb {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3851d764-19b5-4fad-9b05-b67a5a16e695]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a3b08b-b30a-4d1a-a062-0f6b18699269]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] SCSI volumes sdb have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d59e3da-0654-4325-a82a-834bedf7c327]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:05:46 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497 -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:05:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:05:47 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aeabf89-9bc8-45b0-9eb8-8b886ecde91f]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:05:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497, portal: 172.16.0.220,3260]
Oct 25 22:05:47 user nova-compute[74189]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497, portal: 172.16.0.220,3260] successful.
Oct 25 22:05:47 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:05:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497 -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:05:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c5c6c3a-de3f-4230-a925-4610ca61e497 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:05:47 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[31dc0432-a359-4b8c-b590-26e3839ebefc]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:05:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:05:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:05:47 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] <== disconnect_volume: return (292ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:05:47 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 22:05:47 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:05:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:05:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:05:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:05:47 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 22:05:47 user nova-compute[74189]: DEBUG nova.objects.instance [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lazy-loading 'flavor' on Instance uuid 937588fa-28ca-451f-b7ff-2af93f8f2f41 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:05:47 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-b0bb51b7-8cb3-4545-a0c5-1c76538126b7 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.753s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:05:47 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:05:48 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:05:48 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:05:48 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:05:48 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:05:48 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:05:48 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=8953MB free_disk=24.91779327392578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 22:05:48 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:05:48 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:05:48 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 937588fa-28ca-451f-b7ff-2af93f8f2f41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:05:48 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 22:05:48 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 22:05:48 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:05:48 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:05:48 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 22:05:48 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:05:49 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:05:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:05:50 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:05:51 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:05:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:05:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:05:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:05:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:05:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:05:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:06:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:06:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:06:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:06:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:06:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:06:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:06:02 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:06:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:06:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:06:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:06:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:06:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:06:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:06:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:06:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:06:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:06:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Acquiring lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:06:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:06:21 user nova-compute[74189]: DEBUG nova.objects.instance [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lazy-loading 'flavor' on Instance uuid 937588fa-28ca-451f-b7ff-2af93f8f2f41 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:06:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:06:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Acquiring lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:06:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:06:21 user nova-compute[74189]: INFO nova.compute.manager [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Attaching volume dc828471-61dc-4603-be82-463974463d64 to /dev/vdb
Oct 25 22:06:21 user nova-compute[74189]: DEBUG os_brick.utils [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:06:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:06:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:06:21 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[db610c42-e932-4b27-bd84-9454a89bb986]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:06:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:06:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:06:21 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19dfdc1-4282-479f-9171-f4e4ccdab23a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:06:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:06:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:06:21 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[69db87ca-4c11-47ea-b73b-563e02d12991]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:06:21 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b0c21a-aa02-47e5-a9da-09f27838486e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:06:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:06:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:06:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 22:06:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:06:21 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:06:21 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 22:06:21 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e944fab-4043-4f20-a6d2-ccd967b9bed6]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:06:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 22:06:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 22:06:21 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 22:06:21 user nova-compute[74189]: DEBUG os_brick.utils [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:06:21 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Updating existing volume attachment record: fb93a0dc-9557-42e6-97ab-9cf1064f02a0 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 22:06:24 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:06:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:06:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:06:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:06:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:06:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:06:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:06:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:06:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:06:37 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:06:37 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fxjmbgKu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:06:38 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:06:38 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:06:38 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:06:38 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:06:38 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 22:06:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64 -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b65e39-7f5f-4724-960b-c1c4d5e168be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 22:06:38 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64 -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9649df7d-79d3-4424-945c-853575bf7f2b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64] added
Oct 25 22:06:38 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f3902a-670c-479d-bd67-74ba1e9020ef]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d4599e-8fd5-45f8-aad8-8ddbe2d38ca8]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fxjmbgKu {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fxjmbgKu" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f5c56f-fb62-45ff-ac9e-c60ca89213bf]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fxjmbgKu'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af18bf0-3016-4064-868b-11b092a02237]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb984d78-6dac-4baa-919f-3a18a67979c0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 22:06:38 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 22:06:38 user nova-compute[74189]:  {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:06:38 user nova-compute[74189]: WARNING os_brick.initiator.connectors.iscsi [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 22:06:38 user nova-compute[74189]: 
Oct 25 22:06:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64 -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7824bc3d-4386-4441-8f83-c64fedc29a5f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64, portal: 172.16.0.220,3260]
Oct 25 22:06:38 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64, portal: 172.16.0.220,3260] successful.
Oct 25 22:06:38 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[777882fb-52b5-42ad-8946-4067b216e9e6]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c91b18-1f0e-442c-b6e5-d70435f45388]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64 (non-flash)
Oct 25 22:06:38 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64 (non-flash)
Oct 25 22:06:38 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7d1b09-d0db-4c5f-91eb-f014cdcd2e93]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:06:38 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fxjmbgKu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 22:06:39 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:06:39 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23333653763386131', 'path': '/dev/sdb'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:06:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333653763386131', 'path': '/dev/sdb'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 22:06:39 user nova-compute[74189]: DEBUG nova.objects.instance [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lazy-loading 'flavor' on Instance uuid 937588fa-28ca-451f-b7ff-2af93f8f2f41 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:06:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 22:06:39 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:06:39 user nova-compute[74189]:   <source dev="/dev/sdb"/>
Oct 25 22:06:39 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:06:39 user nova-compute[74189]:   <serial>dc828471-61dc-4603-be82-463974463d64</serial>
Oct 25 22:06:39 user nova-compute[74189]: </disk>
Oct 25 22:06:39 user nova-compute[74189]:  {{(pid=74189) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 22:06:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:06:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:06:39 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] No VIF found with MAC fa:16:3e:99:17:42, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:06:39 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:06:39 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 22:06:39 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Rebuilding the list of instances to heal {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 22:06:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:06:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:06:39 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 22:06:39 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lazy-loading 'info_cache' on Instance uuid 937588fa-28ca-451f-b7ff-2af93f8f2f41 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:06:39 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-66469971-5f8d-48e2-91fd-e75f775dd0eb tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.237s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:06:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:06:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:06:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5006 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:06:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:06:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:06:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:06:40 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Updating instance_info_cache with network_info: [{"id": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "address": "fa:16:3e:99:17:42", "network": {"id": "1a61611a-0391-4bde-90de-0f44166caefc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1703595461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db87430885ac4264ae70053d7b3f5686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1522ee3a-81", "ovs_interfaceid": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:06:40 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:06:40 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 22:06:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Acquiring lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:06:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:06:42 user nova-compute[74189]: INFO nova.compute.manager [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Detaching volume dc828471-61dc-4603-be82-463974463d64
Oct 25 22:06:42 user nova-compute[74189]: INFO nova.virt.block_device [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Attempting to driver detach volume dc828471-61dc-4603-be82-463974463d64 from mountpoint /dev/vdb
Oct 25 22:06:42 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Attempting to detach device vdb from instance 937588fa-28ca-451f-b7ff-2af93f8f2f41 from the persistent domain config. {{(pid=74189) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 22:06:42 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 22:06:42 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:06:42 user nova-compute[74189]:   <source dev="/dev/sdb"/>
Oct 25 22:06:42 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:06:42 user nova-compute[74189]:   <serial>dc828471-61dc-4603-be82-463974463d64</serial>
Oct 25 22:06:42 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 22:06:42 user nova-compute[74189]: </disk>
Oct 25 22:06:42 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 22:06:42 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Successfully detached device vdb from instance 937588fa-28ca-451f-b7ff-2af93f8f2f41 from the persistent domain config.
Oct 25 22:06:42 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 937588fa-28ca-451f-b7ff-2af93f8f2f41 from the live domain config. {{(pid=74189) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 22:06:42 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 22:06:42 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:06:42 user nova-compute[74189]:   <source dev="/dev/sdb"/>
Oct 25 22:06:42 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:06:42 user nova-compute[74189]:   <serial>dc828471-61dc-4603-be82-463974463d64</serial>
Oct 25 22:06:42 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 22:06:42 user nova-compute[74189]: </disk>
Oct 25 22:06:42 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 22:06:43 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 937588fa-28ca-451f-b7ff-2af93f8f2f41 {{(pid=74189) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 22:06:44 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:06:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:06:45 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:06:46 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:06:46 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:06:49 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:06:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:06:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:06:49 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:06:49 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 22:06:49 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:06:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:06:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:06:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:06:50 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:06:50 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:06:50 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:06:50 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=8930MB free_disk=24.916763305664062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 22:06:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:06:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:06:50 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 937588fa-28ca-451f-b7ff-2af93f8f2f41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:06:50 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 22:06:50 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 22:06:50 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:06:50 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:06:50 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 22:06:50 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:06:51 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:06:51 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:06:53 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:06:54 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:06:54 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Cleaning up deleted instances {{(pid=74189) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 22:06:54 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] There are 0 instances to clean {{(pid=74189) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 22:06:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:06:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:06:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:06:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:06:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:06:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:06:58 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:06:58 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74189) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 22:07:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:07:03 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 937588fa-28ca-451f-b7ff-2af93f8f2f41 is timed out.
Oct 25 22:07:03 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Successfully detached device vdb from instance 937588fa-28ca-451f-b7ff-2af93f8f2f41 from the live domain config.
Oct 25 22:07:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fxjmbgKu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:07:03 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:07:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[417bf7aa-a16c-402d-9466-90229bd09022]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 22:07:03 user nova-compute[74189]: No targets found.
Oct 25 22:07:03 user nova-compute[74189]: iSNS:
Oct 25 22:07:03 user nova-compute[74189]: No targets found.
Oct 25 22:07:03 user nova-compute[74189]: STATIC:
Oct 25 22:07:03 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64
Oct 25 22:07:03 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:07:03 user nova-compute[74189]:                 Iface Name: default
Oct 25 22:07:03 user nova-compute[74189]: FIRMWARE:
Oct 25 22:07:03 user nova-compute[74189]: No targets found.
Oct 25 22:07:03 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 22:07:03 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 22:07:03 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[53075cc0-7dca-46c8-9454-d356659b15f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03d7841-609d-49f0-a6a4-c5aa0f604f49]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64 (non-flash)
Oct 25 22:07:03 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64 (non-flash)
Oct 25 22:07:03 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe304193be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64'): ({'sdb'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Removing single pathed devices sdb {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[9507be42-cb55-4682-89b3-4d6012e43cda]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[abad5054-a130-495c-9eab-625306a1a076]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Flushing IO for device /dev/sdb {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[6234a311-4729-4950-85d8-2d7ec9455ae9]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7305f80b-ee71-44b6-971c-aa7f5bd3ef34]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] SCSI volumes sdb have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a10d12-aa9a-4233-9fe3-0e7a27bc03b1]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64 -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[444cbf7a-2943-41a9-9f0e-d3ca7191d04b]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64, portal: 172.16.0.220,3260]
Oct 25 22:07:03 user nova-compute[74189]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64, portal: 172.16.0.220,3260] successful.
Oct 25 22:07:03 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64 -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc828471-61dc-4603-be82-463974463d64 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f90eb62-75cd-4a1c-b757-7530bd69225e]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] <== disconnect_volume: return (265ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:07:03 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 22:07:04 user nova-compute[74189]: DEBUG nova.objects.instance [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lazy-loading 'flavor' on Instance uuid 937588fa-28ca-451f-b7ff-2af93f8f2f41 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:07:04 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-812d0528-553d-4898-a41f-598525e96876 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.645s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:07:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:07:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:07:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:07:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:07:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:07:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:07:06 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:07:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:07:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:07:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:07:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:07:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:07:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:07:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:07:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:07:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:07:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:07:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:07:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:07:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:07:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:07:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:07:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:07:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Acquiring lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:07:37 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:07:37 user nova-compute[74189]: DEBUG nova.objects.instance [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lazy-loading 'flavor' on Instance uuid 937588fa-28ca-451f-b7ff-2af93f8f2f41 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:07:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:07:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Acquiring lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:07:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:07:38 user nova-compute[74189]: INFO nova.compute.manager [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Attaching volume b29611cc-f900-4cbf-9919-df6949183224 to /dev/vdb
Oct 25 22:07:38 user nova-compute[74189]: DEBUG os_brick.utils [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:07:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:07:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:07:38 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1501b3-903d-4147-a5f2-c3d408baff64]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:07:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:07:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:07:38 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[69acdd0b-3636-43d7-b06d-b21bb29bb90f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:07:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:07:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:07:38 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5bb2e9-ccea-4074-9fd5-bbf5016948bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:07:38 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[885e9f0a-8506-4132-8b73-68cc496ab25a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:07:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:07:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:07:38 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 22:07:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:07:38 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:07:38 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 22:07:38 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[06bbb6db-ac4e-45bc-93da-231c633ef163]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:07:38 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 22:07:38 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 22:07:38 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 22:07:38 user nova-compute[74189]: DEBUG os_brick.utils [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:07:38 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Updating existing volume attachment record: 23cb939e-78d2-453f-9cde-abcbf7f29fe1 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 22:07:38 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:07:38 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 22:07:39 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:07:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:07:41 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:07:41 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 22:07:41 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Rebuilding the list of instances to heal {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 22:07:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:07:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:07:42 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 22:07:42 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lazy-loading 'info_cache' on Instance uuid 937588fa-28ca-451f-b7ff-2af93f8f2f41 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:07:42 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Updating instance_info_cache with network_info: [{"id": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "address": "fa:16:3e:99:17:42", "network": {"id": "1a61611a-0391-4bde-90de-0f44166caefc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1703595461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db87430885ac4264ae70053d7b3f5686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1522ee3a-81", "ovs_interfaceid": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:07:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:07:42 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 22:07:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:07:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:07:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:07:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:07:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:07:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:07:46 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:07:46 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:07:48 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:07:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:07:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:07:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:07:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:07:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:07:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:07:50 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:07:50 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:07:51 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:07:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:07:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:07:51 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:07:51 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 22:07:51 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:07:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:07:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:07:52 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:07:52 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:07:52 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:07:52 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=8952MB free_disk=24.915950775146484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 22:07:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:07:52 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:07:52 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 937588fa-28ca-451f-b7ff-2af93f8f2f41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:07:52 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 22:07:52 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 22:07:52 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Refreshing inventories for resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 22:07:52 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Updating ProviderTree inventory for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 22:07:52 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Updating inventory in ProviderTree for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 22:07:53 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Refreshing aggregate associations for resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc, aggregates: None {{(pid=74189) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 22:07:53 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Refreshing trait associations for resource provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING {{(pid=74189) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 22:07:53 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:07:53 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:07:53 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 22:07:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.499s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NulFZEVg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:07:55 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:07:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:07:55 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:07:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:07:55 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 22:07:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224 -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf075c6-8a55-4e3c-8d01-19ea6d4bbe14]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 22:07:55 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224 -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7445f612-55f3-4369-a5f5-3a9ab072e841]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224] added
Oct 25 22:07:55 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1317b16a-6ccc-4985-b835-8646bcf49d6c]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a1a1ae-374b-4a04-9e8a-e6e46bd7e28d]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NulFZEVg {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NulFZEVg" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcd9a4d-3aef-4346-b0f9-0f9f17435254]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NulFZEVg'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed14187-da83-4a38-9460-a631a351f222]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[caccaa59-ac23-4b16-ae2c-67477ae0ebc7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 22:07:55 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 22:07:55 user nova-compute[74189]:  {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:07:55 user nova-compute[74189]: WARNING os_brick.initiator.connectors.iscsi [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 22:07:55 user nova-compute[74189]: 
Oct 25 22:07:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224 -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6ac951-a634-4bba-9f32-b3b99da9e6df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224, portal: 172.16.0.220,3260]
Oct 25 22:07:55 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224, portal: 172.16.0.220,3260] successful.
Oct 25 22:07:55 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[248e0853-4609-4901-af8a-e35951a0fdd8]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[88dd034a-e8f6-4773-a38a-52f3b403b863]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224 (non-flash)
Oct 25 22:07:55 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224 (non-flash)
Oct 25 22:07:55 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[835ae4db-5c03-4e84-8a93-9f69c188a22e]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:07:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NulFZEVg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 22:07:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:07:56 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '26333323630636431', 'path': '/dev/sdb'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:07:56 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333323630636431', 'path': '/dev/sdb'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 22:07:56 user nova-compute[74189]: DEBUG nova.objects.instance [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lazy-loading 'flavor' on Instance uuid 937588fa-28ca-451f-b7ff-2af93f8f2f41 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:07:56 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 22:07:56 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:07:56 user nova-compute[74189]:   <source dev="/dev/sdb"/>
Oct 25 22:07:56 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:07:56 user nova-compute[74189]:   <serial>b29611cc-f900-4cbf-9919-df6949183224</serial>
Oct 25 22:07:56 user nova-compute[74189]: </disk>
Oct 25 22:07:56 user nova-compute[74189]:  {{(pid=74189) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 22:07:56 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:07:56 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:07:56 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] No VIF found with MAC fa:16:3e:99:17:42, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:07:57 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-6d2227cc-14ce-4bfe-9a91-783099ef7f0b tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.924s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:07:57 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:07:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Acquiring lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:07:59 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:07:59 user nova-compute[74189]: INFO nova.compute.manager [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Detaching volume b29611cc-f900-4cbf-9919-df6949183224
Oct 25 22:07:59 user nova-compute[74189]: INFO nova.virt.block_device [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Attempting to driver detach volume b29611cc-f900-4cbf-9919-df6949183224 from mountpoint /dev/vdb
Oct 25 22:07:59 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Attempting to detach device vdb from instance 937588fa-28ca-451f-b7ff-2af93f8f2f41 from the persistent domain config. {{(pid=74189) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 22:07:59 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 22:07:59 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:07:59 user nova-compute[74189]:   <source dev="/dev/sdb"/>
Oct 25 22:07:59 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:07:59 user nova-compute[74189]:   <serial>b29611cc-f900-4cbf-9919-df6949183224</serial>
Oct 25 22:07:59 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 22:07:59 user nova-compute[74189]: </disk>
Oct 25 22:07:59 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 22:07:59 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Successfully detached device vdb from instance 937588fa-28ca-451f-b7ff-2af93f8f2f41 from the persistent domain config.
Oct 25 22:07:59 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 937588fa-28ca-451f-b7ff-2af93f8f2f41 from the live domain config. {{(pid=74189) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 22:07:59 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 22:07:59 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:07:59 user nova-compute[74189]:   <source dev="/dev/sdb"/>
Oct 25 22:07:59 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:07:59 user nova-compute[74189]:   <serial>b29611cc-f900-4cbf-9919-df6949183224</serial>
Oct 25 22:07:59 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 22:07:59 user nova-compute[74189]: </disk>
Oct 25 22:07:59 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 22:07:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:08:00 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 937588fa-28ca-451f-b7ff-2af93f8f2f41 {{(pid=74189) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 22:08:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:08:04 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:08:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:08:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:08:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:08:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:08:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:08:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:08:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:08:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:08:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:08:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:08:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:08:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:08:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:08:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:08:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:08:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:08:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:08:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:08:20 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 937588fa-28ca-451f-b7ff-2af93f8f2f41 is timed out.
Oct 25 22:08:20 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Successfully detached device vdb from instance 937588fa-28ca-451f-b7ff-2af93f8f2f41 from the live domain config.
Oct 25 22:08:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NulFZEVg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:08:20 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:08:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[532aff8e-46c5-42ea-b38e-5bffff0b394f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 22:08:20 user nova-compute[74189]: No targets found.
Oct 25 22:08:20 user nova-compute[74189]: iSNS:
Oct 25 22:08:20 user nova-compute[74189]: No targets found.
Oct 25 22:08:20 user nova-compute[74189]: STATIC:
Oct 25 22:08:20 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224
Oct 25 22:08:20 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:08:20 user nova-compute[74189]:                 Iface Name: default
Oct 25 22:08:20 user nova-compute[74189]: FIRMWARE:
Oct 25 22:08:20 user nova-compute[74189]: No targets found.
Oct 25 22:08:20 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 22:08:20 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 22:08:20 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae38be9-cebf-431d-a32b-da34c64094dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d427ecc9-8c53-4d9f-bf1e-b1c14afb5223]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224 (non-flash)
Oct 25 22:08:20 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224 (non-flash)
Oct 25 22:08:20 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe30426b520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224'): ({'sdb'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Removing single pathed devices sdb {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[909ee176-24fd-4e12-96a3-f3167d8397a7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[295ef542-1d4f-4967-a47f-053ffd58438c]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Flushing IO for device /dev/sdb {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5d1cd2-951c-4ffc-8577-52675c8bb586]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[422c2be0-bdb8-4398-95d5-b53b01723b7f]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] SCSI volumes sdb have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdc1d05-a050-40c2-8fb5-7c3ef83c4aaa]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224 -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[656ba625-61e9-469b-b9de-2507b604bf8f]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224, portal: 172.16.0.220,3260]
Oct 25 22:08:20 user nova-compute[74189]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224, portal: 172.16.0.220,3260] successful.
Oct 25 22:08:20 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224 -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b29611cc-f900-4cbf-9919-df6949183224 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f5a815-b70f-4ece-85bb-7e89babf4d08]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] <== disconnect_volume: return (267ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:08:20 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 22:08:21 user nova-compute[74189]: DEBUG nova.objects.instance [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lazy-loading 'flavor' on Instance uuid 937588fa-28ca-451f-b7ff-2af93f8f2f41 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:08:21 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5c6dca18-4788-4109-a1da-21d4fac248b4 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.677s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:08:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:08:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:08:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:08:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:08:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:08:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:08:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:08:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:08:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:08:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:08:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:08:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:08:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:08:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:08:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:08:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:08:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:08:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:08:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:08:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:08:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:08:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:08:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:08:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:08:40 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:08:40 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 22:08:41 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:08:41 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 22:08:41 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Rebuilding the list of instances to heal {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 22:08:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:08:41 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:08:41 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 22:08:41 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lazy-loading 'info_cache' on Instance uuid 937588fa-28ca-451f-b7ff-2af93f8f2f41 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:08:42 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Updating instance_info_cache with network_info: [{"id": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "address": "fa:16:3e:99:17:42", "network": {"id": "1a61611a-0391-4bde-90de-0f44166caefc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1703595461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db87430885ac4264ae70053d7b3f5686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1522ee3a-81", "ovs_interfaceid": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:08:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:08:42 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 22:08:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:08:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:08:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:08:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:08:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:08:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:08:46 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:08:47 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:08:48 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:08:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:08:51 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:08:52 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:08:53 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:08:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:08:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:08:53 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:08:53 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 22:08:53 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:08:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:08:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:08:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:08:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Acquiring lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:08:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:08:54 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:08:54 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:08:54 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=8951MB free_disk=24.915081024169922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 22:08:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:08:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:08:54 user nova-compute[74189]: DEBUG nova.objects.instance [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lazy-loading 'flavor' on Instance uuid 937588fa-28ca-451f-b7ff-2af93f8f2f41 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:08:54 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:08:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:08:54 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 937588fa-28ca-451f-b7ff-2af93f8f2f41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:08:54 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 22:08:54 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 22:08:54 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:08:54 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:08:54 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 22:08:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.309s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:08:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:08:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Acquiring lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:08:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:08:55 user nova-compute[74189]: INFO nova.compute.manager [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Attaching volume 13e189c5-83d8-4f24-9289-9164737fa7a5 to /dev/vdb
Oct 25 22:08:55 user nova-compute[74189]: DEBUG os_brick.utils [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:08:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:08:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:08:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5efd64-3a99-4096-bed2-404d133d2643]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e837fc62b17\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:08:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:08:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:08:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7caae8f1-6940-4887-a063-a008a559d62a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:08:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:08:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:08:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[c895c270-00fa-4a8c-add0-16cf70cb8cee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:08:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[65414bfe-dcd6-4bbf-abe2-e0ba2c507f5a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:08:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Running cmd (subprocess): nvme version {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:08:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] 'nvme version' failed. Not Retrying. {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:08:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] nvme not present on system {{(pid=74189) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 22:08:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:08:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:08:55 user nova-compute[74189]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 22:08:55 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9d9083-7ae7-4be1-9eb5-2cc09cfd7b49]: (4, '') {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:08:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74189) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 22:08:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 22:08:55 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.lightos [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] LIGHTOS: no hostnqn found. {{(pid=74189) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 22:08:55 user nova-compute[74189]: DEBUG os_brick.utils [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e837fc62b17', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:08:55 user nova-compute[74189]: DEBUG nova.virt.block_device [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Updating existing volume attachment record: e4b6d936-8a37-414a-8078-83003c1026f3 {{(pid=74189) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 22:08:56 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:08:59 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:09:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:09:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:09:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:09:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:09:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:09:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:09:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:09:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:09:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:09:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:09:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:09:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:09:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Calling os-brick to attach iSCSI Volume {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uQngyxAC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:09:12 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:09:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:09:12 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:09:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:09:12 user nova-compute[74189]: INFO os_brick.initiator.connectors.iscsi [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 22:09:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5 -p 172.16.0.220:3260 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00fce05-3d36-4b8c-acaf-e4a1b6211dc7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 22:09:12 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd730d22-b28d-4e99-ab27-50a0209dc391]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5] added\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5] added
Oct 25 22:09:12 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ecfa17-7ea7-4959-89ee-b9e9e06dc3dc]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4566367-ac18-4fab-97dd-4dc846c3c826]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uQngyxAC {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uQngyxAC" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b9a6b0-8c84-4c58-8649-f3a95ec000db]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uQngyxAC'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa91748e-07f2-4539-af58-a04479b8d764]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f686b1-edbc-4b06-b604-f51cddc70388]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 22:09:12 user nova-compute[74189]:  {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 22:09:12 user nova-compute[74189]:  {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:09:12 user nova-compute[74189]: WARNING os_brick.initiator.connectors.iscsi [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 22:09:12 user nova-compute[74189]: 
Oct 25 22:09:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5 -p 172.16.0.220:3260 --login {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c055c97-0a22-4a57-9fe4-888b95524b27]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5, portal: 172.16.0.220,3260]
Oct 25 22:09:12 user nova-compute[74189]: Login to [iface: default, target: iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5, portal: 172.16.0.220,3260] successful.
Oct 25 22:09:12 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5850a92-f0ae-4716-9f2f-c1fdcb3c6809]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e8b949-71eb-4ef9-b2b6-bd189f6b9200]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5 (non-flash)
Oct 25 22:09:12 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5 (non-flash)
Oct 25 22:09:12 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Connected to 172.16.0.220:3260 {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=74189) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74189) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[aced81d2-0a76-40b9-bdbb-589ed025a8a1]: (4, ('- - 0', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74189) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:09:12 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uQngyxAC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74189) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 22:09:13 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:09:13 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23137343631393733', 'path': '/dev/sdb'} {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:09:13 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137343631393733', 'path': '/dev/sdb'} {{(pid=74189) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 22:09:13 user nova-compute[74189]: DEBUG nova.objects.instance [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lazy-loading 'flavor' on Instance uuid 937588fa-28ca-451f-b7ff-2af93f8f2f41 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:09:13 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 22:09:13 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:09:13 user nova-compute[74189]:   <source dev="/dev/sdb"/>
Oct 25 22:09:13 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:09:13 user nova-compute[74189]:   <serial>13e189c5-83d8-4f24-9289-9164737fa7a5</serial>
Oct 25 22:09:13 user nova-compute[74189]: </disk>
Oct 25 22:09:13 user nova-compute[74189]:  {{(pid=74189) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 22:09:13 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] No BDM found with device name vda, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:09:13 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74189) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:09:13 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] No VIF found with MAC fa:16:3e:99:17:42, not building metadata {{(pid=74189) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:09:13 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-9debb74c-7618-473c-a158-793df8db6c64 tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.223s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:09:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:09:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:09:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:09:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:09:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:09:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:09:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Acquiring lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:09:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:09:16 user nova-compute[74189]: INFO nova.compute.manager [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Detaching volume 13e189c5-83d8-4f24-9289-9164737fa7a5
Oct 25 22:09:16 user nova-compute[74189]: INFO nova.virt.block_device [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Attempting to driver detach volume 13e189c5-83d8-4f24-9289-9164737fa7a5 from mountpoint /dev/vdb
Oct 25 22:09:16 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Attempting to detach device vdb from instance 937588fa-28ca-451f-b7ff-2af93f8f2f41 from the persistent domain config. {{(pid=74189) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 22:09:16 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 22:09:16 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:09:16 user nova-compute[74189]:   <source dev="/dev/sdb"/>
Oct 25 22:09:16 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:09:16 user nova-compute[74189]:   <serial>13e189c5-83d8-4f24-9289-9164737fa7a5</serial>
Oct 25 22:09:16 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 22:09:16 user nova-compute[74189]: </disk>
Oct 25 22:09:16 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 22:09:16 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Successfully detached device vdb from instance 937588fa-28ca-451f-b7ff-2af93f8f2f41 from the persistent domain config.
Oct 25 22:09:16 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 937588fa-28ca-451f-b7ff-2af93f8f2f41 from the live domain config. {{(pid=74189) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 22:09:16 user nova-compute[74189]: DEBUG nova.virt.libvirt.guest [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 22:09:16 user nova-compute[74189]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:09:16 user nova-compute[74189]:   <source dev="/dev/sdb"/>
Oct 25 22:09:16 user nova-compute[74189]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:09:16 user nova-compute[74189]:   <serial>13e189c5-83d8-4f24-9289-9164737fa7a5</serial>
Oct 25 22:09:16 user nova-compute[74189]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 22:09:16 user nova-compute[74189]: </disk>
Oct 25 22:09:16 user nova-compute[74189]:  {{(pid=74189) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 22:09:17 user nova-compute[74189]: DEBUG nova.virt.libvirt.driver [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 937588fa-28ca-451f-b7ff-2af93f8f2f41 {{(pid=74189) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 22:09:19 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:09:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:09:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:09:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:09:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:09:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:09:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:09:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:09:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:09:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:09:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:09:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:09:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:09:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:09:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:09:37 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 937588fa-28ca-451f-b7ff-2af93f8f2f41 is timed out.
Oct 25 22:09:37 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Successfully detached device vdb from instance 937588fa-28ca-451f-b7ff-2af93f8f2f41 from the live domain config.
Oct 25 22:09:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] calling os-brick to detach iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3041eeaa0>, {'target_iqn': 'iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uQngyxAC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:09:37 user nova-compute[74189]: WARNING os_brick.initiator.connectors.base [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:09:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d167358-4db2-454b-bae6-fe6b2109b5c3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 22:09:37 user nova-compute[74189]: No targets found.
Oct 25 22:09:37 user nova-compute[74189]: iSNS:
Oct 25 22:09:37 user nova-compute[74189]: No targets found.
Oct 25 22:09:37 user nova-compute[74189]: STATIC:
Oct 25 22:09:37 user nova-compute[74189]: Target: iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5
Oct 25 22:09:37 user nova-compute[74189]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:09:37 user nova-compute[74189]:                 Iface Name: default
Oct 25 22:09:37 user nova-compute[74189]: FIRMWARE:
Oct 25 22:09:37 user nova-compute[74189]: No targets found.
Oct 25 22:09:37 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 22:09:37 user nova-compute[74189]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 22:09:37 user nova-compute[74189]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74189) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5', 0)] {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ea0290-61b2-4f0f-ad15-ec5dce975173]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa5ad2b-e45d-41f9-a3e9-0112476af02d]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5 (non-flash)\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5 (non-flash)
Oct 25 22:09:37 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5 (non-flash)
Oct 25 22:09:37 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe2e475dab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5'): ({'sdb'}, set())}) {{(pid=74189) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Removing single pathed devices sdb {{(pid=74189) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[309fdf85-785d-4fb8-ae71-02162714b5bf]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[33eca502-7793-40a4-9ae7-f29b24454cb8]: (4, ('ok\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Flushing IO for device /dev/sdb {{(pid=74189) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d51e07-dced-45d7-859a-4f2f9b9c949e]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74189) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3bbc7c-b630-4fa1-9308-e4d2dbbe28a6]: (4, ('1', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG os_brick.initiator.linuxscsi [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] SCSI volumes sdb have been removed. {{(pid=74189) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5')] {{(pid=74189) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff714ccf-e1e8-44f4-8e48-3101dd48e849]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5 -p 172.16.0.220:3260 --logout {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f1695e-d02c-4313-b93c-8412041f9218]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5, portal: 172.16.0.220,3260]
Oct 25 22:09:37 user nova-compute[74189]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5, portal: 172.16.0.220,3260] successful.
Oct 25 22:09:37 user nova-compute[74189]:  stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5 -p 172.16.0.220:3260 --op delete {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e189c5-83d8-4f24-9289-9164737fa7a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ca8ee8-edc5-4786-96c1-eb17e03ddf29]: (4, ('', '')) {{(pid=85079) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74189) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.base [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] <== disconnect_volume: return (297ms) None {{(pid=74189) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:09:37 user nova-compute[74189]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Disconnected iSCSI Volume {{(pid=74189) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 22:09:38 user nova-compute[74189]: DEBUG nova.objects.instance [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lazy-loading 'flavor' on Instance uuid 937588fa-28ca-451f-b7ff-2af93f8f2f41 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:09:38 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-02fd4b23-840d-4865-8d53-5e7c74e4076a tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.772s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:09:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:09:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:09:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:09:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:09:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:09:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:09:41 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:09:41 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 22:09:42 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:09:42 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 22:09:42 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Rebuilding the list of instances to heal {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 22:09:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:09:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:09:43 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 22:09:43 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lazy-loading 'info_cache' on Instance uuid 937588fa-28ca-451f-b7ff-2af93f8f2f41 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:09:43 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Updating instance_info_cache with network_info: [{"id": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "address": "fa:16:3e:99:17:42", "network": {"id": "1a61611a-0391-4bde-90de-0f44166caefc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1703595461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db87430885ac4264ae70053d7b3f5686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1522ee3a-81", "ovs_interfaceid": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:09:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:09:43 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 22:09:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:09:48 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:09:48 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:09:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:09:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:09:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:09:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:09:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:09:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:09:50 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:09:52 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:09:53 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:09:54 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:09:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:09:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:09:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:09:54 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 22:09:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:09:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:09:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:09:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:09:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:09:55 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:09:55 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:09:55 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=8955MB free_disk=24.914085388183594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 22:09:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:09:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:09:55 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 937588fa-28ca-451f-b7ff-2af93f8f2f41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:09:55 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 22:09:55 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 22:09:55 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:09:55 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:09:55 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 22:09:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:09:58 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:10:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:10:04 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:10:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:10:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:10:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:10:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:10:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:10:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:10:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:10:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:10:41 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:10:41 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 22:10:42 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:10:42 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 22:10:42 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Rebuilding the list of instances to heal {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 22:10:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:10:42 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquired lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:10:42 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Forcefully refreshing network info cache for instance {{(pid=74189) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 22:10:42 user nova-compute[74189]: DEBUG nova.objects.instance [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lazy-loading 'info_cache' on Instance uuid 937588fa-28ca-451f-b7ff-2af93f8f2f41 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:10:43 user nova-compute[74189]: DEBUG nova.network.neutron [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Updating instance_info_cache with network_info: [{"id": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "address": "fa:16:3e:99:17:42", "network": {"id": "1a61611a-0391-4bde-90de-0f44166caefc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1703595461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db87430885ac4264ae70053d7b3f5686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1522ee3a-81", "ovs_interfaceid": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:10:43 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Releasing lock "refresh_cache-937588fa-28ca-451f-b7ff-2af93f8f2f41" {{(pid=74189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:10:43 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Updated the network info_cache for instance {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 22:10:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:10:48 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:10:48 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:10:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:10:52 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:10:53 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:10:53 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:10:54 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:10:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:10:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:10:54 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:10:54 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 22:10:54 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:10:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:10:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:10:55 user nova-compute[74189]: DEBUG oslo_concurrency.processutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:10:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:10:55 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:10:55 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:10:55 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=8959MB free_disk=24.913150787353516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 22:10:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:10:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:10:55 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Instance 937588fa-28ca-451f-b7ff-2af93f8f2f41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74189) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:10:55 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 22:10:55 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 22:10:55 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:10:55 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:10:55 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 22:10:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:10:56 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:10:58 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:11:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:11:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:11:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:11:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5aa0df8e-f5f8-4f06-b630-32310ef2e99f tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Acquiring lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:11:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5aa0df8e-f5f8-4f06-b630-32310ef2e99f tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:11:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5aa0df8e-f5f8-4f06-b630-32310ef2e99f tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Acquiring lock "937588fa-28ca-451f-b7ff-2af93f8f2f41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:11:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5aa0df8e-f5f8-4f06-b630-32310ef2e99f tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:11:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5aa0df8e-f5f8-4f06-b630-32310ef2e99f tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:11:14 user nova-compute[74189]: INFO nova.compute.manager [None req-5aa0df8e-f5f8-4f06-b630-32310ef2e99f tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Terminating instance
Oct 25 22:11:14 user nova-compute[74189]: DEBUG nova.compute.manager [None req-5aa0df8e-f5f8-4f06-b630-32310ef2e99f tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Start destroying the instance on the hypervisor. {{(pid=74189) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 22:11:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:11:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:11:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:11:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:11:14 user nova-compute[74189]: DEBUG nova.compute.manager [req-53234eb1-d0d5-44ce-9dc0-6ab7aebd85d6 req-1fe070de-e474-4fb3-86f5-7b791d01819d service nova] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Received event network-vif-unplugged-1522ee3a-8194-48a5-a462-9ad0a8089dc5 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:11:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-53234eb1-d0d5-44ce-9dc0-6ab7aebd85d6 req-1fe070de-e474-4fb3-86f5-7b791d01819d service nova] Acquiring lock "937588fa-28ca-451f-b7ff-2af93f8f2f41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:11:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-53234eb1-d0d5-44ce-9dc0-6ab7aebd85d6 req-1fe070de-e474-4fb3-86f5-7b791d01819d service nova] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:11:14 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-53234eb1-d0d5-44ce-9dc0-6ab7aebd85d6 req-1fe070de-e474-4fb3-86f5-7b791d01819d service nova] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:11:14 user nova-compute[74189]: DEBUG nova.compute.manager [req-53234eb1-d0d5-44ce-9dc0-6ab7aebd85d6 req-1fe070de-e474-4fb3-86f5-7b791d01819d service nova] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] No waiting events found dispatching network-vif-unplugged-1522ee3a-8194-48a5-a462-9ad0a8089dc5 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:11:14 user nova-compute[74189]: DEBUG nova.compute.manager [req-53234eb1-d0d5-44ce-9dc0-6ab7aebd85d6 req-1fe070de-e474-4fb3-86f5-7b791d01819d service nova] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Received event network-vif-unplugged-1522ee3a-8194-48a5-a462-9ad0a8089dc5 for instance with task_state deleting. {{(pid=74189) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 22:11:14 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:11:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:11:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:11:15 user nova-compute[74189]: INFO nova.virt.libvirt.driver [-] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Instance destroyed successfully.
Oct 25 22:11:15 user nova-compute[74189]: DEBUG nova.objects.instance [None req-5aa0df8e-f5f8-4f06-b630-32310ef2e99f tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lazy-loading 'resources' on Instance uuid 937588fa-28ca-451f-b7ff-2af93f8f2f41 {{(pid=74189) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:11:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:11:15 user nova-compute[74189]: DEBUG nova.virt.libvirt.vif [None req-5aa0df8e-f5f8-4f06-b630-32310ef2e99f tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:02:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1925543989',display_name='tempest-SnapshotDataIntegrityTests-server-1925543989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1925543989',id=53,image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOGkChUSQ65M6kqMAkqrtdgcddHKn/UOMZfWpMTgChDcFgcdxVH59Hqpt4nOgLhLvLihSH9mj/kSS2IDjalVqCx/5TkU5aZO/q4g7cx1jG7wUJc/tzqNn2rRjxNCD6X4w==',key_name='tempest-keypair-342761449',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:02:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db87430885ac4264ae70053d7b3f5686',ramdisk_id='',reservation_id='r-e135oict',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30d9cf7e-df85-44c1-ba4d-30dd2d06a3bd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-392403849',owner_user_name='tempest-SnapshotDataIntegrityTests-392403849-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:02:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f3b0dfb68004254af76c63df3fe595b',uuid=937588fa-28ca-451f-b7ff-2af93f8f2f41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "address": "fa:16:3e:99:17:42", "network": {"id": "1a61611a-0391-4bde-90de-0f44166caefc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1703595461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db87430885ac4264ae70053d7b3f5686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1522ee3a-81", "ovs_interfaceid": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:11:15 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-5aa0df8e-f5f8-4f06-b630-32310ef2e99f tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Converting VIF {"id": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "address": "fa:16:3e:99:17:42", "network": {"id": "1a61611a-0391-4bde-90de-0f44166caefc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1703595461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db87430885ac4264ae70053d7b3f5686", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1522ee3a-81", "ovs_interfaceid": "1522ee3a-8194-48a5-a462-9ad0a8089dc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:11:15 user nova-compute[74189]: DEBUG nova.network.os_vif_util [None req-5aa0df8e-f5f8-4f06-b630-32310ef2e99f tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:17:42,bridge_name='br-int',has_traffic_filtering=True,id=1522ee3a-8194-48a5-a462-9ad0a8089dc5,network=Network(1a61611a-0391-4bde-90de-0f44166caefc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1522ee3a-81') {{(pid=74189) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:11:15 user nova-compute[74189]: DEBUG os_vif [None req-5aa0df8e-f5f8-4f06-b630-32310ef2e99f tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:17:42,bridge_name='br-int',has_traffic_filtering=True,id=1522ee3a-8194-48a5-a462-9ad0a8089dc5,network=Network(1a61611a-0391-4bde-90de-0f44166caefc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1522ee3a-81') {{(pid=74189) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:11:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:11:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1522ee3a-81, bridge=br-int, if_exists=True) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:11:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:11:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:11:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=286cdf84-a723-4894-9d8f-c89154d7725a) {{(pid=74189) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:11:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:11:15 user nova-compute[74189]: INFO os_vif [None req-5aa0df8e-f5f8-4f06-b630-32310ef2e99f tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:17:42,bridge_name='br-int',has_traffic_filtering=True,id=1522ee3a-8194-48a5-a462-9ad0a8089dc5,network=Network(1a61611a-0391-4bde-90de-0f44166caefc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1522ee3a-81')
Oct 25 22:11:15 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-5aa0df8e-f5f8-4f06-b630-32310ef2e99f tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Deleting instance files /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41_del
Oct 25 22:11:15 user nova-compute[74189]: INFO nova.virt.libvirt.driver [None req-5aa0df8e-f5f8-4f06-b630-32310ef2e99f tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Deletion of /opt/stack/data/nova/instances/937588fa-28ca-451f-b7ff-2af93f8f2f41_del complete
Oct 25 22:11:15 user nova-compute[74189]: INFO nova.compute.manager [None req-5aa0df8e-f5f8-4f06-b630-32310ef2e99f tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Took 1.01 seconds to destroy the instance on the hypervisor.
Oct 25 22:11:15 user nova-compute[74189]: DEBUG oslo.service.loopingcall [None req-5aa0df8e-f5f8-4f06-b630-32310ef2e99f tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74189) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 22:11:15 user nova-compute[74189]: DEBUG nova.compute.manager [-] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Deallocating network for instance {{(pid=74189) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 22:11:15 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] deallocate_for_instance() {{(pid=74189) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 22:11:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:11:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:11:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:11:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:11:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:11:16 user nova-compute[74189]: DEBUG nova.network.neutron [-] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Updating instance_info_cache with network_info: [] {{(pid=74189) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:11:16 user nova-compute[74189]: INFO nova.compute.manager [-] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Took 0.78 seconds to deallocate network for instance.
Oct 25 22:11:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5aa0df8e-f5f8-4f06-b630-32310ef2e99f tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:11:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5aa0df8e-f5f8-4f06-b630-32310ef2e99f tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:11:16 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-5aa0df8e-f5f8-4f06-b630-32310ef2e99f tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:11:16 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-5aa0df8e-f5f8-4f06-b630-32310ef2e99f tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:11:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5aa0df8e-f5f8-4f06-b630-32310ef2e99f tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.118s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:11:16 user nova-compute[74189]: INFO nova.scheduler.client.report [None req-5aa0df8e-f5f8-4f06-b630-32310ef2e99f tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Deleted allocations for instance 937588fa-28ca-451f-b7ff-2af93f8f2f41
Oct 25 22:11:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-5aa0df8e-f5f8-4f06-b630-32310ef2e99f tempest-SnapshotDataIntegrityTests-392403849 tempest-SnapshotDataIntegrityTests-392403849-project-member] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.109s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:11:16 user nova-compute[74189]: DEBUG nova.compute.manager [req-49c899f3-e184-413f-b264-dc6c45111d19 req-c904ef7c-fb82-40fb-a2a1-b78118a30ebf service nova] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Received event network-vif-plugged-1522ee3a-8194-48a5-a462-9ad0a8089dc5 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:11:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-49c899f3-e184-413f-b264-dc6c45111d19 req-c904ef7c-fb82-40fb-a2a1-b78118a30ebf service nova] Acquiring lock "937588fa-28ca-451f-b7ff-2af93f8f2f41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:11:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-49c899f3-e184-413f-b264-dc6c45111d19 req-c904ef7c-fb82-40fb-a2a1-b78118a30ebf service nova] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:11:16 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [req-49c899f3-e184-413f-b264-dc6c45111d19 req-c904ef7c-fb82-40fb-a2a1-b78118a30ebf service nova] Lock "937588fa-28ca-451f-b7ff-2af93f8f2f41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:11:16 user nova-compute[74189]: DEBUG nova.compute.manager [req-49c899f3-e184-413f-b264-dc6c45111d19 req-c904ef7c-fb82-40fb-a2a1-b78118a30ebf service nova] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] No waiting events found dispatching network-vif-plugged-1522ee3a-8194-48a5-a462-9ad0a8089dc5 {{(pid=74189) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:11:16 user nova-compute[74189]: WARNING nova.compute.manager [req-49c899f3-e184-413f-b264-dc6c45111d19 req-c904ef7c-fb82-40fb-a2a1-b78118a30ebf service nova] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Received unexpected event network-vif-plugged-1522ee3a-8194-48a5-a462-9ad0a8089dc5 for instance with vm_state deleted and task_state None.
Oct 25 22:11:16 user nova-compute[74189]: DEBUG nova.compute.manager [req-49c899f3-e184-413f-b264-dc6c45111d19 req-c904ef7c-fb82-40fb-a2a1-b78118a30ebf service nova] [instance: 937588fa-28ca-451f-b7ff-2af93f8f2f41] Received event network-vif-deleted-1522ee3a-8194-48a5-a462-9ad0a8089dc5 {{(pid=74189) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:11:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:11:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:11:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:11:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:11:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:11:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:11:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:11:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:11:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:11:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:11:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:11:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:11:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:11:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:11:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:11:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:11:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:11:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:11:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:11:40 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:11:41 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:11:41 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74189) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 22:11:44 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:11:44 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Starting heal instance info cache {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 22:11:44 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Rebuilding the list of instances to heal {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 22:11:44 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Didn't find any instances for network info cache update. {{(pid=74189) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 22:11:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:11:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:11:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:11:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:11:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:11:45 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:11:48 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:11:49 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:11:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:11:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:11:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:11:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:11:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:11:50 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:11:54 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:11:54 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:11:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:11:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:11:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:11:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:11:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:11:55 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:11:55 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:11:55 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:11:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:11:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:11:55 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:11:55 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Auditing locally available compute resources for user (node: user) {{(pid=74189) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 22:11:56 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:11:56 user nova-compute[74189]: WARNING nova.virt.libvirt.driver [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:11:56 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Hypervisor/Node resource view: name=user free_ram=9048MB free_disk=24.94046401977539GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74189) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 22:11:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:11:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:11:56 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 22:11:56 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74189) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 22:11:56 user nova-compute[74189]: DEBUG nova.compute.provider_tree [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed in ProviderTree for provider: 4eea19d7-3bab-440b-873e-a6e9c99ba7fc {{(pid=74189) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:11:56 user nova-compute[74189]: DEBUG nova.scheduler.client.report [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Inventory has not changed for provider 4eea19d7-3bab-440b-873e-a6e9c99ba7fc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74189) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:11:56 user nova-compute[74189]: DEBUG nova.compute.resource_tracker [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Compute_service record updated for user:user {{(pid=74189) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 22:11:56 user nova-compute[74189]: DEBUG oslo_concurrency.lockutils [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=74189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:11:58 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:11:58 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Cleaning up deleted instances {{(pid=74189) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 22:11:58 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] There are 0 instances to clean {{(pid=74189) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 22:11:59 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:12:00 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:12:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:12:05 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:12:06 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:12:09 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:12:10 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:12:11 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:12:12 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:12:12 user nova-compute[74189]: DEBUG oslo_service.periodic_task [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74189) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:12:12 user nova-compute[74189]: DEBUG nova.compute.manager [None req-a1d5510b-7f78-4b30-b427-777c6f210738 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74189) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 22:12:15 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:12:20 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:12:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:12:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:12:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74189) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:12:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:12:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74189) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:12:25 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:12:30 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:12:35 user nova-compute[74189]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74189) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}